Apache Logo
The Apache Way Contribute ASF Sponsors

This was extracted (@ 2017-10-16 20:10) from a list of minutes which have been approved by the Board.
Please Note The Board typically approves the minutes of the previous meeting at the beginning of every Board meeting; therefore, the list below does not normally contain details from the minutes of the most recent Board meeting.

2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2001 | 2000 | 1999 | Pre-organization meetings

Apex

19 Jul 2017 [Thomas Weise / Ted]

## Description:

Apache Apex is a distributed, large-scale, high-throughput, low-latency, fault
tolerant, unified stream and batch processing platform.

## Issues:

There are currently no issues that require the Board's attention.

## Status/Activity:

In May the community released 3.6.0 of Apex Core (the stream processing
engine). The release adds support for user defined control tuples,
experimental support for DAG plugins and a number of important bug fixes and
improvements.

The next release is expected to be version 3.8.0 of Apex Malhar (the library).
The previous library release was 3.7.0 in March.

Apex was presented at several conferences, including Apache Big Data in Miami
and in June at Berlin Buzzwords and Dataworks Summit in San Jose.

Apex had its one year anniversary as top level project in April; more on
development of community and project can be found here:
http://www.atrato.io/blog/2017/04/25/one-year-apex/

## Community:

- Currently 15 PMC members.
- No new PMC member added in the last 3 months
- Last PMC addition was Chandni Singh 2016-09-07

- Currently 40 committers.
- No new committer added in the last 3 months
- Last committer addition was Devendra Tagare on 2016-08-10

- Contributors: 79 all time, 55 in last 12 months (+3, +1 since last report)

## Releases:

Following are the most recent releases:

- Core 3.6.0 released 2017-05-04
- Malhar 3.7.0 released 2017-03-31

19 Apr 2017 [Thomas Weise / Bertrand]

Apache Apex is a distributed, large-scale, high throughput, low-latency, fault
tolerant, unified stream and batch processing platform.

## Issues:

There are currently no issues that require the Board's attention.

## Status/Activity:

In March the community released 3.7.0 of Apex Malhar library. The release adds
a number of new operators, including S3 line reader (parallel block based), S3
output for tuples and file copy, fixed length parser, Redshift output, more
accumulations for the windowed operator and improvements for performance and
scalability of windowed state management. The release also expands the user
documentation with new sections.

The community is working towards release 3.6.0 of Apex Core, which is the
stream processing engine. The previous release was 3.5.0 in December.

The next release will contain support for user defined control tuples, which
significantly simplify batch applications and window state management with
watermarks (previously to be implemented by the user in operators and
application logic).

Apex was presented at Strata Data conference in San Jose in March and Apex Big
Data World (by DataTorrent) in April. Several Apex community members will
present at Apache Big Data in Miami in May, there are also upcoming
presentations at Berlin Buzzwords and Dataworks Summit in June.

We continue to see increase in user interest and adaption, more info can be
found on the Powered By page on the project web site.

## Community:

- Currently 15 PMC members.
- No new PMC member added in the last 3 months
- Last PMC addition was Chandni Singh 2016-09-07

- Currently 40 committers.
- No new committer added in the last 3 months
- Last committer addition was Devendra Tagare on 2016-08-10

- Contributors: 76 all time, 54 in last 12 months (+9, +9 since last report)

## Releases:

Following are the most recent releases:

- Malhar 3.7.0 released 2017-03-31
- Malhar 3.6.0 released 2016-11-26
- Core 3.5.0 released 2016-12-06

18 Jan 2017 [Thomas Weise / Shane]

## Description:

Apache Apex is a distributed, large-scale, high throughput,
low-latency, fault tolerant, unified stream and batch processing
platform.

## Issues:

There are no issues that require the Board's attention.

## Status/Activity:

In November the community released 3.6.0 of Apex Malhar library, which
added the initial version of SQL support using Apache Calcite,
improvements to windowed state management performance and scalability,
expanded user documentation and many other improvements.

In December followed the 3.5.0 release of Apex Core, which is the stream
processing engine. The previous release was 3.4.0 in May and releases are
generally less frequent than the library. The release contains several
operability improvements and also moves the Apache Hadoop dependency from
2.2 to 2.6, enabling the engine to take advantage of newer features in
Apache Hadoop YARN.

Apex is now also present in Apache Beam; the first version of the
Apex runner is part of the recent 0.4.0 Beam release.

Another integration with Apache SAMOA (incubating) was also completed
recently. Apache SAMOA is an open source platform for mining big data
streams and allows multiple Distributed Stream Processing Engines (DSPEs)
to be integrated into the framework.

Apex was presented at Apache Big Data in Seville, at Big Data Spain in Madrid,
Big Data Conference in Phoenix and also as part of the Apache Beam tutorial
at Strata Singapore. We continue to see increase in interest and adoption,
more info can be found on the Powered By page on the project web site.

## Community:

- Currently 15 PMC members.
- No new PMC member added in the last 3 months
- Last PMC addition was Chandni Singh 2016-09-07

- Currently 40 committers.
- No new committer added in the last 3 months
- Last committer addition was Devendra Tagare on 2016-08-10

- Contributors: 67 all time, 45 in last 12 months

## Releases:

Following are the most recent releases:

- Malhar 3.6.0 released 2016-11-26
- Malhar 3.5.0 released 2016-09-05
- Core 3.5.0 released 2016-12-06

19 Oct 2016 [Thomas Weise / Sam]

## Description:

Apache Apex is a distributed, large-scale, high throughput,
low-latency, fault tolerant, unified stream and batch processing
platform for Apache Hadoop.

## Issues:

There are no issues that require the Board's attention.

## Status/Activity:

September saw the release 3.5.0 of Apex Malhar, with many new
features, including windowing support following the Apache Beam semantics,
support for the same in the high level stream API, new data structures
for incremental checkpointing and many new and improved operators.

https://blogs.apache.org/apex/entry/apache_apex_malhar_3_5

The community is working towards the next release Apex Malhar 3.6.0,
which will continue to expand the operator library, usability with operator
documentation and examples, optimized window state management
and the first iteration of SQL support using Apache Calcite.

The community is also working on integrating Apex as engine into other
frameworks, including Apache Beam (incubating) and Apache SAMOA (incubating).

Apex continues to see increased interest and adaption, a list of organizations
that use Apex and integrations can be found here:

http://apex.apache.org/powered-by-apex.html

~50% YoY growth in contributors
~50% more subscribers on the users@ mailing list over last 6 months.

Continuous presentations with growing worldwide meetup community:

https://www.meetup.com/topics/apache-apex/

Apex will be represented with several talks at upcoming big data conferences,
including Apache Big Data Europe.

## Community:

- Currently 15 PMC members.
- Last PMC addition was Chandni Singh 2016-09-07

- Currently 40 committers.
- Last committer addition was Devendra Tagare on 2016-08-10

https://projects.apache.org/committee.html?apex

- 57 contributors all time

## Releases:

Following are the most recent releases:

- Malhar 3.5.0 released 2016-09-05
- Malhar 3.4.0 released 2016-05-25
- Core 3.4.0 released 2016-05-12

20 Jul 2016 [Thomas Weise / Bertrand]

Apache Apex is a distributed, large-scale, high throughput,
low-latency, fault tolerant, unified stream and batch processing
platform for Apache Hadoop.

## Issues:

There are no issues that require the Board's attention.

## Status/Activity:

Community is working towards the next Malhar release (3.5.0),
notable items are the high level API, extended windowing support
and improving usability of operators.

## Community:

- Currently 14 PMC members.
- Last PMC addition was Siyuan Hua 2016-06-07

- Currently 39 committers.
- No new committer added in the last 3 months
- Last committer addition was Ashish Tadose on 2016-03-11

https://projects.apache.org/committee.html?apex

- 55 contributors all time

## Releases:

Following are the most recent releases:

- Malhar 3.4.0 released 2016-05-25
- Core 3.4.0 released 2016-05-12
- Core 3.2.1 released 2016-04-20

15 Jun 2016 [Thomas Weise / Bertrand]

Apache Apex is a distributed, large-scale, high throughput,
low-latency, fault tolerant, unified stream and batch processing
platform for Apache Hadoop.

## Issues:

There are no issues that require the Board's attention.

## Status/Activity:

Top level project migration tasks were completed with
LDAP groups now properly setup and repositories renamed.

Last month saw releases 3.4.0 of Apex Core and Malhar.
Community is now focused on road map items for the next Malhar
release, especially in the higher level API area, integrations with
other ecosystem projects and improving usability of operators.

Continued presentations at meetups with several events
during next weeks:

http://www.meetup.com/pro/apacheapex/

There will be presentations about Apache Apex at
Hadoop Summit in San Jose.

## Community:

- Currently 14 PMC members.
- Last PMC addition was Siyuan Hua 2016-06-07

- Currently 39 committers.
- Last committer addition was Ashish Tadose on 2016-03-11

https://projects.apache.org/committee.html?apex

- 54 contributors all time

## Releases:

Following are the most recent releases:

- Malhar 3.4.0 released 2016-05-25
- Core 3.4.0 released 2016-05-12
- Core 3.2.1 released 2016-04-20

18 May 2016 [Thomas Weise / Jim]

Apache Apex is a distributed, large-scale, high throughput,
low-latency, fault tolerant, unified stream and batch processing
platform for Apache Hadoop.

## Issues:

Top-level project migration tasks pending:
https://issues.apache.org/jira/browse/INFRA-11718

## Status/Activity:

Development activity towards core release 3.4.0, first release after
graduation (ETA mid May). Also maintaining core 3.2.x and 3.3.x with
bug fixes in response to user demand.

New features recently added include (anti-)affinity support, large
operator state management, new operators for Avro, Parquet, projection,
transform, Apache Geode integration and JDBC storage for dimensional
compute. Apex will also be part of the next Bigtop release.

The community has been active building additional meetup groups:
http://s.apache.org/jKT
Many presentations and uptick in engagement.

Interest in Apex overall is increasing. There will be presentations
at Apache Big Data Vancouver and Hadoop Summit in San Jose.

## Community:

- Currently 13 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition(s) Brennon York and Ilya Ganelin on 2016-01-19

- Currently 40 committers.
- Last committer addition was Ashish Tadose on 2016-03-11

- 53 contributors all time

## Releases:

Following are the most recent releases:

- Core 3.2.1 released 2016-04-20
- Core 3.3.0 released 2016-02-07
- Malhar 3.3.1 released 2016-03-02
- Malhar 3.3.0 released 2016-01-17

## Mailing list activity (30 days):

- dev@apex.apache.org:
 - 125 subscribers (+3):
 - 1435 emails (2180 previously)

- users@apex.apache.org:
 - 103 subscribers (+8):
 - 52 emails (88 previously)

## JIRA activity (30 days):

- 59 tickets created
- 56 tickets closed/resolved


## Git activity (30 days):

- 106 commits
- 50 merged pull requests
- 18 contributors

20 Apr 2016

Establish the Apache Apex Project

 WHEREAS, the Board of Directors deems it to be in the best
 interests of the Foundation and consistent with the
 Foundation's purpose to establish a Project Management
 Committee charged with the creation and maintenance of
 open-source software, for distribution at no charge to
 the public, related to distributed, large-scale, high
 throughput, low-latency, fault tolerant, unified stream
 and batch processing platform for Apache Hadoop.

 NOW, THEREFORE, BE IT RESOLVED, that a Project Management
 Committee (PMC), to be known as the "Apache Apex Project",
 be and hereby is established pursuant to Bylaws of the
 Foundation; and be it further

 RESOLVED, that the Apache Apex Project be and hereby is
 responsible for the creation and maintenance of software
 related to distributed, large-scale, high throughput,
 low-latency, fault tolerant, unified stream and batch
 processing platform for Apache Hadoop; and be it further

 RESOLVED, that the office of "Vice President, Apache Apex" be
 and hereby is created, the person holding such office to
 serve at the direction of the Board of Directors as the chair
 of the Apache Apex Project, and to have primary responsibility
 for management of the projects within the scope of
 responsibility of the Apache Apex Project; and be it further

 RESOLVED, that the persons listed immediately below be and
 hereby are appointed to serve as the initial members of the
 Apache Apex Project:

 * Ilya Ganelin <ilganeli@apache.org>
 * P. Taylor Goetz <ptgoetz@apache.org>
 * Gaurav Gupta <gauravgopi123@apache.org>
 * Pramod Immaneni <pramod@apache.org>
 * Amol Kekre <akekre@apache.org>
 * Justin Mclean <jmclean@apache.org>
 * Chetan Narsude <chetan@apache.org>
 * Chris Nauroth <cnauroth@apache.org>
 * Vlad Rozov <vrozov@apache.org>
 * Hitesh Shah <hitesh@apache.org>
 * Thomas Weise <thw@apache.org>
 * David Yan <davidyan@apache.org>
 * Brennon York <boyork@apache.org>

 NOW, THEREFORE, BE IT FURTHER RESOLVED, that Thomas Weise (thw)
 be appointed to the office of Vice President, Apache Apex, to
 serve in accordance with and subject to the direction of the
 Board of Directors and the Bylaws of the Foundation until
 death, resignation, retirement, removal or disqualification,
 or until a successor is appointed; and be it further

 RESOLVED, that the initial Apache Apex PMC be and hereby is
 tasked with the creation of a set of bylaws intended to
 encourage open development and increased participation in the
 Apache Apex Project; and be it further

 RESOLVED, that the Apache Apex Project be and hereby
 is tasked with the migration and rationalization of the Apache
 Incubator Apex podling; and be it further

 RESOLVED, that all responsibilities pertaining to the Apache
 Incubator Apex podling encumbered upon the Apache Incubator
 Project are hereafter discharged.

 Special Order 7D, Establish the Apache Apex Project, was
 approved by Unanimous Vote of the directors present.

20 Apr 2016

Apex is an enterprise grade native YARN big data-in-motion platform that
unifies stream processing and batch processing.

Apex has been incubating since 2015-08-17.

Three most important issues to address in the move towards graduation:

 None. Incubator graduation VOTE passed: https://s.apache.org/qhTf

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 Resolution to establish Apache Apex as TLP submitted to board.

How has the community developed since the last report?

 The community is very engaged with the development of the project.  We see
 continious uptick in mailing list participaton (2180 messages on dev@ for
 March, 122+ subscribers).

 The community discussed graduation, addressed outstanding issues and
 completed VOTE.

 The community has been active building additional meetup groups:
 http://s.apache.org/jKT
 Many presentations and uptick in engagement.

How has the project developed since the last report?

 Release 3.3.1-icubating of Malhar on 2016-03-02

 Various metrics for March are as follows:
 +---------------------------------------------------+
 |   Metric                         | Core  | Malhar |
 +---------------------------------------------------+
 | Non Merge Commits                |  52   |   22   |
 | Contributors                     |  10   |   11   |
 | Jira New Issues                  |  40   |   31   |
 | Resolved Issues                  |  43   |   20   |
 | Pull Requests merged             |  33   |   12   |
 | Pull Requests proposed           |   2   |   11   |
 +---------------------------------------------------+

 We are anticipating patch release 3.2.1 in April.

Date of last release:

 2016-03-02 Apex (Malhar) 3.3.1-incubating

When were the last committers or PMC members elected?

 2 PPMC members and 1 committer were added since December.
 PPMC and committer list was updated on the status page.

Signed-off-by:

 [X](apex) Chris Nauroth
 [ ](apex) Alan Gates
 [X](apex) Hitesh Shah
 [X](apex) Justin Mclean
 [ ](apex) P. Taylor Goetz
 [X](apex) Ted Dunning

20 Jan 2016

Apex is an enterprise grade native YARN big data-in-motion platform that
unifies stream processing as well as batch processing.

Apex has been incubating since 2015-08-17.

Three most important issues to address in the move towards graduation:

 1. Continue release Apex-Core, and Apex-Malhar on ongoing basis.
 2. Continue grow contributors beyond the initial set.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 No issues, thanks for your support.

How has the community developed since the last report?

 The community is very engaged with the development of the project.

 We see continuous uptick in mailing list participation (1392 messages on
 dev@ for December, 86+ subscribers).

 We have seen new contributors and work to integrate with other Apache
 ecosystem projects such as Geode and NiFi.

 The community has been active building meetup groups in various locations:
 http://s.apache.org/jKT

 Meetup membership grew to ~1000 in less than 4 months

How has the project developed since the last report?

 Release Malhar 3.2.0-incubating on 2015-11-16
 Roadmap published on web site:
 http://apex.incubator.apache.org/roadmap.html
 JIRA migration completed for Core and Malhar.

 Various metrics for December are as follows:
 +---------------------------------------------------+
 |   Metric                         | Core  | Malhar |
 +---------------------------------------------------+
 | Non Merge Commits                |  17   |   18   |
 | Contributors                     |  11   |   10   |
 | Jira New Issues                  |  18   |   32   |
 | Resolved Issues                  |  25   |   14   |
 | Pull Requests merged             |   8   |   16   |
 | Pull Requests proposed           |   5   |   18   |
 +---------------------------------------------------+

 We are anticipating releases for Apex Core and Malhar in January.

Date of last release:

 2015-11-16 Apex (Malhar) 3.2.0-incubating
 2015-10-31 Apex (Core) 3.2.0-incubating

When were the last committers or PMC members elected?

 1 new PPMC member and 2 committers were added in December.
 PPMC and committer list was updated on the status page.

 Due to omission in the incubation proposal initial committers voted to
 adjust PPMC membership as per original intention.  The vote result can be
 found here:  http://s.apache.org/jeJ

Signed-off-by:

 [X](apex) Chris Nauroth
 [X](apex) Alan Gates
 [X](apex) Hitesh Shah
 [X](apex) Justin Mclean
 [X](apex) P. Taylor Goetz
 [X](apex) Ted Dunning

Shepherd/Mentor notes:

 Chris Nauroth:

   There is a very high level of activity across mailing lists and JIRA.
   Development is clearly happening in an open, collaborative way.

18 Nov 2015

Apex is an enterprise grade native YARN big data-in-motion platform that
unifies stream processing as well as batch processing.

Apex has been incubating since 2015-08-17.

Three most important issues to address in the move towards graduation:

 1. Release Apex-Core, and Apex-Malhar on ongoing basis.
 2. Grow contributors beyond the initial set.
 3. Move to using Apache JIRA

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 The project is still using the original Atlassian instance of JIRA.
 INFRA-10144 has tracked the Apache JIRA migration request since August.

How has the community developed since the last report?

 The community is very engaged with the development of the project. There
 have been 788 messages on dev@ for October.

 The community has been active building meetup groups in various locations:
 http://s.apache.org/jKT

 - Number of meetups: 6 in total so far: 4 in USA cities and 2 in Indian
   cities
 - Total members in worldwide Apache Apex meetups: 495
 - Events: 1 in Oct; 4 scheduled in Nov: CapitalOne presentation in
   Chicago; DataTorrent presentation in Pune; GE presentation in San Ramon;
   PubMatic presentation in San Jose;

 Future: Planning to start meetups in more cities, and be able to organize
 2-3 events a month.

How has the project developed since the last report?

 The first release under incubation passed voting. Apex (Core)
 3.2.0-incubating was released 2015-10-30.  The community is currently
 discussing roadmap for upcoming releases.

 Various metrics are as follows:
 +---------------------------------------------------+
 |   Metric                         | Core  | Malhar |
 +---------------------------------------------------+
 | Non Merge Commits                | 159   |   39   |
 | Contributors                     |  15   |    9   |
 | Jira New Issues                  |  58   |   19   |
 | Resolved Issues                  |  34   |   30   |
 +---------------------------------------------------+

 The next release target is Apex Malhar with release candidate expected
 fist week of November.

Date of last release:

 2015-10-30 Apex (Core) 3.2.0-incubating

When were the last committers or PMC members elected?

 Committers and Mentors came about via incubation proposal.

Signed-off-by:

 [X](apex) Chris Nauroth
 [X](apex) Alan Gates
 [X](apex) Hitesh Shah
 [X](apex) Justin Mclean
 [X](apex) P. Taylor Goetz
 [X](apex) Ted Dunning

Shepherd/Mentor notes:

 Chris Nauroth (cnauroth):

   The community continues to show great, open development activity on the
   mailing list.  The first release was handled well with careful attention
   to detail when IPMC members requested a second RC with some changes.  I
   would like to request that the infra team prioritize completion of the
   JIRA migration tracked in INFRA-10144.

 Alan Gates (gates):

   There have been some questions regarding which committers in the project
   are also on the PPMC.  Originally only 6 developers were proposed for
   initial committers, but as part of the entry to incubation this was
   expanded to the current 30+.  The understanding of some in the project
   was that the PPMC still only consisted of those original 6, while the
   other ~24 devs were just committers.  The mentors have explained that it
   does not work this way.  The community is talking through how to
   approach this disconnect.  The mail thread is at
   <http://s.apache.org/qsV>.

21 Oct 2015

Apex is an enterprise grade native YARN big data-in-motion platform that
unifies stream processing as well as batch processing.

Apex has been incubating since 2015-08-17.

Three most important issues to address in the move towards graduation:

 1. Release Apex-Core, and Apex-Malhar at least twice.
 2. Grow contributors beyond the initial set.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None. Thanks for continual support.

How has the community developed since the last report?

 The community is very engaged with the development of the project. There
 have been 485 messages on dev@.

 The community voted and selected the APEX logo which is put on the brand
 new project website at http://apex.incubator.apache.org/

How has the project developed since the last report?

 Various metrics are as follows:
 +---------------------------------------------------+
 |   Metric                         | Core  | Malhar |
 +---------------------------------------------------+
 | Non Merge Commits                |  88   |   33   |
 | Contributors                     |  17   |    9   |
 | Jira Issues                      |  94   |   30   |
 | Resolved Issues                  |  30   |    4   |
 +---------------------------------------------------+

 The project is still using the Atlassian instance of JIRA. The migration to
 Apache JIRA is underway.

 The first release of the project under ASF banner (3.2.0) is targeted to be
 branched off at the end of September.

Date of last release:

 No release under ASF-Incubation code base as yet. Apex-Core, Apex-Malhar
 were last launched on July end in pre Apache days.

When were the last committers or PMC members elected?

 Committers and Mentors came about via incubation proposal.

Signed-off-by:

 [X](apex) Chris Nauroth
 [X](apex) Alan Gates
 [X](apex) Hitesh Shah
 [X](apex) Justin Mclean
 [X](apex) P. Taylor Goetz
 [X](apex) Ted Dunning

Shepherd/Mentor notes:

16 Sep 2015

Apex is an enterprise grade native YARN big data-in-motion platform that
unifies stream processing as well as batch processing.

Apex has been incubating since 2015-08-17.

Three most important issues to address in the move towards graduation:

 1. Complete software donation
 2. Create an incubating web site (<http://apex.incubator.apache.org/>)
 3. Release Apex-Core, and Apex-Malhar at least twice

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None. Thanks for continual support.

How has the community developed since the last report?

 This is the first report. Community incubated few weeks ago.

How has the project developed since the last report?

 This is the first report. The community is now using Apache forums, and
 other tools to collaborate.

Date of last release:

 No release under ASF-Incubation code base as yet. Apex-Core, Apex-Malhar
 was last launched on July end in pre Apache days.

When were the last committers or PMC members elected?

 Committers and Mentors came about via incubation proposal

Signed-off-by:

 [X](apex) Chris Nauroth
 [X](apex) Alan Gates
 [X](apex) Hitesh Shah
 [X](apex) Justin Mclean
 [X](apex) P. Taylor Goetz
 [ ](apex) Ted Dunning

Shepherd/Mentor notes:

 Chris Nauroth (cnauroth):

   We are already seeing substantial public discussion on the dev mailing
   list, both in terms of number of messages and the content of those
   messages.  Collaboration is going well.