Apache Logo
The Apache Way Contribute ASF Sponsors

This was extracted (@ 2018-03-21 21:10) from a list of minutes which have been approved by the Board.
Please Note The Board typically approves the minutes of the previous meeting at the beginning of every Board meeting; therefore, the list below does not normally contain details from the minutes of the most recent Board meeting.

2018 | 2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2001 | 2000 | 1999 | Pre-organization meetings

Impala

21 Feb 2018 [Jim Apple / Chris]

## Description:

Impala is a high-performance distributed SQL engine.

## Issues:

There are no special issues the board should be aware of.

## Activity:

The most prominent activity in January was the branching to prepare for a 3.0
release. Version 2.11.0 was also released in January, and a 2.x branch is
maintained with the anticipated possible release of versions 2.12.0 and
beyond. This branching enabled a number of breaking changes to finally land.

Other notable efforts include:

 * Enhancements to sampled statistics collection
 * The continuation of long-term efforts around the buffer pool
 * The continuation of long-term efforts around Kudu's RPC
 * The enablement of different decimal semantics (for the 3.x branch only)
 * Improved usage of OpenSSL (both performance and correctness)
 * The exposure of more system information in the web UI
 * Multiple improvements to test parallelism performance and correctness

## Health report:

The project remains healthy. There were 124 dev@emails, 62 user@ emails, 106
tickets opened and 104 resolved, and three new patch authors. There were 98
commits, which is consistent with the average rate over 2017 of 92 commits per
month.

## PMC and committer changes:

Tianyi Wang was added as a committer on January 5. Philip Zeyliger was added
as a committer on January 9. The most recent new PMC member was added on
2017-09-27.

## Releases:

2.11.0 was released on January 18.

17 Jan 2018 [Jim Apple / Shane]

## Description:

Impala is a high-performance distributed SQL engine.

## Issues:

There are no special issues the board should be aware of.

## Activity:

Notable efforts in December include work on decimal and floating point
correctness, test and build infrastructure refactoring, the addition of more
debugging and profiling information (and the removal of some less helpful
information), perfomance improvements for computing table statistics, support
for processors with AVX-512, a variety of fixes to runtime filters, and
kerberos handling improvements.

## Health report:

The project is healthy. December was a slower month than November, likely due
to two US holidays at the end of the month. There were 60 commits, 112 dev@
emails, 45 user@ emails, 66 tickets resolved, and 94 tickets opened.

## PMC and committer changes:

Greg Rahn was added as a committer on December 12.  The most recent new PMC
member was added on 2017-09-27.

## Releases:

The release process for 2.11 is underway:
https://s.apache.org/impala-2.11-vote-results

20 Dec 2017 [Jim Apple / Shane]

## Description:

Impala is a high-performance distributed SQL engine.

## Issues:

There are no special issues the board should be aware of.

## Activity:

Impala graduated from the incubator to a TLP on 15 November 2017. The
incubator report covering August, September, and October is available at
https://wiki.apache.org/incubator/November2017.

Notable efforts in November include Hadoop 3.0 compatibility work, TABLESAMPLE
work to compute statistics more quickly, test reliability, decimal arithmetic
type changes, client connectivity bug fixes, and changing the RPC mechanism
for data stream service.

## Health report:

The project is healthy. November had 90 commits, the same as October. The dev
list had 139 emails, compared to 175 in the previous 30 days. The user list
had 31 emails, compared to 17 in the previous 30 days. 109 tickets were
resolved, compared to 101 in October. 122 tickets were created, compared to
130 in October.

Several new contributors have been active.

## PMC and committer changes:

The most recent new PMC member was added on 2017-09-27. Two new committers
were added on 2017-09-29.

## Releases:

The last release was 2017-09-14. Discussions for the next release are in
progress. Discussions of a major (compatibility-breaking) release have
occurred, but there does not appear to be much enthusiasm to do such a release
right now. Some compat-breaking changes, like DECIMAL_V2, are available
already behind feature flags.

15 Nov 2017

Establish the Apache Impala Project

 WHEREAS, the Board of Directors deems it to be in the best interests
 of the Foundation and consistent with the Foundation's purpose to
 establish a Project Management Committee charged with the creation and
 maintenance of open-source software, for distribution at no charge to
 the public, related to a high-performance distributed SQL engine.

 NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee
 (PMC), to be known as the "Apache Impala Project", be and hereby is
 established pursuant to Bylaws of the Foundation; and be it further

 RESOLVED, that the Apache Impala Project be and hereby is responsible
 for the creation and maintenance of software related to a
 high-performance distributed SQL engine; and be it further

 RESOLVED, that the office of "Vice President, Apache Impala" be and
 hereby is created, the person holding such office to serve at the
 direction of the Board of Directors as the chair of the Apache Impala
 Project, and to have primary responsibility for management of the
 projects within the scope of responsibility of the Apache Impala
 Project; and be it further

 RESOLVED, that the persons listed immediately below be and hereby are
 appointed to serve as the initial members of the Apache Impala
 Project:

 * Alex Behm             <abehm@apache.org>
 * Bharath Vissapragada  <bharathv@apache.org>
 * Brock Noland          <brock@apache.org>
 * Carl Steinbach        <cws@apache.org>
 * Casey Ching           <casey@apache.org>
 * Daniel Hecht          <dhecht@apache.org>
 * Dimitris Tsirogiannis <dtsirogiannis@apache.org>
 * Henry Robinson        <henry@apache.org>
 * Ishaan Joshi          <ishaan@apache.org>
 * Jim Apple             <jbapple@apache.org>
 * John Russell          <jrussell@apache.org>
 * Juan Yu               <jyu@apache.org>
 * Lars Volker           <lv@apache.org>
 * Lenni Kuff            <lskuff@apache.org>
 * Marcel Kornacker      <marcel@apache.org>
 * Martin Grund          <mgrund@apache.org>
 * Matthew Jacobs        <mjacobs@apache.org>
 * Michael Brown         <mikeb@apache.org>
 * Michael Ho            <kwho@apache.org>
 * Sailesh Mukil         <sailesh@apache.org>
 * Skye Wanderman-Milne  <skye@apache.org>
 * Taras Bobrovytsky     <tarasbob@apache.org>
 * Tim Armstrong         <tarmstrong@apache.org>
 * Todd Lipcon           <todd@apache.org>

 NOW, THEREFORE, BE IT FURTHER RESOLVED, that Jim Apple be appointed to
 the office of Vice President, Apache Impala, to serve in accordance
 with and subject to the direction of the Board of Directors and the
 Bylaws of the Foundation until death, resignation, retirement, removal
 or disqualification, or until a successor is appointed; and be it
 further

 RESOLVED, that the initial Apache Impala PMC be and hereby is tasked
 with the creation of a set of bylaws intended to encourage open
 development and increased participation in the Apache Impala Project;
 and be it further

 RESOLVED, that the Apache Impala Project be and hereby is tasked with
 the migration and rationalization of the Apache Incubator Impala
 podling; and be it further

 RESOLVED, that all responsibilities pertaining to the Apache Incubator
 Impala podling encumbered upon the Apache Incubator PMC are hereafter
 discharged.

 Special Order 7D, Establish the Apache Impala Project, was
 approved by Unanimous Vote of the directors present.

15 Nov 2017

Impala is a high-performance C++ and Java SQL query engine for data stored in
Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

  Our graduation proposal is in the works.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 No

How has the community developed since the last report?

 There have been 279 Commits:
   git log --format='%ci' | grep -cE '2017-(08|09|10)'

 62 of those commits were by non-committers:
   git log --format='%an %ci' | grep -E '2017-(08|09|10)' | tr -d '0-9\-' | cut -d ' ' -f -2 | sort | uniq -c | sort -n

Of the 37 patch authors, 16 were not committers at the beginning of this reporting period.

 There are three new committers members and one new PPMC member:
   https://lists.apache.org/list.html?dev@impala.apache.org:dfr=2017-8-1|dto=2017-10-31:%22has%20invited%22

Impala has done a fourth release with a third release manager.

Impala has begun graduation procedures: we have held a community discussion and a
community vote on graduation, both unanimous. We have established our intended PMC.
Next, we will draft our charter and hold a discussion on general@incubator.

How has the project developed since the last report?

Impala has removed the old unpartitioned hash and aggregation nodes, relics from
years ago that were kept around for backwards compatibility: the new buffer management
makes these obsolete. Code generation for decimal and timestamp types has been added
to the text scanner, increasing the performance of some queries by up to 19%. More
robust query plans in case of data skew have made some aggregations eight times as fast.
A number of large changes are in-flight, including changes to equivalence class computation
in the planner, more decimal semantics adjustments, min-max filters for Kudu, and
multi-threaded metadata loading that increases the performance of some metadata operations by 8x.

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [ ] Initial setup
 [ ] Working towards first release
 [ ] Community building
 [X] Nearing graduation
 [ ] Other:

Date of last release:

 2017-09-14

When were the last committers or PPMC members elected?

 2017-09-29

Signed-off-by:

 [ ](impala) Tom White
    Comments:
 [X](impala) Todd Lipcon
    Comments:
 [ ](impala) Carl Steinbach
    Comments:
 [X](impala) Brock Noland
    Comments:

IPMC/Shepherd notes:

 Drew Farris (shepherd): Three mentors active on the mailing lists, healthy project, excellent progress towards graduation.

16 Aug 2017

Impala is a high-performance C++ and Java SQL query engine for data stored in
Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

 1. Growth of the developer community
 2.
 3.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 No

How has the community developed since the last report?

 There have been 268 Commits:
   git log --format='%ci' | grep -cE '2017-0(5|6|7)'

 51 of those commits were by non-committers:
   git log --format='%ae %ci' | grep -E '2017-0(5|6|7)' | cut -d ' ' -f 1 | sort | uniq -c | sort -n

 There are two new PPMC members:
   https://lists.apache.org/list.html?dev@impala.apache.org:dfr=2017-2-1|dto=2017-4-30:%22has%20invited%22

Impala has done a third release with a second release manager. Two CVEs were issued, our first ones under the Apache security guidelines.

How has the project developed since the last report?

There have been big changes to the buffer pool, as outlined in https://lists.apache.org/thread.html/f573698455bf2ff9ac2073c778802d0d5c9f3c8be43ede80614259cb@%3Cdev.impala.apache.org%3E . There have also been big changes landing to the RPC layer to improve scalability. Impala now has TABLESAMPLE to allow running queries on only a small percentage of the table for experimenting with queries quickly, and it now works on ADLS.

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [ ] Initial setup
 [ ] Working towards first release
 [X] Community building
 [X] Nearing graduation
 [ ] Other:

 Once the developer community has grown a bit, Impala will be ready
 to contemplate graduation.

Date of last release:

 2017-06-16

When were the last committers or PPMC members elected?

 2017-07-17

Signed-off-by:

 [ ](impala) Tom White
    Comments:
 [x](impala) Todd Lipcon
    Comments:
 [x](impala) Carl Steinbach
    Comments:
 [ ](impala) Brock Noland
    Comments:

17 May 2017

Impala is a high-performance C++ and Java SQL query engine for data stored in
Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

 1. Growth of the developer community
 2.
 3.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 No

How has the community developed since the last report?

 There have been 267 Commits:
   git log --format='%ci' | grep -cE '2017-0(2|3|4)'

 42 of those commits were by non-committers:
   git log --format='%ae %ci' | grep -E '2017-0(2|3|4)' | cut -d ' ' -f 1 | sort | uniq -c | sort -n

 There were 114 emails to the user list. Of the top nine
 participants, six were not committers:
   https://lists.apache.org/trends.html?user@impala.apache.org:dfr=2017-2-1|dto=2017-4-30:

 There are six new committers:
   https://lists.apache.org/list.html?dev@impala.apache.org:dfr=2017-2-1|dto=2017-4-30:%22has%20invited%22

 Two new contributors have announced plans to take on large
 development efforts (JSON support and ppc64le support).

How has the project developed since the last report?

 Two of the "three most important issues to address in the move
 towards graduation" from our last report in February have been
 completed: The bug tracker was transitioned to issues.apache.org,
 and the documentation now describes Apache Impala specifically, not
 any non-Apache extensions. The documentation has also been posted to
 http://impala.incubator.apache.org/docs/build/html/index.html and
 http://impala.incubator.apache.org/docs/build/impala.pdf.

 Many commits have landed since our last report towards increasing
 the performance of metadata.

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [ ] Initial setup
 [ ] Working towards first release
 [X] Community building
 [X] Nearing graduation
 [ ] Other:

 Once the developer community has grown a bit, Impala will be ready
 to contemplate graduation.

Date of last release:

 2017-01-22

When were the last committers or PPMC members elected?

 2017-04-24

Signed-off-by:

 [X](impala) Tom White
    Comments:
 [X](impala) Todd Lipcon
    Comments:
 [X](impala) Carl Steinbach
    Comments:
 [X](impala) Brock Noland
    Comments:

27 Feb 2017

Impala is a high-performance C++ and Java SQL query engine for data stored in
Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

 1. Community growth
 2. Transition of bug tracker to issues.apache.org
 3. Evolution of documentation to describe specifically Apache Impala

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 No

How have the community and project developed since the last report?

 Our last report was in November. Since then, there have been 148
 commits. 49 commits were authored by non-committers, of which 4 new
 commits come from 3 new contributors. dev@ received 496 emails and
 user@ received 53. 443 new issues have been filed. There has been one
 release (our second Apache release) and we have added one new PPMC
 member. Our infrastructure has been transitioning: we moved our
 pre-commit testing out of our old, pre-Apache hosting and we have been
 actively working with Gavin McDonald on migrating our JIRA hosting.

Date of last release:

 2017-01-22

When were the last committers or PPMC members elected?

 2017-01-12

Signed-off-by:

 [x](impala) Tom White
 [x](impala) Todd Lipcon
 [ ](impala) Carl Steinbach
 [ ](impala) Brock Noland

16 Nov 2016

Impala is a high-performance C++ and Java SQL query engine for data stored in
Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

 1. Community growth
 2. Transition of user documentation to Apache hosting
 3. Migration of pre-commit continuous integration testing to
    publicly-available infrastructure

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 No

How has the community developed since the last report?

 Our last report was in August. Since then, we have five new
 contributors who have authored patches, while two relatively recent
 contributors who were active before August have continued their
 involvement by authoring new patches. Traffic to our developer mailing
 list has grown by about 60%.

How has the project developed since the last report?

 There have been 241 commits since the last report.

 Our status website now has 16 of the 17 listed work items complete. We
 had our first Apache release and have a wiki page describing how to
 perform the release in detail. We scrubbed our code using the RAT tool
 for copyright notices not compliant with the ASF rules. We wrote
 guidelines for contributors on how to become a committer and added a
 new committer. All developer documentation has now moved to the
 Apache-hosted wiki.

Date of last release:

 2016-10-05

When were the last committers or PMC members elected?

 2016-08-18

Signed-off-by:

 [X](impala) Tom White
 [ ](impala) Todd Lipcon
 [ ](impala) Carl Steinbach
 [ ](impala) Brock Noland

17 Aug 2016

Impala is a high-performance C++ and Java SQL query engine for data stored in
Apache Hadoop-based clusters.

Three most important issues to address in the move towards graduation:

 1. Transition of development workflows to ASF (see
    https://issues.cloudera.org/browse/IMPALA-3221)
 2. Initial release as incubating project.
 3. Community growth

Any issues that the Incubator PMC or ASF Board might wish/need to be aware of?

 No.

How has the community developed since the last report?

 Our last report was in April. Since then

 * Six new contributors have submitted patches for review, and two
   contributors new to the project since incubation have continued to send
   patches.
 * Mailing list activity more than doubled in the four months since our
   last report compared to the four months before that, from 31 threads to
   75 threads (excluding patch review comments)

How has the project developed since the last report?

 * The podling name search was completed:
   https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-96
 * Trademark handoff was completed
 * Impala's git repository is now hosted on ASF infrastructure
 * Impala's website's source is hosted on ASF’s git infrastructure and the
   website is now available on https://impala.apache.org
 * Project bylaws have been ratified: https://impala.apache.org/bylaws.html
 * Developer documentation has started to move to the ASF-hosted wiki:
   https://cwiki.apache.org/confluence/collector/pages.action?key=IMPALA
 * Work has begun in migrating to ASF-hosted JIRA
 * A patch changing the copyright headers is in review

Date of last release:

 No releases have been made yet.

When were the last committers or PMC members elected?

 No committers or PMC members have been added since incubation began.

Signed-off-by:

 [X](impala) Tom White
 [ ](impala) Todd Lipcon
 [ ](impala) Carl Steinbach
 [ ](impala) Brock Noland

20 Apr 2016

Impala is a high-performance C++ and Java SQL query engine for data stored
in Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

 1. Transition of development workflows to ASF (see
    https://issues.cloudera.org/browse/IMPALA-3221)
 2. Initial release as incubating project.
 3. Community growth

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None.

How has the community developed since the last report?

 There have been no additions to the committer or PMC lists since
 incubation began. We continue to see an uptick in external contributions,
 with two patches from new contributors this month. One contributor
 pleasingly reported it was "great to work closely with Impala community".

How has the project developed since the last report?

 We have put together a list of tasks required to move development of
 Impala from Cloudera's infrastructure to the ASF. Since Impala was already
 a well-established project before the Incubator proposal, there is perhaps
 more decoupling required than for more nascent projects. The list is at
 https://issues.cloudera.org/browse/IMPALA-3221, and is being actively
 worked on. Note that this doesn't cover the standard podling tasks (like
 name search, etc).

Date of last release:

 None since entering incubation.

When were the last committers or PMC members elected?

 None since entering incubation.

Signed-off-by:

 [X](impala) Tom White
 [ ](impala) Todd Lipcon
 [ ](impala) Carl Steinbach
 [ ](impala) Brock Noland

16 Mar 2016

Impala is a high-performance C++ and Java SQL query engine for data stored
in Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

 1. Movement of existing JIRA / Git / wiki resources to Apache
    equivalents
 2. Initial release as incubating project.
 3. Community growth

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None.

How has the community developed since the last report?

 There have been no additions to the committer or PMC lists since
 incubation began. However, we have seen an uptick in external
 contributions, both through code, and in discussion on the mailing list.
 One contributor has been attempting to port Impala to PPC, and has
 reported some success after asking many questions.

How has the project developed since the last report?

 We have made some slow progress with our initial infrastructure tasks.
 Code review traffic is now copied to dev@impala.incubator.apache.org,
 which means that developer discussions are now happening on the mailing
 lists.

 We have a number of infrastructure tasks ahead of us which are blocked on
 the current Impala team at Cloudera being very busy with an internal
 release (this is one reason we look forward to a more diverse community!).
 For example:

 1. We would like to move our Git repository to .apache.org in short order,
    but as it stands the existing repo is 10GB large and historically
    contains many binary artifacts that, while acceptably licensed, have no
    useful place in Impala's repository. We need to strip these artifacts
    from the Git history, and then adjust Gerrit to commit to the new
    branch in the new repo. This is not hard but takes some time.
 2. We would also like to move our JIRA tickets from issues.cloudera.org to
    issues.apache.org. Experience in a sister podling has shown that this
    isn't straightforward if we wish to preserve existing release labels,
    user assignments and so on, so requires some time.

 We anticipate having much more time to work on these basic issues after
 the end of February. We look forward to getting Impala into a position
 where it is easier for the larger community to collaborate on these kinds
 of project management issues.

Date of last release:

 None since entering incubation.

When were the last committers or PMC members elected?

 None since entering incubation.

Signed-off-by:

 [X](impala) Tom White
 [ ](impala) Todd Lipcon
 [ ](impala) Carl Steinbach
 [ ](impala) Brock Noland

20 Jan 2016

Impala is a high-performance C++ and Java SQL query engine for data stored
in Apache Hadoop-based clusters.

Impala has been incubating since 2015-12-03.

Three most important issues to address in the move towards graduation:

 1. Resolve any issues around use of Gerrit as code-review tool.
 2. Movement of existing JIRA / Git / wiki / e-mail resources to Apache
    equivalents
 3. Initial release as incubating project.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None.

How has the community developed since the last report?

 Slowly - Impala is still in the very early stages of incubation, and
 performing the mechanical tasks of code movement and infrastructure setup
 is our first priority. The holiday period in the United States has slowed
 this effort slightly, but we look forward to picking up pace in early
 2016.  There have been no additions to the committer or PMC lists since
 incubation began.

How has the project developed since the last report?

 We have performed some of the basic initial tasks for incubation -
 establishing wiki pages, Git repositories and accounts for the initial
 committer set. Our next steps are:

 1. Finalize the SGA from Cloudera
 2. Move existing @cloudera.org e-mail aliases to their
    @impala.incubator.apache.org equivalents.
 3. Move source code from Cloudera git repository to Apache git repo.
 4. Improve out-of-box build and test experience so that community can
    easily evaluate release artifacts.
 5. Migrate cloudera.org JIRA tickets to issues.apache.org.

Date of last release:

 NA

When were the last committers or PMC members elected?

 At the time of the Incubation vote, 2015-12-03.

Signed-off-by:

 [X](impala) Tom White
 [X](impala) Todd Lipcon
 [ ](impala) Carl Steinbach
 [ ](impala) Brock Noland

Shepherd/Mentor notes: