ApacheCon is Coming 9-12 Sept. 2019 - Las Vegas The Apache Software Foundation
Apache 20th Anniversary Logo

Community-led development "The Apache Way"

Apache Support Logo

This was extracted (@ 2020-09-29 22:10) from a list of minutes which have been approved by the Board.
Please Note The Board typically approves the minutes of the previous meeting at the beginning of every Board meeting; therefore, the list below does not normally contain details from the minutes of the most recent Board meeting.

Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).

Pinot

19 Aug 2020

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2019-03-01.

### Three most important unfinished issues to address before graduating:

 1. None
 2.
 3.

### Are there any issues that the IPMC or ASF Board need to be aware of?

 None

### How has the community developed since the last report?

 - We have 470+ users on slack - all slack discussions are forwarded to the
 project mailing list.

### How has the project developed since the last report?

 - Released 0.4.0
 - Voted Ting Chen and Kartik Khare as a new committer.
 - Voted Jackie and Xiang Fu to PPMC

### How would you assess the podling's maturity?
 Please feel free to add your own commentary.

 - [ ] Initial setup
 - [ ] Working towards first release
 - [ ] Community building
 - [X] Nearing graduation
 - [ ] Other:

### Date of last release:

 2020-07-14

### When were the last committers or PPMC members elected?

 July 2020

### Have your mentors been helpful and responsive?
 Are things falling through the cracks? If so, please list any
 open issues that need to be addressed.

### Is the PPMC managing the podling's brand / trademarks?
 Are 3rd parties respecting and correctly using the podlings
 name and brand? If not what actions has the PPMC taken to
 correct this? Has the VP, Brand approved the project name?

### Signed-off-by:

 - [X] (pinot) Kishore Gopalakrishna
    Comments:
 - [X] (pinot) Jim Jagielski
    Comments:
 - [ ] (pinot) Olivier Lamy
    Comments:
 - [X] (pinot) Felix Cheung
    Comments:  What's the next step towards graduation?

### IPMC/Shepherd notes:

17 Jun 2020

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

### Three most important unfinished issues to address before graduating:

 1. What's the criteria on the mailing list activity for graduation? We
 have 350+ users on slack (almost doubled since last report), and have avg
 ~10 threads per month in the mailing list since Feb.
 2.
 3.

### Are there any issues that the IPMC or ASF Board need to be aware of?
 No answer.

### How has the community developed since the last report?
 1. The usage of Pinot kept growing. We have 350+ users on slack (almost
 doubled since last report), and the usage of the mailing list also
 increased.
 2. Voted Haibo Wang as a new committer.
 3. Number of Pinot contributors crossed 100.
 4. Held the first ever Pinot meetup. LinkedIn, Uber and startups shared
 their stories with 100+ online attendees.
 5. Added Jim Jagielski as new Mentor.

### How has the project developed since the last report?
 1. 200+ commits in the last 3 months.
 2. Lots of new features were added and working towards 1.0 release.

### How would you assess the podling's maturity?
 Please feel free to add your own commentary.

 - [ ] Initial setup
 - [ ] Working towards first release
 - [ ] Community building
 - [X] Nearing graduation
 - [ ] Other:

### Date of last release:
 2020-03-25

### When were the last committers or PPMC members elected?
 2020-04-10

### Have your mentors been helpful and responsive?
 No answer.

### Is the PPMC managing the podling's brand / trademarks?
 No answer.

### Signed-off-by:

 - [ ] (pinot) Kishore Gopalakrishna
    Comments:
 - [X] (pinot) Jim Jagielski
    Comments:
 - [ ] (pinot) Olivier Lamy
    Comments:
 - [X] (pinot) Felix Cheung
    Comments:

### IPMC/Shepherd notes:
 Justin Mclean: 3 of the questions asked were not answered. Please
 answer them next report.

19 Feb 2020

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

### Three most important unfinished issues to address before graduating:

 1. Activity on the mailing list. Most of the discussion happens on pinot
 slack channel
 2. Pinot has close to 200 members on the slack channel. We asked users to
 join the mailing list but very few did.
 3. We are planning to write slack hooks to post discussion summary in the
 slack channel to the mailing list.

### Are there any issues that the IPMC or ASF Board need to be aware of?

 1. Most Apache projects have slack channels, is there any effort from
 IPMC to formally recognize project slack channel as a first-class citizen.
 2. If there is any interest, the Pinot Podling can volunteer to drive
 this effort.

### How has the community developed since the last report?
 1. The usage of Pinot is growing and we have close to 200 users on slack
 2. Voted Sidd as a new committer.
 3. Pinot has close to 100 contributors

### How has the project developed since the last report?

 1. 100+ commits in the last 3 months.
 2. Lots of new features were added and working towards 1.0 release

### How would you assess the podling's maturity?
Please feel free to add your own commentary.

 - [ ] Initial setup
 - [ ] Working towards first release
 - [x] Community building
 - [x] Nearing graduation
 - [ ] Other:

### Date of last release:

 2019-11-22

### When were the last committers or PPMC members elected?
 2020-01-08

### Have your mentors been helpful and responsive?
 No answer.

### Is the PPMC managing the podling's brand / trademarks?
 No answer.

### Signed-off-by:

 - [X] (pinot) Kishore Gopalakrishna
    Comments:
 - [X] (pinot) Jim Jagielski
    Comments:
 - [X] (pinot) Olivier Lamy
    Comments: what about moving the slack channel to ASF slack?
 - [X] (pinot) Felix Cheung
    Comments:

### IPMC/Shepherd notes:
 Justin Mclean: While Slack its a useful tool it should not
 replace asynchronous communication. If the project wants to
 try an experiment please discuss with the incubator to work
 out the details.
 Justin Mclean: This report is a bit minimal, and you failed
 to answer some questions can you please include more detail
 next time.

20 Nov 2019

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

### Three most important unfinished issues to address before graduating:

 1. Streamline Pinot releases (currently blocked due to helix bugs)
 2. More commits from wider community

### Are there any issues that the IPMC or ASF Board need to be aware of?
 No

### How has the community developed since the last report?
 Multiple design and code checkins from the community:
  1. Parquet/ORC support for ingestion
  2. Better integration with Kubernetes
  3. (In progress) Null value support
  4. Other contributions
     - https://github.com/apache/incubator-pinot/pull/4770
     - https://github.com/apache/incubator-pinot/pull/4615
     - https://github.com/apache/incubator-pinot/pull/4750
     - https://github.com/apache/incubator-pinot/pull/4571
     - https://github.com/apache/incubator-pinot/pull/4293
     - https://github.com/apache/incubator-pinot/pull/4020
     - https://github.com/apache/incubator-pinot/pull/3977

### How has the project developed since the last report?
  1. Significant progress in SQL support (distinct, order by)
  2. Completed design of schema updates, implementation starting
  3. Progress in design of realtime segment completion, some implementation

### How would you assess the podling's maturity?
Please feel free to add your own commentary.

 - [ ] Initial setup
 - [ ] Working towards first release
 - [ ] Community building
 - [X] Nearing graduation
 - [ ] Other:

### Date of last release:

 2019-02-15

### When were the last committers or PPMC members elected?

 No answer.

### Have your mentors been helpful and responsive?

 No answer.

### Signed-off-by:

 - [ ] (pinot) Kishore Gopalakrishna
    Comments:
 - [X] (pinot) Jim Jagielski
    Comments:
 - [ ] (pinot) Roman Shaposhnik
    Comments:
 - [X] (pinot) Olivier Lamy
    Comments:
 - [X] (pinot) Felix Cheung
    Comments:  good progress.. how can we grow more committers? also dev@
    traffic is very light - only 9 threads in the last 3 months.

### IPMC/Shepherd notes:
 Dave Fisher - I see the start of a VOTE for a committer on private@
 There has been no response from other PPMC members. That is disappointing.
 This could be because most of the PPMC members are not subscribed to
 private@. This includes one of the Mentors who signed off on the report.

 Justin Mclean: The items listed under community development seem more
 about project development. How has the community developed?
 I'd also like to see answer to all questions, it make it hard to
 judge process and for us to help if information is not supplied.

21 Aug 2019

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

### Three most important unfinished issues to address before graduating:

  1. Increasing frequency of release
  2. Adding more committers from open source community
  3. Getting word out from community (blogs, etc.)

### Are there any issues that the IPMC or ASF Board need to be aware of?

  Pinot release is scheduled to happen quarterly but has been delayed due
  to a bug we found in helix that was very hard to track down.
  https://github.com/apache/helix/issues/331. We finally
  found the issue, and should be cutting the next release shortly.

### How has the community developed since the last report?
  We have had open-source contributions to integrate Calcite SQL parser,
  support for transforms in selections and filters, support for kafka-2.0,
  and several other bug fixes and performance enhancements. Other
  contributions on upsert feature, and deep-store commit are in the design
  process.
  Contributions from outside of Linkedin:
   - UDF support in filter predicates:
   https://github.com/apache/incubator-pinot/pull/4365
   - Kafka 2.0 support (work authored across open source community):
   https://github.com/apache/incubator-pinot/pull/4397
   - Variable length bytes dictionary support:
   https://github.com/apache/incubator-pinot/pull/4321
   - PQL to SQL enhancement Phase-1 :
   https://github.com/apache/incubator-pinot/pull/4216
   - Ideas and discussions on null value support:
   https://github.com/apache/incubator-pinot/issues/4230
   - Ideas and discussions on SQL support:
   https://github.com/apache/incubator-pinot/issues/4219


### How has the project developed since the last report?
  1. Support for Kafka-2.0 added
  2. Work in progress to move closer to SQL syntax and semantics for
  constructs supported.
  3. Helix and Pinot controller separation in final phase of development.

### How would you assess the podling's maturity?
Please feel free to add your own commentary.

  - [ ] Initial setup
  - [ ] Working towards first release
  - [ ] Community building
  - [X] Nearing graduation
  - [ ] Other:

### Date of last release:

  2019-02-15

### When were the last committers or PPMC members elected?

  No new PPMC members or committers since incubation

### Have your mentors been helpful and responsive?

 Yes, mentors have been super-helpful and respond to questions in a timely
  manner.

### Signed-off-by:

  - [ ] (pinot) Kishore Gopalakrishna
     Comments:
  - [X] (pinot) Jim Jagielski
     Comments:
  - [ ] (pinot) Roman Shaposhnik
     Comments:
  - [ ] (pinot) Olivier Lamy
     Comments:
  - [X] (pinot) Felix Cheung
     Comments:  Nice improvements to the project. Agreed next steps would
     be on community building.

### IPMC/Shepherd notes:

15 May 2019

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

Three most important unfinished issues to address before graduating:

 1. Building community contribution
 2. Establish a successful release cadence

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None

How has the community developed since the last report?

 External contributors have made improvements to real-time segment
 split-commit algorithm to minimize controller access to segment store
 during segment commit phase. In addition they have also contributed
 towards other bug fixes, especially in the real-time area.

How has the project developed since the last report?

 - We made our first release Apache Pinot 0.1.0
 - We have added and improved a lot more documentation

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [ ] Initial setup
 [ ] Working towards first release
 [x] Community building
 [ ] Nearing graduation
 [ ] Other:

Date of last release:

 2019-03-07

When were the last committers or PPMC members elected?

 Committer Xiang Fu, who was already in the incubator proposal, was added.

Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.

 Yes mentors have been helpful and responsive

Signed-off-by:

 [ ](pinot) Kishore Gopalakrishna
 Comments:
 [x](pinot) Jim Jagielski
 Comments:
 [ ](pinot) Roman Shaposhnik
 Comments:
 [ ](pinot) Olivier Lamy
 Comments:
 [x](pinot) Felix Cheung
 Comments: great!

IPMC/Shepherd notes:
 Drew Farris (shepherd): Looking great. At least 3 mentors active,
 observed development activity and interaction on the mailing lists.

20 Mar 2019

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

Three most important issues to address in the move towards graduation:

 1. Improving documentation
 2. Cutting a release
 3. Building community contribution

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None

How has the community developed since the last report?

 External contributors have added some new features and improved
 documentations.
 - Adding parquet record reader
   https://github.com/apache/incubator-pinot/pull/3852
 - Adding an aggregation function for population standard
   variance
   https://github.com/apache/incubator-pinot/pull/3850
 - Improving documentation
   https://github.com/apache/incubator-pinot/pull/3826

How has the project developed since the last report?

 - We finished to update LICENSE/NOTICE files for both source
   and binary releases. (this item was ongoing for the last report)
 - We have updated pom files for release preparation.
   (adding rat, maven-release-plugin, maven-checksum-plugin...etc)
 - We are currently in the voting process for the first
   Apache release candidate.

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [ ] Initial setup
 [X] Working towards first release
 [ ] Community building
 [ ] Nearing graduation
 [ ] Other:

Date of last release:

 N/A

When were the last committers or PPMC members elected?

 We haven't had a change in committers or PPMC since our incubation.

Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.

 Yes, mentors have been very helpful and have responded in a timely
 manner. They also helped us on release verification for a community
 vote.

Signed-off-by:

 [X](pinot) Kishore Gopalakrishna
    Comments:
 [ ](pinot) Jim Jagielski
    Comments:
 [ ](pinot) Roman Shaposhnik
    Comments:
 [X](pinot) Olivier Lamy
    Comments:
 [X](pinot) Felix Cheung
    Comments: Congrats on vote passing on your first release

IPMC/Shepherd notes:

20 Feb 2019

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

Three most important issues to address in the move towards graduation:

 1.Improving documentation
 2.Cutting a release
 3.Building community contribution

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None

How has the community developed since the last report?

 We have had interest from Slack to contribute to
 https://github.com/apache/incubator-pinot/issues/2798

How has the project developed since the last report?
 We are preparing for a release in Feb.
 - Source file headers have been updated to include Apache licenses.
 - Package names moved from com.linkedin to org.apache.
 - Additional work related to this effort can be tracked via
   https://github.com/apache/incubator-pinot/pull/3722

 The website (https://pinot.apache.org/) has been updated. Primary changes
 include updated landing page and documentation now links to updated
 read-the-docs.

 All previously released bits have been removed.

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [X] Initial setup
 [ ] Working towards first release
 [ ] Community building
 [ ] Nearing graduation
 [ ] Other:

Date of last release:

 N/A

When were the last committers or PPMC members elected?

 I believe this was soon after our incubation. @kishoreg may have more
 information on this. (kishoreg confirmed no new committer)

Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.

 Yes, the mentors have been very helpful and have responded in a timely
 manner.

Signed-off-by:

 [ ](pinot) Kishore Gopalakrishna
    Comments:
 [ ](pinot) Jim Jagielski
    Comments:
 [ ](pinot) Roman Shaposhnik
    Comments:
 [X](pinot) Olivier Lamy
    Comments:
 [X](pinot) Felix Cheung
    Comments: dev@ discussions are picking up, great job!

IPMC/Shepherd notes:
 Justin Mclean: Please mention the issue of unapproved releases.
   Thanks for resolving this quickly.

16 Jan 2019

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

Three most important issues to address in the move towards graduation:

 1. Improving documentation
 2. Cutting a release
 3. Building community contribution


Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 None

How has the community developed since the last report?

 We have had interest from Uber in contributing towards proposals
 discussed in Issues 3592 and 3539

How has the project developed since the last report?

 Source repo migrated to Apache, mailing lists and JIRA created. Website
 created.
 We have added a minimal wiki page. We have added documentation on many
 user-facing features.

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [X] Initial setup
 [ ] Working towards first release
 [ ] Community building
 [ ] Nearing graduation
 [ ] Other:

Date of last release:

 N/A

When were the last committers or PPMC members elected?

Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.

Signed-off-by:

 [ ](pinot) Kishore Gopalakrishna
    Comments:
 [X](pinot) Jim Jagielski
    Comments:
 [ ](pinot) Roman Shaposhnik
    Comments:
 [X](pinot) Olivier Lamy
    Comments:
 [X](pinot) Felix Cheung
    Comments:

IPMC/Shepherd notes:

21 Nov 2018

Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.

Pinot has been incubating since 2018-10-17.

Three most important issues to address in the move towards graduation:

 We are just starting the incubation and don't have much to report. Few
 things we are working on:
 1. Migrate the code base from LinkedIn GitHub to Apache GitHub
 2. Finish the initial tasks to set up the podling - website, mailing
 lists, developer icla's etc

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

How has the community developed since the last report?

How has the project developed since the last report?

How would you assess the podling's maturity?
Please feel free to add your own commentary.

 [x] Initial setup
 [ ] Working towards first release
 [ ] Community building
 [ ] Nearing graduation
 [ ] Other:

Date of last release:

 XXXX-XX-XX

When were the last committers or PPMC members elected?

Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.

Signed-off-by:

 [x](pinot) Kishore Gopalakrishna
    Comments:
 [ ](pinot) Jim Jagielski
    Comments: Very, very early in process.
 [ ](pinot) Roman Shaposhnik
    Comments:
 [x](pinot) Olivier Lamy
    Comments:

IPMC/Shepherd notes: