This was extracted (@ 2024-12-18 21:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Project Status: Current project status: Healthy, vibrant, active community Issues for the board: None ## Membership Data: Apache Pinot was founded 2021-07-20 (3 years ago) There are currently 41 committers and 12 PMC members in this project. The Committer-to-PMC ratio is roughly 3:1. Community changes, past quarter: - No new PMC members. Last addition was Rong Rong on 2023-09-11. - Abhishek Sharma was added as committer on 2024-10-06 - Caner Balcı was added as committer on 2024-09-13 - Jiapeng Tao was added as committer on 2024-08-27 - Qiaochu Liu was added as committer on 2024-09-13 - Manish Swaminathan was added as committer on 2024-10-18 - Pratik Tibrewal was added as committer on 2024-09-13 ## Project Activity: The community members present frequently in meetups organized via meetup.com. A live meetup at Uber on Aug 27 drew about a 100 participants from various companies across the SF Bay area. A wide range of topics for beginners through advanced were discussed. Basics on Pinot architecture and queries, to more complicated topics like memory optimization in realtime consumption, and providing Differential Privacy on top of pinot. Release 1.2.0 was finalized and released in Aug 2024 ## Community Health: The community has grown to well over 5000 users (judging by the number of unique members in slack channels #general and #troubleshooting). Several active features are being worked on, such as Pauseless consumption, Automatic segment reload, multi-topic ingestion, etc A recent presentation by Vivek Vaidyanathan in P99 conference on Jave Heap memory optimization was well-received.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Project Status: Current project status: Top level project with high activity Issues for the board: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (3 years ago) There are currently 35 committers and 12 PMC members in this project. The Committer-to-PMC ratio is roughly 3:1. Community changes, past quarter: - No new PMC members. Last addition was Rong Rong on 2023-09-11. - No new committers. Last addition was Jia Guo on 2024-04-24. ## Project Activity: Apache Pinot 1.2.0 is scheduled to release in August 2024 12 successful meetups conducted from May to July ## Community Health: Community very healthy on the Apache Pinot slack with 4891 members In total there are 332 contributors to the project
No report was submitted.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Project Status: Current project status: Top level project with high activity. Issues for the board: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (3 years ago) There are currently 34 committers and 12 PMC members in this project. The Committer-to-PMC ratio is roughly 3:1. Community changes, past quarter: - No new PMC members. Last addition was Rong Rong on 2023-09-11. - Gonzalo Ortiz was added as committer on 2024-02-02 - Vivek Iyer was added as committer on 2024-01-15 ## Project Activity: Apache Pinot released version 1.1 on March 25, 2024 Key highlights of the release are: - Multi Stage Engine enhancements and maturity - Support Vector index and Hierarchical Navigable Small Worlds - Approximate algorithms for faster aggregations - Upsert enhancements Five successful meetups conducted for Apache Pinot Apache Pinot website redesigned and released. ## Community Health: Community very healthy on the Apache Pinot slack with 4587 members. 905 commits in the past quarter (38% increase) 523 PRs opened on GitHub, past quarter (-5% change) 504 PRs closed on GitHub, past quarter (-5% change) 133 issues opened on GitHub, past quarter (-34% change) 72 issues closed on GitHub, past quarter (-43% change)
No report was submitted.
No report was submitted.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Project Status: Current project status: Top level project with high activity. Issues for the board: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (2 years ago) There are currently 32 committers and 12 PMC members in this project. The Committer-to-PMC ratio is 8:3. Community changes, past quarter: - Rong Rong was added to the PMC on 2023-09-11 - Ankit Sultana was added as committer on 2023-10-04 ## Project Activity: - Pinot community published release 1.0.0 on 2023-09-19. - Upsert, Queryy time JOIN support, Improving ANSI SQL compliance are the highlighted changes. - Apache Pinot Commiter presented the talk about how we improved "Query Processing Resiliency" at the ASF Conference. ## Community Health: - 936 commits in the past quarter - 65 code contributors in the past quarter. - #troubleshooting channel from Apache Pinot community slack has 3605 members. - Most of the design discussion happens through Github Issues. 368 issues opened and 184 issues closed in the past quarter.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Project Status Top-level project with high activity ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (2 years ago) There are currently 31 committers and 12 PMC members in this project. The Committer-to-PMC ratio is roughly 8:3. Community changes, past quarter: - Rong Rong was added to the PMC on 2023-09-11 - Xiaobing Li was added as committer on 2023-06-14 ## Project Activity: - We changed plans to release 1.0.0 instead of 0.13.0 as reported earlier. 1.0.0 is still compatible with all major features except for stream level realtime consumers which is not being used in the community at all. https://github.com/apache/pinot/issues/10996 This feature was removed. This release is under vote now, and is expected to be completed in a few days. ## Community Health: - 67 code contributors in the past quarter - 447 commits in the past quarter - 36k messages initiated in the #troubleshooting channel alone, that gives us a good idea of the wide aoption and engagement. The channel has 3430 unique members. - The #pinot-dev channel has 486 members now.
No report was submitted.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (2 years ago) There are currently 33 committers and 12 PMC members in this project. Community changes, past quarter: - We closed the voting for Yu Peng to become a new PMC member on 2023-05-09. - We closed the voting for Xiabing Li to become a committer on 2023-05-15. ## Project Activity: - Apache Pinot 0.12.1 was released on 2023-03. - We are going to prepare 0.13.0 release in the next month. - We are actively adding JOIN support for Apache Pinot query engine. ## Community Health: - dev@pinot.apache.org had a 28% increase in traffic in the past quarter - 52 code contributors in the past quarter (6% increase) - 285 commits in the past quarter
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-21 (2 years ago) There are currently 31 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 8:3. Community changes, past quarter: - No new PMC members. We are looking into the committer list for new PMC member. - Jia Guo was added as committer on 2023-01-12 - Saurabh Dubey was added as committer on 2023-02-06 ## Project Activity: - Apache Pinot 0.12.0 was released on 2023-01-26. - We are going to prepare 0.13.0 release in the next month. - We are actively adding JOIN support for Apache Pinot query engine. ## Community Health: - We have merged >80 commits in March with 34 authors. - We >1000 visitors/day for Github page. - We have 3569 users in Apache Pinot slack workspace.
No report was submitted.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Issues: No issues for the board to be aware of ## Membership Data: Apache Pinot was founded 2021-07-20 (a year ago) There are currently 30 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 8:3. Community changes, past quarter: - No new PMC members. Last addition was Felix Cheung on 2021-07-20. - No new committers. Last addition was Rong Rong on 2022-05-05. ## Project Activity: Multi-stage query engine, several UI improvements, adaptive server selection while query processing, pause/resume of realtime streams are just some of the features we have added ## Community Health: We have 3200+ slack members (67% increase from last year) and 1.7M downloads (61% increase from last year)
No report was submitted.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (a year ago) There are currently 30 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 8:3. Community changes, past quarter: - No new PMC members. Last addition was Felix Cheung on 2021-07-20. - No new committers. Last addition was Rong Rong on 2022-05-05. ## Project Activity: We are preparing for the next release (0.11.0) We are adding the NULL value support to the query engine ## Community Health: Overall community health is good. Due to the mid-year holiday season, we got less contributions (commits/PRs/issues), but we do see more contributors showing interest to the project.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (10 months ago) There are currently 30 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 8:3. Community changes, past quarter: - No new PMC members. Last addition was Felix Cheung on 2021-07-20. - Rong Rong was added as committer on 2022-05-05 ## Project Activity: Last major release in April was 0.10.0. Since then, Software development activity: 1. completed work on uploading segments to realtime tables in master branch 2. CSV decoder for realtime added 3. Realtime Native Text Index added 4. Several scalar functions added 5. Continued work on PQL deprecation Early release branch: 1. Multi stage query execution and JOINS ## Community Health: The community continue to see a healthy growth. The number of members on slack is up to 2461. Contributors have been healthy at 34 this month, with 3 of them first time contributors. Number of issues filed is up, as PMCs are keeping a more active track on slack conversations and ensuring those get converted to issues on github.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to the distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Pinot was founded 2021-07-20 (6 months ago) There are currently 29 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 8:3. Community changes, past quarter: - No new PMC members. Last addition was Felix Cheung on 2021-07-20. - Atri Sharma was added as committer on 2021-12-08 - Richard Startin was added as committer on 2022-01-06 - Sajjad Moradi was added as committer on 2021-12-14 ## Project Activity: Software development activity: - We released the 0.9.0 release on 2021-11-17. - We released the 0.9.1 release to address the log4j vulnerability on 2021-12-13. (CVE-2021-45046) - We released the 0.9.2 release to address the swagger-ui vulnerability on 2021-12-15. (CVE-2019-17495) - We released the 0.9.3 release to address the log4j2's improper validation and uncontrolled recursion on 2021-12-24. (CVE-2021-45105) - We are starting to preparing to the 0.10.0 release. Meetups and Conferences: - Pinot Community Meetup is happening monthly basis and we have a lot of PMCs/committers/contributors presenting the project that they work on. https://www.meetup.com/apache-pinot/ https://www.youtube.com/c/StarTree/videos ## Community Health: We see slight decrease in commit activities (-7%). Taking account into the low activity around the holiday in December, we do not need to worry about this slight decrease in activity. Contributor has increased by 6% and we now have 52 active contributors. On the user mailing list side, we don't have notable change. Overall, our community health is good.
## Description: The mission of Apache Pinot is the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Issues: There are no issues requiring board attention ## Membership Data: Apache Pinot was founded 2021-07-20 (4 months ago) There are currently 26 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 7:3. Community changes, past quarter: - No new PMC members. Last addition was Felix Cheung on 2021-07-20. - No new committers were added. ## Project Activity: Several performance improvements introduced (Java 11 specific, inlining binary comparisons, faster bitmap scans, etc.) Segment merge and Rollup feature has been checked in Phase-1 of Native text index is in Release 0.9.0 is in the process of being cut. ## Community Health: Pinot community in the slack channels has gone to 1800+ people. The channel on troubleshooting is busy, and has questions pop up regularly, with other contributors and users (not necessarily committers) also chiming in with answers. Committers and PMC are on top of the questions asked, supporting the community in a timely fashion. The Contribution guidelines we published is well-adopted with contributors putting out design or other documents to suit efficiency.
No report was submitted.
## Description: The mission of Apache Pinot is creation and maintenance of distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case ## Issues: There are no open issues in the project that needs board's attention at the moment. ## Membership Data: Apache Pinot was founded 2021-07-20 (2 months ago) There are currently 26 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 7:3. Community changes, past quarter: - The community slack channel crossed 1700 members. - No new PMC members (project graduated recently). - No new committers were added. ## Project Activity: - We completed the 0.8.0 project release that included various features. Key callouts include: + Enhancements to JSON object indexing and support for nested JSON. + Support for Apache Pulsar and Kinesis streams for realtime ingestion. + Move from Java 8 to Java 11 + Detailed release notes: https://docs.pinot.apache.org/basics/releases/0.8.0 ## Community Health: With the community contributions growing, the PMC met and discussed on standardizing contribution guidelines that ensure productivity from the contributors as well as maintains overall project growth in the right direction. Link can be found here: https://docs.pinot.apache.org/developers/developers-and-contributors/contribution-guidelines
## Description: Distributed OLAP datastore to provide realtime analytics at at low latency. ## Issues: There are no Board-level issues at this time. ## Membership Data: Apache Pinot was founded 2021-07-20 (15 days ago) There are currently 26 committers and 11 PMC members in this project. The Committer-to-PMC ratio is roughly 7:3. Community changes, past quarter: - No new PMC members (project graduated recently). - No new committers were added. ## Project Activity: - Graduate to Top Level Project recently (2021-07-20). - Last release 0.7.1 was published in April 2021, and had various key features: - Advanced indexing for JSON, Geospatial data - Lookup-join - Security enhancements including TLS support - Bug fixes as well as minor enhancements. - Upcoming release 0.8.0 in the works currently ## Community Health: - Close to 1600 members in the Slack community. - Saw pretty healthy commits (320) and PR (243) rates overall. - As the community adoption grows, the rate of github issues saw an uptick (119 new issues). - We continue to encourage new contributors to contribute towards the project starting with beginner tasks to help improve the issues burn rate.
WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache Pinot Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Pinot Project be and hereby is responsible for the creation and maintenance of software related to distributed OLAP data store to provide Real-time Analytics to power wide variety of analytical use case; and be it further RESOLVED, that the office of "Vice President, Apache Pinot" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Pinot Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Pinot Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Pinot Project: * Felix Cheung <felixcheung@apache.org> * Jackie Jiang <jackie@apache.org> * Jim Jagielski <jim@apache.org> * Kishore G <kishoreg@apache.org> * Mayank Shrivastava <mayanks@apache.org> * Neha Pawar <nehapawar@apache.org> * Olivier Lamy <olamy@apache.org> * Seunghyun Lee <snlee@apache.org> * Siddharth Teotia <siddteotia@apache.org> * Subbu Subramaniam <mcvsubbu@apache.org> * Xiang Fu <xiangfu@apache.org> NOW, THEREFORE, BE IT FURTHER RESOLVED, that Kishore G be appointed to the office of Vice President, Apache Pinot, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal of disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Pinot Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Pinot podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Pinot podling encumbered upon the Apache Incubator PMC are hereafter discharged. Special Order 7A, Establish the Apache Pinot Project, was approved by Unanimous Vote of the directors present.
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
### Three most important unfinished issues to address before graduating:
None - After having a discussion on the mailing list with committers,
PMCs, contributors and mentors, we have addressed all the issues. Updated
the project page, maturity model, committer and PMC list on the roster.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
We now have 1000+ members in the Apache Pinot Slack Community - all slack
discussions are forwarded to the project mailing list. Around 10 new
users/contributors are joining the slack channel every couple of weeks and
actively participate in asking questions, discussing feature requests,
issues etc. The community is very active in engaging on both slack and
mailing list with very fast turnaround on discussions.
### How has the project developed since the last report?
Released 0.7.1,
175 new commits merged to master branch in last 3 months (April 2021 to
present),
56 issues closed in last 3 months (April 2021 to present),
64 new issues opened in last 3 months (April 2021 to present)
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation - Project is seeing a strong community growth of
both users and contributors with increasing adoption of Pinot. Very healthy
interaction in the community following the "Apache Way" of doing things.
Have completed the self-assessment of Apache project maturity model
https://cwiki.apache.org/confluence/display/PINOT/Apache+Maturity+Model+Asse
ssment+for+Pinot
- [ ] Other:
### Date of last release:
2021-04-14
### When were the last committers or PPMC members elected?
Siddharth Teotia was invited to PPMC on Feb 23rd 2021 after following the
voting process and getting the votes from existing PPMCs.
### Have your mentors been helpful and responsive?
Mentors have been very responsive and helpful.
### Is the PPMC managing the podling's brand / trademarks?
### Signed-off-by:
- [X] (pinot) Kishore Gopalakrishna
Comments:
- [X] (pinot) Jim Jagielski
Comments:
- [ ] (pinot) Olivier Lamy
Comments:
- [X] (pinot) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
### Three most important unfinished issues to address before graduating:
1. Move ThirdEye code base out of Apache Pinot repo.
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None.
### How has the community developed since the last report?
We now have 900+ members in the Apache Pinot Slack Community - all slack
discussions are forwarded to the project mailing list.
### How has the project developed since the last report?
Released 0.6.0
Github stats in the last one month:
30 authors have pushed 61 commits to master and 134 commits to all
branches.
On master, 347 files have changed and there have been 19,473 additions and
3,444 deletions.
10 issues were resolved, and 24 new issues were opened.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-11-17
### When were the last committers or PPMC members elected?
We have successfully closed the voting for Chinmay Soman and Yupeng Fu as
Apache Pinot Committers on January 26, 2021.
### Have your mentors been helpful and responsive?
Mentors are responsive as well as helpful.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [ ] (pinot) Kishore Gopalakrishna
Comments:
- [ ] (pinot) Jim Jagielski
Comments:
- [ ] (pinot) Olivier Lamy
Comments:
- [X] (pinot) Felix Cheung
Comments: Since some committership were based on Thirdeye
contribution, let's review that before graduation.
### IPMC/Shepherd notes:
Justin Mclean: Please provide an answer to all sections of the
report. Please don't include meaningless stats without
proving some commentary to explain what they mean. It also
be nice to include more information on why the Thirdeye code
was moved out of the repo.
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
### Three most important unfinished issues to address before graduating:
1. None
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
We now have 690+ members in the Apache Pinot Slack Community - all slack
discussions are forwarded to the project mailing list.
### How has the project developed since the last report?
- Released 0.5.0
- Github stats in the last one month:
- 31 authors have pushed 77 commits to master and 100 commits to all
branches.
- On master, 880 files have changed and there have been 22,711
additions and 4,458 deletions.
- 24 issues were resolved, and 28 new issues were opened.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-09-10
### When were the last committers or PPMC members elected?
July 2020
### Have your mentors been helpful and responsive?
No answer.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [ ] (pinot) Kishore Gopalakrishna
Comments:
- [X] (pinot) Jim Jagielski
Comments:
- [ ] (pinot) Olivier Lamy
Comments:
- [X] (pinot) Felix Cheung
Comments:
### IPMC/Shepherd notes:
--------------------
## Ratis
Ratis is a java implementation of the RAFT consensus protocol.
Ratis has been incubating since 2017-01-03.
### Three most important unfinished issues to address before graduating:
The project is ready for graduation. The graduation discussion has
been started on the PPMC private list.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None.
### How has the community developed since the last report?
- 2 new contributors. 49 total contributors.
### How has the project developed since the last report?
- 58 commits since the last report.
- Work done by the community on improving the quality of unit tests.
- The Ratis streaming project is under development (RATIS-979)
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020/07/20 - Ratis 1.0.0.
### When were the last committers or PPMC members elected?
runzhiwang was elected as a committer on Aug 11, 2020.
### Have your mentors been helpful and responsive?
Mentors are helpful.
### Is the PPMC managing the podling's brand / trademarks?
The name is approved.
https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-160
### Signed-off-by:
- [X] (ratis) Uma Maheswara Rao G
Comments: Graduation discussions have been initiated. I feel, the
project is ready for graduation.
- [ ] (ratis) Devaraj Das
Comments:
- [X] (ratis) Arpit Agarwal
Comments:
### IPMC/Shepherd notes:
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2019-03-01.
### Three most important unfinished issues to address before graduating:
1. None
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
- We have 470+ users on slack - all slack discussions are forwarded to the
project mailing list.
### How has the project developed since the last report?
- Released 0.4.0
- Voted Ting Chen and Kartik Khare as a new committer.
- Voted Jackie and Xiang Fu to PPMC
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-07-14
### When were the last committers or PPMC members elected?
July 2020
### Have your mentors been helpful and responsive?
Are things falling through the cracks? If so, please list any
open issues that need to be addressed.
### Is the PPMC managing the podling's brand / trademarks?
Are 3rd parties respecting and correctly using the podlings
name and brand? If not what actions has the PPMC taken to
correct this? Has the VP, Brand approved the project name?
### Signed-off-by:
- [X] (pinot) Kishore Gopalakrishna
Comments:
- [X] (pinot) Jim Jagielski
Comments:
- [ ] (pinot) Olivier Lamy
Comments:
- [X] (pinot) Felix Cheung
Comments: What's the next step towards graduation?
### IPMC/Shepherd notes:
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
### Three most important unfinished issues to address before graduating:
1. What's the criteria on the mailing list activity for graduation? We
have 350+ users on slack (almost doubled since last report), and have avg
~10 threads per month in the mailing list since Feb.
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No answer.
### How has the community developed since the last report?
1. The usage of Pinot kept growing. We have 350+ users on slack (almost
doubled since last report), and the usage of the mailing list also
increased.
2. Voted Haibo Wang as a new committer.
3. Number of Pinot contributors crossed 100.
4. Held the first ever Pinot meetup. LinkedIn, Uber and startups shared
their stories with 100+ online attendees.
5. Added Jim Jagielski as new Mentor.
### How has the project developed since the last report?
1. 200+ commits in the last 3 months.
2. Lots of new features were added and working towards 1.0 release.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-03-25
### When were the last committers or PPMC members elected?
2020-04-10
### Have your mentors been helpful and responsive?
No answer.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [ ] (pinot) Kishore Gopalakrishna
Comments:
- [X] (pinot) Jim Jagielski
Comments:
- [ ] (pinot) Olivier Lamy
Comments:
- [X] (pinot) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Justin Mclean: 3 of the questions asked were not answered. Please
answer them next report.
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
### Three most important unfinished issues to address before graduating:
1. Activity on the mailing list. Most of the discussion happens on pinot
slack channel
2. Pinot has close to 200 members on the slack channel. We asked users to
join the mailing list but very few did.
3. We are planning to write slack hooks to post discussion summary in the
slack channel to the mailing list.
### Are there any issues that the IPMC or ASF Board need to be aware of?
1. Most Apache projects have slack channels, is there any effort from
IPMC to formally recognize project slack channel as a first-class citizen.
2. If there is any interest, the Pinot Podling can volunteer to drive
this effort.
### How has the community developed since the last report?
1. The usage of Pinot is growing and we have close to 200 users on slack
2. Voted Sidd as a new committer.
3. Pinot has close to 100 contributors
### How has the project developed since the last report?
1. 100+ commits in the last 3 months.
2. Lots of new features were added and working towards 1.0 release
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [x] Community building
- [x] Nearing graduation
- [ ] Other:
### Date of last release:
2019-11-22
### When were the last committers or PPMC members elected?
2020-01-08
### Have your mentors been helpful and responsive?
No answer.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [X] (pinot) Kishore Gopalakrishna
Comments:
- [X] (pinot) Jim Jagielski
Comments:
- [X] (pinot) Olivier Lamy
Comments: what about moving the slack channel to ASF slack?
- [X] (pinot) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Justin Mclean: While Slack its a useful tool it should not
replace asynchronous communication. If the project wants to
try an experiment please discuss with the incubator to work
out the details.
Justin Mclean: This report is a bit minimal, and you failed
to answer some questions can you please include more detail
next time.
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
### Three most important unfinished issues to address before graduating:
1. Streamline Pinot releases (currently blocked due to helix bugs)
2. More commits from wider community
### Are there any issues that the IPMC or ASF Board need to be aware of?
No
### How has the community developed since the last report?
Multiple design and code checkins from the community:
1. Parquet/ORC support for ingestion
2. Better integration with Kubernetes
3. (In progress) Null value support
4. Other contributions
- https://github.com/apache/incubator-pinot/pull/4770
- https://github.com/apache/incubator-pinot/pull/4615
- https://github.com/apache/incubator-pinot/pull/4750
- https://github.com/apache/incubator-pinot/pull/4571
- https://github.com/apache/incubator-pinot/pull/4293
- https://github.com/apache/incubator-pinot/pull/4020
- https://github.com/apache/incubator-pinot/pull/3977
### How has the project developed since the last report?
1. Significant progress in SQL support (distinct, order by)
2. Completed design of schema updates, implementation starting
3. Progress in design of realtime segment completion, some implementation
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2019-02-15
### When were the last committers or PPMC members elected?
No answer.
### Have your mentors been helpful and responsive?
No answer.
### Signed-off-by:
- [ ] (pinot) Kishore Gopalakrishna
Comments:
- [X] (pinot) Jim Jagielski
Comments:
- [ ] (pinot) Roman Shaposhnik
Comments:
- [X] (pinot) Olivier Lamy
Comments:
- [X] (pinot) Felix Cheung
Comments: good progress.. how can we grow more committers? also dev@
traffic is very light - only 9 threads in the last 3 months.
### IPMC/Shepherd notes:
Dave Fisher - I see the start of a VOTE for a committer on private@
There has been no response from other PPMC members. That is disappointing.
This could be because most of the PPMC members are not subscribed to
private@. This includes one of the Mentors who signed off on the report.
Justin Mclean: The items listed under community development seem more
about project development. How has the community developed?
I'd also like to see answer to all questions, it make it hard to
judge process and for us to help if information is not supplied.
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
### Three most important unfinished issues to address before graduating:
1. Increasing frequency of release
2. Adding more committers from open source community
3. Getting word out from community (blogs, etc.)
### Are there any issues that the IPMC or ASF Board need to be aware of?
Pinot release is scheduled to happen quarterly but has been delayed due
to a bug we found in helix that was very hard to track down.
https://github.com/apache/helix/issues/331. We finally
found the issue, and should be cutting the next release shortly.
### How has the community developed since the last report?
We have had open-source contributions to integrate Calcite SQL parser,
support for transforms in selections and filters, support for kafka-2.0,
and several other bug fixes and performance enhancements. Other
contributions on upsert feature, and deep-store commit are in the design
process.
Contributions from outside of Linkedin:
- UDF support in filter predicates:
https://github.com/apache/incubator-pinot/pull/4365
- Kafka 2.0 support (work authored across open source community):
https://github.com/apache/incubator-pinot/pull/4397
- Variable length bytes dictionary support:
https://github.com/apache/incubator-pinot/pull/4321
- PQL to SQL enhancement Phase-1 :
https://github.com/apache/incubator-pinot/pull/4216
- Ideas and discussions on null value support:
https://github.com/apache/incubator-pinot/issues/4230
- Ideas and discussions on SQL support:
https://github.com/apache/incubator-pinot/issues/4219
### How has the project developed since the last report?
1. Support for Kafka-2.0 added
2. Work in progress to move closer to SQL syntax and semantics for
constructs supported.
3. Helix and Pinot controller separation in final phase of development.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2019-02-15
### When were the last committers or PPMC members elected?
No new PPMC members or committers since incubation
### Have your mentors been helpful and responsive?
Yes, mentors have been super-helpful and respond to questions in a timely
manner.
### Signed-off-by:
- [ ] (pinot) Kishore Gopalakrishna
Comments:
- [X] (pinot) Jim Jagielski
Comments:
- [ ] (pinot) Roman Shaposhnik
Comments:
- [ ] (pinot) Olivier Lamy
Comments:
- [X] (pinot) Felix Cheung
Comments: Nice improvements to the project. Agreed next steps would
be on community building.
### IPMC/Shepherd notes:
Pinot is a distributed columnar storage engine that can ingest data in real- time and serve analytical queries at low latency. Pinot has been incubating since 2018-10-17. Three most important unfinished issues to address before graduating: 1. Building community contribution 2. Establish a successful release cadence Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None How has the community developed since the last report? External contributors have made improvements to real-time segment split-commit algorithm to minimize controller access to segment store during segment commit phase. In addition they have also contributed towards other bug fixes, especially in the real-time area. How has the project developed since the last report? - We made our first release Apache Pinot 0.1.0 - We have added and improved a lot more documentation How would you assess the podling's maturity? Please feel free to add your own commentary. [ ] Initial setup [ ] Working towards first release [x] Community building [ ] Nearing graduation [ ] Other: Date of last release: 2019-03-07 When were the last committers or PPMC members elected? Committer Xiang Fu, who was already in the incubator proposal, was added. Have your mentors been helpful and responsive or are things falling through the cracks? In the latter case, please list any open issues that need to be addressed. Yes mentors have been helpful and responsive Signed-off-by: [ ](pinot) Kishore Gopalakrishna Comments: [x](pinot) Jim Jagielski Comments: [ ](pinot) Roman Shaposhnik Comments: [ ](pinot) Olivier Lamy Comments: [x](pinot) Felix Cheung Comments: great! IPMC/Shepherd notes: Drew Farris (shepherd): Looking great. At least 3 mentors active, observed development activity and interaction on the mailing lists.
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
Three most important issues to address in the move towards graduation:
1. Improving documentation
2. Cutting a release
3. Building community contribution
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
External contributors have added some new features and improved
documentations.
- Adding parquet record reader
https://github.com/apache/incubator-pinot/pull/3852
- Adding an aggregation function for population standard
variance
https://github.com/apache/incubator-pinot/pull/3850
- Improving documentation
https://github.com/apache/incubator-pinot/pull/3826
How has the project developed since the last report?
- We finished to update LICENSE/NOTICE files for both source
and binary releases. (this item was ongoing for the last report)
- We have updated pom files for release preparation.
(adding rat, maven-release-plugin, maven-checksum-plugin...etc)
- We are currently in the voting process for the first
Apache release candidate.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[X] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
N/A
When were the last committers or PPMC members elected?
We haven't had a change in committers or PPMC since our incubation.
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Yes, mentors have been very helpful and have responded in a timely
manner. They also helped us on release verification for a community
vote.
Signed-off-by:
[X](pinot) Kishore Gopalakrishna
Comments:
[ ](pinot) Jim Jagielski
Comments:
[ ](pinot) Roman Shaposhnik
Comments:
[X](pinot) Olivier Lamy
Comments:
[X](pinot) Felix Cheung
Comments: Congrats on vote passing on your first release
IPMC/Shepherd notes:
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
Three most important issues to address in the move towards graduation:
1.Improving documentation
2.Cutting a release
3.Building community contribution
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
We have had interest from Slack to contribute to
https://github.com/apache/incubator-pinot/issues/2798
How has the project developed since the last report?
We are preparing for a release in Feb.
- Source file headers have been updated to include Apache licenses.
- Package names moved from com.linkedin to org.apache.
- Additional work related to this effort can be tracked via
https://github.com/apache/incubator-pinot/pull/3722
The website (https://pinot.apache.org/) has been updated. Primary changes
include updated landing page and documentation now links to updated
read-the-docs.
All previously released bits have been removed.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
N/A
When were the last committers or PPMC members elected?
I believe this was soon after our incubation. @kishoreg may have more
information on this. (kishoreg confirmed no new committer)
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Yes, the mentors have been very helpful and have responded in a timely
manner.
Signed-off-by:
[ ](pinot) Kishore Gopalakrishna
Comments:
[ ](pinot) Jim Jagielski
Comments:
[ ](pinot) Roman Shaposhnik
Comments:
[X](pinot) Olivier Lamy
Comments:
[X](pinot) Felix Cheung
Comments: dev@ discussions are picking up, great job!
IPMC/Shepherd notes:
Justin Mclean: Please mention the issue of unapproved releases.
Thanks for resolving this quickly.
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
Three most important issues to address in the move towards graduation:
1. Improving documentation
2. Cutting a release
3. Building community contribution
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
We have had interest from Uber in contributing towards proposals
discussed in Issues 3592 and 3539
How has the project developed since the last report?
Source repo migrated to Apache, mailing lists and JIRA created. Website
created.
We have added a minimal wiki page. We have added documentation on many
user-facing features.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
N/A
When were the last committers or PPMC members elected?
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Signed-off-by:
[ ](pinot) Kishore Gopalakrishna
Comments:
[X](pinot) Jim Jagielski
Comments:
[ ](pinot) Roman Shaposhnik
Comments:
[X](pinot) Olivier Lamy
Comments:
[X](pinot) Felix Cheung
Comments:
IPMC/Shepherd notes:
Pinot is a distributed columnar storage engine that can ingest data in real-
time and serve analytical queries at low latency.
Pinot has been incubating since 2018-10-17.
Three most important issues to address in the move towards graduation:
We are just starting the incubation and don't have much to report. Few
things we are working on:
1. Migrate the code base from LinkedIn GitHub to Apache GitHub
2. Finish the initial tasks to set up the podling - website, mailing
lists, developer icla's etc
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
How has the community developed since the last report?
How has the project developed since the last report?
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[x] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Signed-off-by:
[x](pinot) Kishore Gopalakrishna
Comments:
[ ](pinot) Jim Jagielski
Comments: Very, very early in process.
[ ](pinot) Roman Shaposhnik
Comments:
[x](pinot) Olivier Lamy
Comments:
IPMC/Shepherd notes: