Community-led development "The Apache Way"
This was extracted (@ 2022-08-17 16:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Report was filed, but display is awaiting the approval of the Board minutes.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 56 comitters and 28 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Ethan Rose was added to the PMC on 2022-03-07, Jyotinder Singh was added as a committer on 2022-04-23, and Siddhant Sangwan was added as a committer on 2022-05-03 ## Project Activity - S3 performance improvement, "Change S3G to OM RPC framework to keep persistent connection across multiple users" feature development is finished. - Datanode side container rocksdb merge feature is under development. The major improvement will be the stability and performance on data read/write path. - Stream writing is under development. Community is now working on performance tests and tuning. - Erasure coding Phase I development was finished. The feature branch was merged back to master after community vote. - Many issues are fixed to improve the whole stability and performance. Phase II development is ongoing, including offline data recovery, usability and performance improvement. - Multi-Tenant support feature development is ongoing. - Introduce hashed key path locks for bucket, to replace the current bucket wise lock, improving the bucket access performance. Feature is under development. - Efforts made to identify and fix the flaky tests, to improve the new PR CI efficiency. - A lot of bugs are fixed to improve the stability, performance and integrity. - Community started the discussion of the 1.3.0 release. There are several pending blocking issues to address. After that, we will start the release process. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. ## Community Health Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 42 emails (-7% change). - 310 PRs opened on GitHub (+15% change). - 306 PRs closed on GitHub (+15% change). - 401 commits (+5% change). - 43 code contributors in the past quarter (-12% change).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues Regarding the project healthy score( https://reporter.apache.org/wizard/statistics?ozone), as of today, it's 7.55. The main deductions are "No release data available" and "No new members added to the LDAP committee group for more than six months". Since we have the release data and new committers added, how can we get the healthy score lifted? ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 54 comitters and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Mark Gui was added as committer on 2021-12-21. Jie Yao was added as committer on 2022-01-12. ## Project Activity - A new authentication solution is implemented to greatly improve the S3 performance. - Datanode side container rocksdb merge feature is POC ready. POC shows that there is major improvement of stability and performance on data read/write path. - Streaming write feature development is ongoing. - Erasure coding phase one development is close to finishing. Community is discussing merging the feature branch back to the master branch, making it easy for users to try this feature. - Many issues are fixed to improve the whole stability and performance. - Efforts made to fix the flaky tests and acceptance tests. - Community has released Ozone 1.2.1, which includes major features, like Non-rolling downgrade support, Storage Container Manager HA, Transparent data encryption for s3 buckets, and optimization of Filesystem prefix and security enhancements. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.1 was released on 2021-12-22. ## Community Health Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 42 emails (-7% change). - issues@ozone.apache.org had 5138 emails(+0% change). - 278 PRs opened on GitHub(-3% change). - 272 PRs closed on GitHub(-5% change). - 380 commits (-6% change). - 50 code contributors in the past quarter (+8% change).
No report was submitted.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 52 comitters and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 7:4. - In the last quarter, Aryan Gupta was added as committer on 2021-11-10. ## Project Activity: - Three big features, Erasure-coding support, Streaming Write and Multi-tenant are continuously ongoing. - Most of the Container Balancer development work is done. The feature is ready for experimental use in the next month. - A new feature, HttpFS support is kicked off in this quarter. - S3 performance and authentication mechanism are improved. - File system optimization is already merged back to the master branch and the remaining tasks are continued. - A lot of effort is made to fix the flaky tests and make the CI build more smooth and efficient. - Many issues are fixed to improve the whole stability and performance. - Community is preparing to release Ozone 1.2.0. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. ## Community Health: Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 52 emails (-6% change). - issues@ozone.apache.org had 5805 emails(+28% change). - 291 PRs opened on GitHub(+1% change). - 269 PRs closed on GitHub(+0% change). - 366 commits (+35% change). - 47 code contributors in the past quarter (+0% change).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 51 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 1.9:1. - In the last quarter, Prashant Pogde was added as PMC on 2021-05-19. Ethan Rose was added as committer on 2021-07-29. Sadanand Shenoy was added as committer on 2021-08-04. ## Project Activity: - Two major features, non-rolling upgrade and file system optimization are merged back to master. - Three new major features, Container Balancer, Multi-tenant support and Streaming write are kicked off in this quarter, and are under development. - Erasure-Coding development is smoothly ongoing. - Storage space reservation and effort to prevent the storage space full are finished. - SCM HA and OM HA snapshot installation are supported. - Recon stability and functionality are improved. - A lot of issues are fixed to improve the stability and performance. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. ## Community Health: Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 55 emails (-77% change). - issues@ozone.apache.org had 4708 emails(-12% change). - 263 PRs opened on GitHub(-23% change) - 242 PRs closed on GitHub(-32% change) - 47 code contributors in the past quarter (-9% change)
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 50 comitters and 26 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Matthew Sharp was added as PMC and committer on 2021-04-06. Rui Wang was added as committer on 2021-02-12. Glen Geng was added as committer on 2021-02-12. ## Project Activity: - FS Namesystem optimization is under development, close to ready. - SCM HA has finished Phase 3.0 development and started the Phase 4.0 tasks, including snapshot and dynamic membership change. SCH HA branch is merged back to master. - S3 ACL feature development is finished. Native ACL is improved. - Recon stability is improved. - Security is enhanced. - Non-rolling upgrade design and development are smoothly ongoing. - New feature Multi-Tenant support design draft is under review and POC is ongoing. - New feature Container Balancer design document is ready and passed the community review. Development is ongoing. - Community kicked off new feature Erasure-Coding support design discussion. - A lot of bugs are fixed to improve Ozone's whole stability and performance. - 1.1.0 is released. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. ## Community Health: Last board report was sent on Feb 9th. In the past quarter, - dev@ozone.apache.org had 235 emails (+72% change). - issues@ozone.apache.org had 5549 emails(-19% change). - 328 issues resolved in JIRA in the past quarter (-9% change). - 392 issues opened in JIRA in the past quarter (+1% change). - 11 new contributors joined the community in the past quarter. Now it's totally 115 contributors(Last report is 104).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 47 comitters and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. - There is no membership change in the last month. - In the last quarter, Ethan Rose was added as branch committer on 2020-11-24 Xiang Zhang was added as committer on 2020-11-12 Chun-Hao Yang was added as committer on 2020-11-07 Prashant Pogde was added as committer on 2020-11-10 ## Project Activity: - FS Namesystem optimization is continuing. - SCM HA has finished Phase 2.0 development. Phase 3.0 tasks include bootstrap, security, and configuration etc. - S3 ACL support in under development. Community is also investigating how to support S3 Bucket policy in s3 gateway. - Container Balance feature development is kicked off, per request from customer engagement. - Several companies in China start to try run Ozone with small scale clusters internally, including JD, 360 and T3 ChuXing. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 release is planned. It depends on Apache Ratis release schedule. ## Community Health: Last board report was sent on Jan 11th. In the past month, - dev@ozone.apache.org had 9 new emails(Last report is 35). - issues@ozone.apache.org had 3572 new emails(Last report is 1378). - 161 issues resolved in JIRA (Last report is 99). - 136 issues opened in JIRA (Last report is 92). - 7 new contributors joined the community this month. Now it's totally 104 contributors.(Last month report is 97)
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 45 comitters and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 1.8:1. ## Project Activity: - Trash support feature development is moving fast. - FS Namesystem optimization is moving fast too. - SCM HA has finished Phase 1.5 and entered Phase 2.0 development, targeting for code ready by end of next month. - Community is also actively working on other features development and bug fix, such as S3 ACL, namespace Quota, security related issues, etc. - Community plans to release 1.1.0 in Q1 and already has a volunteer as Release Manager. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 is planned, depending on Apache Ratis release. ## Community Health: Last board report sent one month ago. Due to the holiday season, some indicators have slightly dropped. In the past 4 weeks, - dev@ozone.apache.org had 35 new emails(Last report is 45). - issues@ozone.apache.org had 1378 new emails(Last report is 1619). - 99 issues resolved in JIRA (Last report is 91). - 92 issues opened in JIRA (Last report is 105). - There are 4 new contributors joined the community this month. And now we have a total of 97 contributors.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 45 comitters and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 1.8:1. - Ethor Rose (2020-11-18) was added as branch committer since last month's report. ## Project Activity: - Decommissioning feature branch is voted and merged. - Community is preparing to release 1.1.0. - Most of the migration activities (from Hadoop to TLP) are finished. CI and code workflow is stable now. - There are multiple active design discussions (truncate, append, trash, s3 performance, s3 acl etc.). - Long-term feature branches (SCM-HA, upgrade, prefix table) moved forward. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 is planned, depending on Apache Ratis release. ## Community Health: Last board report sent one month ago. In the past 4 weeks, - dev@ozone.apache.org had 45 new emails(Last report is 51). - issues@ozone.apache.org had 1619 new emails(Last report is 1686). - 91 issues resolved in JIRA (Last report is 46). - 105 issues opened in JIRA (Last report is 86). - 45 active individual contributors in the community which is the highest number so far. - Both of the weekly community meetings (US/EU and EU/APAC) were well attended with multiple discussions of releases, feature plans, feature designs.
## Description: Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues: Commit activity of Ozone statistics doesn't work as expected https://reporter.apache.org/wizard/statistics?ozone . ## Membership Data: - Apache Ozone was founded 2020-10-21 (Last month) - 25 initial PMC members and 44 initial Committers were added since the TLP - Prashant Pogde was added as committer on 2020-11-10 - There are currently 45 committers and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 1.8:1. ## Project Activity: - Infras were built since TLP, including mail list, github repo and JIRA project etc. - In the past month, community mainly focused on Volume/Bucket quota feature, upgrade feature and FS namespace performance improvement development. ## Releases: - 1.0.0 was released on 2020-09-02. ## Community Health: Since Ozone established(Three weeks ago), - dev@ozone.apache.org had 51 emails - issues@ozone.apache.org had 1686 emails - 86 issues opened in JIRA - 46 issues closed in JIRA - 28 commits from 17 contributors
WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to a distributed object store for Hadoop-based and Cloud-native environments. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache Ozone Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Ozone be and hereby is responsible for the creation and maintenance of software related to a distributed object store for Hadoop-based and Cloud-native environments; and be it further RESOLVED, that the office of "Vice President, Apache Ozone" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Ozone Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Ozone Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Ozone Project: * Arpit Agarwal <arp@apache.org> * Shashikant Banerjee <shashikant@apache.org> * Sammi Chen <sammichen@apache.org> * Li Cheng <licheng@apache.org> * Dinesh Chitlangia <dineshc@apache.org> * Attila Doroszlai <adoroszlai@apache.org> * Junping Du <junping_du@apache.org> * Marton Elek <elek@apache.org> * Anu Engineer <aengineer@apache.org> * Uma Maheswara Rao G <umamahesh@apache.org> * Lokesh Jain <ljain@apache.org> * Hanisha Koneru <hanishakoneru@apache.org> * Yiqun Lin <yqlin@apache.org> * Siyao Meng <siyao@apache.org> * Stephen O'Donnell <sodonnell@apache.org> * Jitendra Nath Pandey <jitendra@apache.org> * Rakesh Radhakrishnan <rakeshr@apache.org> * Mukul Kumar Singh <msingh@apache.org> * Vivek Ratnavel Subramanian <vivekratnavel@apache.org> * Tsz-wo Sze <szetszwo@apache.org> * Nandakumar Vadivelu <nanda@apache.org> * Aravindan Vijayan <avijayan@apache.org> * Bharat Viswanadham <bharat@apache.org> * Siddharth Wagle <swagle@apache.org> * Xiaoyu Yao <xyao@apache.org> NOW, THEREFORE, BE IT FURTHER RESOLVED, that Sammi Chen be appointed to the office of Vice President, Apache Ozone, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Ozone Project be and hereby is tasked with the migration and rationalization of the Apache Hadoop Ozone sub-project; and be it further RESOLVED, that all responsibilities pertaining to the Apache Hadoop Ozone sub-project encumbered upon the Apache Hadoop Project are hereafter discharged. Special Order 7E, Establish the Apache Ozone Project, was approved by Unanimous Vote of the directors present.