This was extracted (@ 2025-03-19 23:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 82 committers and 39 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the past quarter, Xi Chen was added to the PMC on 2025-02-08 ## Project Activity - Continuous Recon feature and OM snapshot feature enhancements. - File/Object deletion improvement, make directory deletion multi-threading, add new metrics, fix the ratis request ID reuse problem, etc. - Command line enhancements, interactive mode ozone shell, command to repair broken FSO tree, command to show internal component versions, command to create RocksDB checkpoint, CLI layout refactor, etc. - SCM safemode enhancement, support EC containers, refactor safe mode exit rule efficiency, etc. - Container reconciliation development is ongoing. - Use symmetric key instead of asymmetric key to sign delegation token. - S3 gateway, support object tags support, use individual port for S3 web admin UI, etc. - Streaming write supports Hsync and Hflush. - Documentation improvement, hive integration guide, distCP integration guide, impala integration guide, etc. - Continuous github build and CI improvements, flaky unit test fixing, refactor unit test to reduce execution time, etc. - Ozone 1.4.1 release is completed. Next release will be Ozone 2.0.0. - Migrate Hadoop common dependency from 3.3.6 to 3.4.1. - LegacyReplicationManager support is removed. - File per chunk layout on Datanode is deprecated. Datanode will fallback to file per block layout if file per chunk layout is configured. - Non-Ratis support for OM and SCM is under removal. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. - 1.4.0 was released on 2024-01-19. - 1.4.1 was released on 2024-11-24. ## Community Health Last board report was sent on 12th Nov 2024. Since last report, - 36 code contributors who have commits in the past quarter (-3% change) - dev@ozone.apache.org had 72 emails in the past quarter (-22% change) - 338 PRs closed on GitHub, past quarter (+28% change) - 335 PRs opened on GitHub, past quarter (+25% change) - 286 commits in the past quarter (+28% change) Note: The commit & PR count excludes the ones from user "app/dependabot", who has many commits for dependency jar version upgrade.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 82 committers and 38 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Sadanand Shenoy was added to the PMC on 2024-08-30 Siddhant Sangwan was added to the PMC on 2024-09-04 Chung-En Lee was added as committer on 2024-09-07 ## Project Activity - Recon UI improvements, including new page layout, listKeys API improvement, search function for pending deletion keys, etc. - A new OM HA POC is ongoing. Instead of sending OM requests through Ratis, the new POC will only send the OM data update requests through Ratis. - RATIS 3.1.1 is released. Ozone 1.4.1 RC2 has been rolled out. - Master branch version is changed to 2.0.0-SNAPSHOT. Next major release will be 2.0.0. - Feature improvement umbrella JIRA HDDS-11506 is opened to track all issues and improvements found in deleting service. - Debuggability improvement, "ozone debug ldb scan" command supports more options, new "ozone debug cert-recover" command to restore SCM certificates from RocksDB, OM supports system audit log, etc. - OM/SCM/Datanode web sites are improved. - Test improvements, like MiniOzoneCluster supports s3g, Intermittent failure unit tests fixing, etc. - Short-circuit read feature has started the implementation. - Many other fixes and improvements from snapshot, HBase support, erasure coding, documentations, etc. - Community activities - CoC North America 2024 session "Scaling Ozone performance to max out CPU, Network and Disk" - CoC North America 2024 session "Recognize, Reconcile, Repeat: The Path to Uniform Replicas in Apache Ozone" - CoC North America 2024 session "GenAI applications with Apache Ozone" - CoC North America 2024 session "Your Project’s Website is Bad (But It Doesn’t Have to Be)" - "Innovation Synergy Ozone, GenAI, and Kubernetes Meetup October 2024" held on 24th Oct. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. - 1.4.0 was released on 2024-01-19. ## Community Health Last board report was sent on 13th August 2024. Since last report, - 37 code contributors in the past quarter (last 44, -16% change) - dev@ozone.apache.org had 103 emails in the past quarter (last 66 +56% change) - 263 PRs closed on GitHub, past quarter (last 303, -13% change) - 267 PRs opened on GitHub, past quarter (last 312, -14% change) - 223 commits in the past quarter (last 265, -16% change) Note: The commit & PR count excludes the ones from user "app/dependabot", who has many commits for dependency jar version upgrade.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 81 committers and 36 PMC members in this project. The Committer-to-PMC ratio is roughly 9:4. - In the last quarter, Tanvi Penumudy was added as committer on 2024-05-31 Arafat Khan was added as committer on 2024-06-10 ## Project Activity - Recon improvements, adding DN decommissioning status and info display, listKeys filters support, and other fixes and improvements. - Snapshot bug fixes. - Atomic Key Overwrite and Key Replacement feature branch is merged into master branch after community vote. - HBase on Ozone feature branch is merged into master branch after community vote. - Storage container reconciliation feature has started the implementation. - Acceptance test infra and experience are under continuous improvement. The Docker environment is migrated to Docker 2. - Java 11/17 compile, test, runtime issue fixing are ongoing. - Flaky test checking and fixing are ongoing. - Ozone 1.4.1 RC0 is under vote. Xi Chen is the RM of this release. - Community activities - APAC Open Source Day - Ozone Deep dive session - CoC EU 2024 session "Elevating Scalable Object Storage: A Comprehensive Exploration of Ozone’s Trailblazing Capabilities" - CoC EU 2024 session "Recon - Ozone cluster monitoring and observability" - CoC Asia 2024 session "Apache HBase on Ozone" - ACL Shanghai Meetup session "Apache Ozone: What's new in next release" ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. - 1.4.0 was released on 2024-01-19. ## Community Health Last board report was sent on 7th May 2024. Since last report, - 44 code contributors in the past quarter (+0% change) - dev@ozone.apache.org had 66 emails in the past quarter (+0% change) - 303 PRs closed on GitHub, past quarter (last 380, -20% change) - 312 PRs opened on GitHub, past quarter (last 392, -20% change) - 265 commits in the past quarter (last 337, -21% change) Note: The commit & PR count excludes the ones from user "app/dependabot", who has many commits for dependency jar version upgrade.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 79 committers and 36 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Ashish Kumar was added as committer on 2024-02-21 Devesh Singh was added as committer on 2024-02-21 Hongbing Wang was added as committer on 2024-04-02 Ivan Andika was added as committer on 2024-04-16 ## Project Activity - A lot of Recon improvements, including disk usage page, list keys for bucket with filter, capability to remove DEAD datanode, sort datanodes by storage metrics, search open keys, etc. - Snapshot improvements and bug fixes, such as support pagination of list snapshot, snapshot cache operation optimization, more log and metrics for easy debug, etc. - Disk balancer, major coding is finished. Integration and system tests will be carried out next. - HBase on Ozone development is continuous. - Documentation improvement, new documents are added and several existing documents are translated into Chinese. - Security FIPS compliance is kicked off, and the development started. - S3 API compatibility improvements and issue fixes are ongoing. - Support Java 17 compile and runtime is ongoing. - Strengthen CI effort is continuous, plus the code cleanup. - Erasure coding, there are lots of bug fixes and also performance improvements. - Container reconciliation is proposed and discussed. Container reconciliation will try to identify each replica's healthy status for a container, and recover a replica at block level instead of current replica level. - AWS S3 Lifecycle support is being discussed in the community. S3 Lifecycle will add the expiration condition to the key, and make the key auto deleted after it's expired. - Data tiering is under discussion. The initial goal of Data tiering is to support converting 3 factor data to Erasure coding data automatically based on some predefined rules. - Lots of other bug fixes and performance improvements are done, to improve the overall Ozone performance and stability. - Ozone 1.4.1 release is discussed in the community. Xi Chen is the RM of this release. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. - 1.4.0 was released on 2024-01-19. ## Community Health Last board report was sent on 5th Feb 2024. Since last report, - 392 PRs opened on GitHub, past quarter (+159% change) - 380 PRs closed on GitHub, past quarter (+153% change) - 337 commits in the past quarter (+85% change) - 44 code contributors in the past quarter (+2% change) - dev@ozone.apache.org had 66 emails in the past quarter (-30% change) Note: The commit/PR open/PR close count excludes the ones from user "dependabot", who has many commits for dependency jar version upgrade.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 75 comitters and 36 PMC members in this project. The Committer-to-PMC ratio is roughly 7:3. - In the last quarter, Guo Hao was added as committer on 2023-10-30 Christos Bisias was added as committer on 2023-11-04 Janus Chow was added to the PMC on 2023-11-22 Maksim Myskov was added as committer on 2023-11-30 Xi Chen was added as committer on 2024-01-23 ## Project Activity - Feature update a. Namespace snapshot phase II, enhancement and bug fixes, is continuing. b. Support MPU(multi part upload) expired key cleanup in OM c. Replication manager improvements, many corner cases are found and fixed. d. Support ranged GET requests for a specified part through S3G. e. Migrate existing unit tests from junit4 to junit5 is continuing. f. Fix flaky tests is continuing. g. A tool that helps to migrate Schema V2 containers to Schema V3 containers is under development. h. Hbase on Ozone development(hsync/hflush API) is resumed and continuing. i. GRPC channel performance improvement by leveraging GRPC library capability. j. Recon UI improvement. k. The Root CA auto rotation feature development is finished. l. Hadoop 3.2.2, 2.7.3 runtime support are dropped after a consensu in the community. Now Hadoop 2.10.2, 3.1.2 and 3.3.6 are supported. m. Lots of other bug fixes and performance improvements for the overall performance and stability. - Release 1.4.0 is finally released on 19/01/2024, after months' preparation, with 1584 JIRAs resolved, and following major features and improvements, a. Snapshots b. Erasure Coding V2: offline reconstruction, container balancer support c. Recon: heat maps, more diagnose info d. Certificate auto-rotation e. SCM decommissioning f. Improved OM decommissioning g. Symmetric key-based block/container token implementation h. Quota on FSO bucket ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. - 1.4.0 was released on 2024-01-19. ## Community Health Last board report was sent on 9th Nov. Due to the Christmas season impact, since last report, - 151 PRs opened on GitHub, past quarter (-64% decrease) - 150 PRs closed on GitHub, past quarter (-63% decrease) - 182 commits in the past quarter (-58% decrease) - 43 code contributors in the past quarter (-25% change) - dev@ozone.apache.org had 99 emails in the past quarter (+80% increase)
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 71 comitters and 35 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Kaijie Chen was added to the PMC on 2023-10-30 Swaminathan Balachandran was added as committer on 2023-10-18 ShaoHong Xu was added as committer on 2023-09-24 Hemant Kumar was added as committer on 2023-08-29 ## Project Activity - Feature update a. S3g, etag is supported for object upload and download through s3g. b. Namespace snapshot phase II, enhancement and bug fixes, is ongoing. c. Hsync support, development is ongoing. d. Improvements on container replication and block deletion, to address observed DN decommission slow and block deletion slow cases. e. Improvements on OM read performance, including lock efficiency, avoid buffer copying in Codec, etc. f. Streaming write, streaming write support is added in s3g. g. Lots of bug fixes and performance improvements for the overall performance and stability. h. A tool is under development, to offline migrate schema V2 containers to schema V3 containers. i. Migrating existing unit tests from junit4 to junit5. Checking and fixing flaky tests. - Release 1.3.1 release, cancelled after a consensus of community discussion. 1.4.0 release, has dependency on RATIS project's 3.0 release, which is ongoing in the RATIS community. - Community activity An in-person "Storage User Group Meetup" is hosted on Oct 25 in the US. Topics include a. Apache Ozone User adoptions b. Apache Ozone State of the Union c. Snapshots new innovations d. Apache Iceberg on Ozone ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. ## Community Health Last board report was sent on 8th May. Since last report, - 383 PRs opened on GitHub, past quarter (-16% decrease) - 368 PRs closed on GitHub, past quarter (-18% decrease) - 387 commits in the past quarter (-16% decrease) - 58 code contributors in the past quarter (+1% increase) - dev@ozone.apache.org had 55 emails in the past quarter (-50% decrease) - Discussions at ozone github repository had 10 threads - Active discussions at ASF #ozone channel
@Sharan: check with Chris about vendor neutrality concerns
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 68 comitters and 34 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, George Bijan Jahad was added as committer on 2023-06-28 Sumit Agrawal was added as committer on 2023-05-23 ## Project Activity - Erasure Coding Phase II, offline recovery support is finished. - Erasure Coding aware Replication Manager support is finished. - Hue File Browser now supports browsing Ozone. - The new block token feature which uses the symmetric key is finished. Its feature branch has been merged into master branch. - SCM decommission feature is finished. Primordial SCM is allowed to be decommissioned. - Disk Volume failure detection is strengthened. - Auto service certificate rotation is finished. Root CA and subordinate CA certificate auto rotation is under development. - Recon has supported new insights, including file/object access heat map, pending deleted blocks in SCM, deleted containers, missing containers info. - Quota support for snapshot and Hsync is finished. - A lot of bug fixes and performance improvements have been made to improve the overall performance and stability. - 1.3.1 release branch is cut. - 1.4.0 release is kicked off. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. ## Community Health Last board report was sent on 8th May. Since last report, - 426 PRs opened on GitHub, past quarter (-6% decrease) - 412 PRs closed on GitHub, past quarter (-11% decrease) - 421 commits in the past quarter (-10% decrease) - 55 code contributors in the past quarter (-5% decrease) - dev@ozone.apache.org had 110 emails in the past quarter (+41% increase)
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 66 comitters and 34 PMC members in this project. The Committer-to-PMC ratio is roughly 9:5. - In the last quarter, Zita Dombi was added as committer on 2023-03-25 George Huang was added as committer on 2023-03-16 Nilotpal Nandi was added to the PMC on 2023-03-07 Wei-Chiu Chuang was added to the PMC on 2023-03-07 Aswin Shakil was added as committer on 2023-02-25 Duong Nguyen was added as committer on 2023-02-06 Mingchao Zhao was added to the PMC on 2023-02-03 ## Project Activity - Erasure Coding Phase II, EC aware Replication Manager support is ongoing. - Ozone snapshots feature phase I development has been finished and its feature branch has been merged to master branch. - OM, DN and Recon auto certificate rotation has been supported. SCM Root CA and Sub CA certificate rotation design is ready and going through review. - HttpFS feature branch has been merged into master branch. - hflush API support was kicked off and the implementation is ongoing. It enables new use cases, such as HBase and Solr, where the Write Ahead Log and Transaction Logs are flushed to Ozone constantly. - New block token which uses the symmetric key is under development. It will have better performance compared with the current asymmetric solution. - SCM decommission support is under development. Primordial SCM is allowed to be decommissioned now. - New insights, including file/object access heat map, pending deleted blocks in SCM, deleted containers, missing containers etc, are under development to enrich Recon's function. - Added configuration to support non S3 naming comply bucket name, to facilitate migrating files from HDFS to Ozone. - A lot of bug fixes and performance improvements have been made to improve the overall Ozone performance and stability. - 1.3.1 release was discussed. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. ## Community Health Last board report was sent on Feb 2nd. Since last report, - 403 PRs opened on GitHub, past quarter (21% increase) - 408 PRs closed on GitHub, past quarter (21% increase) - 407 commits in the past quarter (-2% decrease) - 58 code contributors in the past quarter (5% increase) - dev@ozone.apache.org had 80 emails in the past quarter (-40% decrease)
@Rich: follow up with Ozone PMC about committers
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 62 comitters and 31 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Ritesh Shukla was added as committer on 2022-12-17 Istvan Fajth was added as committer on 2022-12-17 Ayush Saxena was added as PMC on 2023-01-24 ## Project Activity - Erasure Coding Phase II development, integrating EC with Replication Manager is the major task now. - Ozone snapshots feature phase I development has been finished. The vote to merge the feature branch to master branch is ongoing. - Stream writing feature has reached an important milestone. The vote to merge the feature branch to master was passed. - Certificate auto rotation development is ongoing. - The major development of HttpFS has finished. - A new design of block token has been finished. It will improve the token calculation performance, compared with current implementation. - Support for Java 11 & 17 is discussed. - New features, including User Quota, S3 credential lifetime management, Data heat map are in the design phase. - 1.3.0 has been released. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. - 1.3.0 was released on 2022-12-18. ## Community Health Last board report was sent on Dec 15th(Last report has data for 4 months). Since last report, - 242 new JIRA opened on Apache issues (-55% change). - 193 JIRA resolved on Apache issues (-60% change). - 31 contributors have commits (-20% change).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 62 comitters and 28 PMC members in this project. The Committer-to-PMC ratio is roughly 2.4:1. - In the last quarter, Kaijie Chen was added as committer on 2022-08-29 Neil Joshi was added as committer on 2022-09-12 Janus Chow was added as committer on 2022-10-21 ## Project Activity - Erasure Coding Phase II offline recovery & read/write improvements development is still ongoing in the master branch with half tasks resolved. - Ozone snapshot feature major design is finished, implementation is ongoing. - FSO enhancement, improved file/dir deleting performance and resolved some issues, making sure the correctness of quota on FSO, etc. - Recon enhancement, a lot of improvements on Recon's performance, stability and scale. - Certificate auto rotation feature is designed and under development. There is also an effort to support external root CA. - Disk Balancer feature is under implementation. This feature balances the storage utilization among volumes in a datanode. - Integration test with Impala is finished. Several performance issues are found and resolved in both Ozone and Impala. - Integration test with Spark is ongoing. - A lot of improvements and bug fixes on performance, backward compatibility, usability, metrics, logs, flaky tests etc. - 1.3.0 release RC2 in voting. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. ## Community Health Last board report was sent on Aug 10th. Since last report, - 538 new JIRA opened on Apache issues (+34.5% change). - 486 JIRA resolved on Apache issues (+45% change). - 39 contributors have commits (-10% change).
No report was submitted.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 59 comitters and 28 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Namit Maheshwari was added as committer on 2022-07-30 Ritesh Shukla was added as committer on 2022-07-06 Soumitra Sulav was added as committer on 2022-07-16 ## Project Activity - One round of Stream Writing performance testing is finished with good data. - Erasure Coding Phase II development is ongoing in the master branch, with offline reconstruction implementation together with a lot of other improvements. - The design and POC of new feature namespace per Bucket Snapshot are ongoing. It's an important feature to support namespace full/incremental backup/copy. - Container Balancer integration with SCM HA feature is finished. - New feature Disk Balancer is kicked off and high level design is finished. This feature tries to balance the storage utilization among volumes in a datanode. - One RocksDB per Datanode Volume feature is finished and merged to master branch. It will help to improve the stability of datanode and performance on data read/write path. - S3 Multi-Tenancy feature is finished and merged to master branch. This feature enables multiple S3-accessible volumes to be created. Each volume will be managed separately by their own tenant admins. - A lot of improvements and bug fixes on performance, backward compatibility, usability, metrics, logs, flaky tests etc. - 1.3.0 release is kicked off. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. ## Community Health Last board report was sent on May 9th. In the past quarter, - 400 new JIRA opened on Apache issues (+29% change). - 335 JIRA resolved on Apache issues (+9% change). - 43 code contributors in the past quarter (+0% change).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 56 comitters and 28 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Ethan Rose was added to the PMC on 2022-03-07, Jyotinder Singh was added as a committer on 2022-04-23, and Siddhant Sangwan was added as a committer on 2022-05-03 ## Project Activity - S3 performance improvement, "Change S3G to OM RPC framework to keep persistent connection across multiple users" feature development is finished. - Datanode side container rocksdb merge feature is under development. The major improvement will be the stability and performance on data read/write path. - Stream writing is under development. Community is now working on performance tests and tuning. - Erasure coding Phase I development was finished. The feature branch was merged back to master after community vote. - Many issues are fixed to improve the whole stability and performance. Phase II development is ongoing, including offline data recovery, usability and performance improvement. - Multi-Tenant support feature development is ongoing. - Introduce hashed key path locks for bucket, to replace the current bucket wise lock, improving the bucket access performance. Feature is under development. - Efforts made to identify and fix the flaky tests, to improve the new PR CI efficiency. - A lot of bugs are fixed to improve the stability, performance and integrity. - Community started the discussion of the 1.3.0 release. There are several pending blocking issues to address. After that, we will start the release process. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.0 was released on 2021-11-17. - 1.2.1 was released on 2021-12-22. ## Community Health Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 42 emails (-7% change). - 310 PRs opened on GitHub (+15% change). - 306 PRs closed on GitHub (+15% change). - 401 commits (+5% change). - 43 code contributors in the past quarter (-12% change).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues Regarding the project healthy score( https://reporter.apache.org/wizard/statistics?ozone), as of today, it's 7.55. The main deductions are "No release data available" and "No new members added to the LDAP committee group for more than six months". Since we have the release data and new committers added, how can we get the healthy score lifted? ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 54 comitters and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Mark Gui was added as committer on 2021-12-21. Jie Yao was added as committer on 2022-01-12. ## Project Activity - A new authentication solution is implemented to greatly improve the S3 performance. - Datanode side container rocksdb merge feature is POC ready. POC shows that there is major improvement of stability and performance on data read/write path. - Streaming write feature development is ongoing. - Erasure coding phase one development is close to finishing. Community is discussing merging the feature branch back to the master branch, making it easy for users to try this feature. - Many issues are fixed to improve the whole stability and performance. - Efforts made to fix the flaky tests and acceptance tests. - Community has released Ozone 1.2.1, which includes major features, like Non-rolling downgrade support, Storage Container Manager HA, Transparent data encryption for s3 buckets, and optimization of Filesystem prefix and security enhancements. ## Releases Data - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. - 1.2.1 was released on 2021-12-22. ## Community Health Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 42 emails (-7% change). - issues@ozone.apache.org had 5138 emails(+0% change). - 278 PRs opened on GitHub(-3% change). - 272 PRs closed on GitHub(-5% change). - 380 commits (-6% change). - 50 code contributors in the past quarter (+8% change).
No report was submitted.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 52 comitters and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 7:4. - In the last quarter, Aryan Gupta was added as committer on 2021-11-10. ## Project Activity: - Three big features, Erasure-coding support, Streaming Write and Multi-tenant are continuously ongoing. - Most of the Container Balancer development work is done. The feature is ready for experimental use in the next month. - A new feature, HttpFS support is kicked off in this quarter. - S3 performance and authentication mechanism are improved. - File system optimization is already merged back to the master branch and the remaining tasks are continued. - A lot of effort is made to fix the flaky tests and make the CI build more smooth and efficient. - Many issues are fixed to improve the whole stability and performance. - Community is preparing to release Ozone 1.2.0. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. ## Community Health: Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 52 emails (-6% change). - issues@ozone.apache.org had 5805 emails(+28% change). - 291 PRs opened on GitHub(+1% change). - 269 PRs closed on GitHub(+0% change). - 366 commits (+35% change). - 47 code contributors in the past quarter (+0% change).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 51 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 1.9:1. - In the last quarter, Prashant Pogde was added as PMC on 2021-05-19. Ethan Rose was added as committer on 2021-07-29. Sadanand Shenoy was added as committer on 2021-08-04. ## Project Activity: - Two major features, non-rolling upgrade and file system optimization are merged back to master. - Three new major features, Container Balancer, Multi-tenant support and Streaming write are kicked off in this quarter, and are under development. - Erasure-Coding development is smoothly ongoing. - Storage space reservation and effort to prevent the storage space full are finished. - SCM HA and OM HA snapshot installation are supported. - Recon stability and functionality are improved. - A lot of issues are fixed to improve the stability and performance. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. ## Community Health: Last board report was sent on May 11th. In the past quarter, - dev@ozone.apache.org had 55 emails (-77% change). - issues@ozone.apache.org had 4708 emails(-12% change). - 263 PRs opened on GitHub(-23% change) - 242 PRs closed on GitHub(-32% change) - 47 code contributors in the past quarter (-9% change)
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 50 comitters and 26 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. - In the last quarter, Matthew Sharp was added as PMC and committer on 2021-04-06. Rui Wang was added as committer on 2021-02-12. Glen Geng was added as committer on 2021-02-12. ## Project Activity: - FS Namesystem optimization is under development, close to ready. - SCM HA has finished Phase 3.0 development and started the Phase 4.0 tasks, including snapshot and dynamic membership change. SCH HA branch is merged back to master. - S3 ACL feature development is finished. Native ACL is improved. - Recon stability is improved. - Security is enhanced. - Non-rolling upgrade design and development are smoothly ongoing. - New feature Multi-Tenant support design draft is under review and POC is ongoing. - New feature Container Balancer design document is ready and passed the community review. Development is ongoing. - Community kicked off new feature Erasure-Coding support design discussion. - A lot of bugs are fixed to improve Ozone's whole stability and performance. - 1.1.0 is released. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 was released on 2021-04-20. ## Community Health: Last board report was sent on Feb 9th. In the past quarter, - dev@ozone.apache.org had 235 emails (+72% change). - issues@ozone.apache.org had 5549 emails(-19% change). - 328 issues resolved in JIRA in the past quarter (-9% change). - 392 issues opened in JIRA in the past quarter (+1% change). - 11 new contributors joined the community in the past quarter. Now it's totally 115 contributors(Last report is 104).
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 47 comitters and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. - There is no membership change in the last month. - In the last quarter, Ethan Rose was added as branch committer on 2020-11-24 Xiang Zhang was added as committer on 2020-11-12 Chun-Hao Yang was added as committer on 2020-11-07 Prashant Pogde was added as committer on 2020-11-10 ## Project Activity: - FS Namesystem optimization is continuing. - SCM HA has finished Phase 2.0 development. Phase 3.0 tasks include bootstrap, security, and configuration etc. - S3 ACL support in under development. Community is also investigating how to support S3 Bucket policy in s3 gateway. - Container Balance feature development is kicked off, per request from customer engagement. - Several companies in China start to try run Ozone with small scale clusters internally, including JD, 360 and T3 ChuXing. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 release is planned. It depends on Apache Ratis release schedule. ## Community Health: Last board report was sent on Jan 11th. In the past month, - dev@ozone.apache.org had 9 new emails(Last report is 35). - issues@ozone.apache.org had 3572 new emails(Last report is 1378). - 161 issues resolved in JIRA (Last report is 99). - 136 issues opened in JIRA (Last report is 92). - 7 new contributors joined the community this month. Now it's totally 104 contributors.(Last month report is 97)
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 45 comitters and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 1.8:1. ## Project Activity: - Trash support feature development is moving fast. - FS Namesystem optimization is moving fast too. - SCM HA has finished Phase 1.5 and entered Phase 2.0 development, targeting for code ready by end of next month. - Community is also actively working on other features development and bug fix, such as S3 ACL, namespace Quota, security related issues, etc. - Community plans to release 1.1.0 in Q1 and already has a volunteer as Release Manager. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 is planned, depending on Apache Ratis release. ## Community Health: Last board report sent one month ago. Due to the holiday season, some indicators have slightly dropped. In the past 4 weeks, - dev@ozone.apache.org had 35 new emails(Last report is 45). - issues@ozone.apache.org had 1378 new emails(Last report is 1619). - 99 issues resolved in JIRA (Last report is 91). - 92 issues opened in JIRA (Last report is 105). - There are 4 new contributors joined the community this month. And now we have a total of 97 contributors.
## Description Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues None. ## Membership Data - Apache Ozone was founded 2020-10-21. - There are currently 45 comitters and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 1.8:1. - Ethor Rose (2020-11-18) was added as branch committer since last month's report. ## Project Activity: - Decommissioning feature branch is voted and merged. - Community is preparing to release 1.1.0. - Most of the migration activities (from Hadoop to TLP) are finished. CI and code workflow is stable now. - There are multiple active design discussions (truncate, append, trash, s3 performance, s3 acl etc.). - Long-term feature branches (SCM-HA, upgrade, prefix table) moved forward. ## Releases: - 1.0.0 was released on 2020-09-02. - 1.1.0 is planned, depending on Apache Ratis release. ## Community Health: Last board report sent one month ago. In the past 4 weeks, - dev@ozone.apache.org had 45 new emails(Last report is 51). - issues@ozone.apache.org had 1619 new emails(Last report is 1686). - 91 issues resolved in JIRA (Last report is 46). - 105 issues opened in JIRA (Last report is 86). - 45 active individual contributors in the community which is the highest number so far. - Both of the weekly community meetings (US/EU and EU/APAC) were well attended with multiple discussions of releases, feature plans, feature designs.
## Description: Apache Ozone is a scalable, redundant, and distributed object and file store, designed to scale to billions of objects/files and run on clusters of thousands of nodes. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. ## Issues: Commit activity of Ozone statistics doesn't work as expected https://reporter.apache.org/wizard/statistics?ozone . ## Membership Data: - Apache Ozone was founded 2020-10-21 (Last month) - 25 initial PMC members and 44 initial Committers were added since the TLP - Prashant Pogde was added as committer on 2020-11-10 - There are currently 45 committers and 25 PMC members in this project. The Committer-to-PMC ratio is roughly 1.8:1. ## Project Activity: - Infras were built since TLP, including mail list, github repo and JIRA project etc. - In the past month, community mainly focused on Volume/Bucket quota feature, upgrade feature and FS namespace performance improvement development. ## Releases: - 1.0.0 was released on 2020-09-02. ## Community Health: Since Ozone established(Three weeks ago), - dev@ozone.apache.org had 51 emails - issues@ozone.apache.org had 1686 emails - 86 issues opened in JIRA - 46 issues closed in JIRA - 28 commits from 17 contributors
WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to a distributed object store for Hadoop-based and Cloud-native environments. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache Ozone Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Ozone be and hereby is responsible for the creation and maintenance of software related to a distributed object store for Hadoop-based and Cloud-native environments; and be it further RESOLVED, that the office of "Vice President, Apache Ozone" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Ozone Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Ozone Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Ozone Project: * Arpit Agarwal <arp@apache.org> * Shashikant Banerjee <shashikant@apache.org> * Sammi Chen <sammichen@apache.org> * Li Cheng <licheng@apache.org> * Dinesh Chitlangia <dineshc@apache.org> * Attila Doroszlai <adoroszlai@apache.org> * Junping Du <junping_du@apache.org> * Marton Elek <elek@apache.org> * Anu Engineer <aengineer@apache.org> * Uma Maheswara Rao G <umamahesh@apache.org> * Lokesh Jain <ljain@apache.org> * Hanisha Koneru <hanishakoneru@apache.org> * Yiqun Lin <yqlin@apache.org> * Siyao Meng <siyao@apache.org> * Stephen O'Donnell <sodonnell@apache.org> * Jitendra Nath Pandey <jitendra@apache.org> * Rakesh Radhakrishnan <rakeshr@apache.org> * Mukul Kumar Singh <msingh@apache.org> * Vivek Ratnavel Subramanian <vivekratnavel@apache.org> * Tsz-wo Sze <szetszwo@apache.org> * Nandakumar Vadivelu <nanda@apache.org> * Aravindan Vijayan <avijayan@apache.org> * Bharat Viswanadham <bharat@apache.org> * Siddharth Wagle <swagle@apache.org> * Xiaoyu Yao <xyao@apache.org> NOW, THEREFORE, BE IT FURTHER RESOLVED, that Sammi Chen be appointed to the office of Vice President, Apache Ozone, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Ozone Project be and hereby is tasked with the migration and rationalization of the Apache Hadoop Ozone sub-project; and be it further RESOLVED, that all responsibilities pertaining to the Apache Hadoop Ozone sub-project encumbered upon the Apache Hadoop Project are hereafter discharged. Special Order 7E, Establish the Apache Ozone Project, was approved by Unanimous Vote of the directors present.