This was extracted (@ 2024-04-17 21:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Project Status: Current project status: Ongoing Issues for the board: None ## Membership Data: Apache Bigtop was founded 2012-09-19 (11 years ago) There are currently 41 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Luca Toscano on 2023-09-26. - No new committers. Last addition was Zhiguo Wu on 2023-05-17. ## Project Activity: Work for 3.3.0 release is ongoing. Ambari, Oozie and YCSB were dropped from the stack. Ranger was added. Support for openEuler and Rocky Linux 9 were added. ## Community Health: Community health is good while statistiscs shows slight decrease in activity. New committer should be added from active contiributors since existing committers seem not to have enough bandwidth for reviewing. - dev@bigtop.apache.org had a 16% decrease in traffic in the past quarter (232 emails compared to 274): - issues@bigtop.apache.org had a 27% decrease in traffic in the past quarter (165 emails compared to 224): - 31 PRs opened on GitHub, past quarter (-11% change) - 29 PRs closed on GitHub, past quarter (-9% change)
WHEREAS, the Board of Directors heretofore appointed Yuqi Gu (guyuqi) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Yuqi Gu from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Masatake Iwasaki (iwasakims) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Yuqi Gu is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Masatake Iwasaki be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7C, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Project Status: Current project status: In the 3.3.0 release cycle. Issues for the board: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (11 years ago) There are currently 41 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Luca Toscano on 2023-09-26. - No new committers. Last addition was Zhiguo Wu on 2023-05-17. ## Project Activity: - We are working on v3.3.0 release work including bug fixes and new features implementation. - Added OpenEluer support in Bigtop. - Dropped some deprecated distro support and inactive projects. - Improved the CI infrastructure by upgrading the OS and Jenkins for enhanced security, implementing better TLS certificate renewal, and enabling HTTP/2 for httpd. Additionally, we discussed the development of the new sub-project Bigtop-Manager, which is a platform for managing Bigtop components within the Bigtop framework. ## Community Health: Overall community health is good. Community Health Score (Chi): 7.96 (Healthy). Several contributors were actively fixing issues and developing the 3.3.0 release. The metrics decreased due to the holiday season at the end of 2023. - 9 code contributors in the past quarter (-18% change) - 47 PRs opened on GitHub, past quarter (-12% increase) - 41 PRs closed on GitHub, past quarter (-18% increase) - 37 commits in the past quarter (-57% increase) - [issues@bigtop.apache.org](mailto:issues@bigtop.apache.org) had a 7% decrease in traffic in the past quarter (258 emails compared to 277)
No report was submitted.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Project Status: Current project status: 3.2.1 was released on 2023-08-22, CHI: 7.15 (Healthy) Issues for the board: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (11 years ago) There are currently 42 committers and 29 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - No new committers. Last addition was Zhiguo Wu on 2023-05-17. ## Project Activity: - 3.2.1 was released on 2023-08-22, which is a patch release of 3.2.0 for addressing some security issues of Hadoop. - We are working on adding support for openEuler to Bigtop based on the branch 'openEuler-support': OpenEuler Bigtop-toolchain images have been supported, along with Puppet deployment scripts. In addition, support has been added for several components, including Hadoop, Phoenix, Alluxio, Oozie, Ycsb, and Kafka. ## Community Health: Community health is good. Several contributors were actively fixing issues and developing the 3.2.1 release. The number of code contributors was a bit decreased, but all other metrics were positive and reflect our active development and interactions. - 9 code contributors in the past quarter (-10% change) - 57 PRs opened on GitHub, past quarter (119% increase) - 49 PRs closed on GitHub, past quarter (133% increase) - 71 commits in the past quarter (195% increase) - [dev@bigtop.apache.org](mailto:dev@bigtop.apache.org) had a 128% increase in traffic in the past quarter (534 emails compared to 234) - [issues@bigtop.apache.org](mailto:issues@bigtop.apache.org) had a 89% increase in traffic in the past quarter (258 emails compared to 136)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Project Status: Ongoing: 3.2.1 patch release is currently underway. ## Issues for the board: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (11 years ago) There are currently 42 committers and 29 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - Zhiguo Wu was added as committer on 2023-05-17 ## Project Activity: - We are working on the 3.2.1 patch release to address security issues fixed by Hadoop 3.3.5. - We defined the Bigtop-3.3 release scope on BIGTOP-3909 which will include: 1.Support New components like Ranger debian, bigtop-select (for Ambari). 2.Adapt Bigtop Mpack to new Ambari-2.8. 3.Dropping old supported distros and only support the latest LTS. 4.Sub components upgrading. -In addition, we had a brainstorming discussion about openEuler support and the related work has been kicked off: https://github.com/apache/bigtop/pulls?q=is%3Apr+is%3Aopen++openEuler ## Community Health: - Community health is good. Several contributors were actively fixing issues and developing the 3.2.1 release. The number of the commits was a bit decreased, but all other metrics were positive and reflect our active development and interactions. - 10 code contributors in the past quarter (42% increase) - 24 PRs opened on GitHub, past quarter (50% increase) - 20 PRs closed on GitHub, past quarter (122% increase) - 24 commits in the past quarter (-17% decrease) - 33 issues opened in JIRA, past quarter (57% increase) - 19 issues closed in JIRA, past quarter (90% increase) - dev@bigtop.apache.org had a 105% increase in traffic in the past quarter (246 emails compared to 120)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (10 years ago) There are currently 41 committers and 29 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - Yoda Leona was added as committer on 2023-02-07 ## Project Activity: - 3.2.0 was released on 2023-01-17. In this release a number of core services were added into Bigtop Mpack Framework including Hive, Hbase, Solr, Ambari metrics,etc. And we also implemented Bigtop-stack-provisioner: One-Click deploying and testing Bigtop stack by Ambari with a simple script. Some new distros were also newly supported and many other components were upgraded for compatibility. - Definition of 3.3 BOM is in discussion on BIGTOP-3909. We are discussing about OpenEuler support, components upgrading and reducing the release burden (only support the latest LTS). ## Community Health: - The relative decrease was caused by moving Mpack development to resurrect Ambari project and PRs/Jiras silence (only accept blocker or critical bug fixes into the branch) when preparing for Bigtop 3.2.0 release. - dev@bigtop.apache.org had a 100% increase in traffic in the past quarter (380 emails compared to 190). - issues@bigtop.apache.org had a 78% increase in traffic in the past quarter (212 emails compared to 119). - 7 code contributors in the past quarter (-41% change) - 14 PRs opened on GitHub, past quarter (-77% change) - 8 PRs closed on GitHub, past quarter (-85% change) - 28 commits in the past quarter (-50% decrease)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (10 years ago) There are currently 40 committers and 29 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - Leona Yoda accepted the invitation to become Bigtop committer on 2022-12-11. ## Project Activity: We are working on 3.2.0 release which provides: - Components upgrade (Hadoop 3.2.4 -> 3.3.4, Spark 3.1.2 -> 3.2.3, HBase 2.4.11 -> 2.4.13, Hive 3.1.2 -> 3.1.3, etc.) - New Mpack services support (Spark, Kafka, Hive, Flink, Solr, Phoenix, Ambari-Metrics, etc.). - New Distros support (Fedora-35 ->36, ubuntu-18.04 -> 22.04). - Introduced bigtop-select package solution as an alternative stack in the next release of Ambari and improve the build scripts to make binary distribution more configurable. We need some additional work on bugfix for v3.2.0 release. ## Community Health: Community health is good. The statistics decrease was caused by moving Mpack development to resurrected Ambari project. Several contributors are actively fixing issues and developing the 3.2.0 release. - 12 code contributors in the past quarter (-33% change). - 60 PRs opened on GitHub, past quarter (-40% change). - 52 PRs closed on GitHub, past quarter (-45% change). - 75 issues opened in JIRA, past quarter (-32% change) - 58 issues closed in JIRA, past quarter (-36% change)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (10 years ago) There are currently 40 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 4:3. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - No new committers. Last addition was Luca Toscano on 2021-12-07. ## Project Activity: - 3.1.1 was released on 2022-08-07. In this patch release, we addressed the critical issue like WebHDFS broken which is a major problem for users. - 3.2.0 is the next minor release, which provides upgraded components (Hadoop 3.2.4 -> 3.3.4, Spark 3.1.2 -> 3.2.1, HBase 2.4.11 -> 2.4.13, Hive 3.1.2 -> 3.1.3, etc.) and new Mpack services support (Spark, Kafka, Hive, Flink, Solr, Phoenix, Ambari-Metrics, etc.). We need some additional work on bugfix and new Mpack features, so 3.2.0 will be released in 2022-Q4. - We enabled autolink redirection from Github commit to Jira for Bigtop (INFRA-23651). - In the Bigtop dev mailing list, we made the draft for "bring Ambari back" and Apache Ambari was resurrected from the Attic on July 2022. (https://lists.apache.org/thread/1x51fkog54x4fkkyvn8lljg139kbw686) - After Apache Ambari comes back, we are having a brainstorming discussion about selecting Bigtop Mpack as the default stack of Ambari. (https://lists.apache.org/thread/kbn8gjfl23cm381jwww0bbb41wfpf3jn, https://lists.apache.org/thread/o38qho9qxk6fv64q194043h91bw8yx4y) ## Community Health: - Community health is good. Several contributors are actively fixing issues and developing the 3.2.0 release. All metrics were positive and reflect our active development and interactions. - 18 code contributors in the past quarter (100% increase). - 92 PRs opened on GitHub, past quarter (109% increase). - 88 PRs closed on GitHub, past quarter (137% increase). - 106 commits in the past quarter (51% increase). - 108 issues opened in JIRA, past quarter (107% increase) - 88 issues closed in JIRA, past quarter (131% increase)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (10 years ago) There are currently 40 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 4:3. Community changes, past quarter: - The Apache Bigtop Project Chair was changed (Yuqi Gu, VP) on 2022-05-18. - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - No new committers. Last addition was Luca Toscano on 2021-12-07. ## Project Activity: The community was mainly working on the following two versions: - 3.0.1, a patch release for addressing the Log4Shell vulnerabilities with minimal changes for 3.0.0, was released on 2022-04-11. - 3.1.0, a minor release, was released on 2022-05-21. This release provides Debian 11, Fedora 35, and Rocky Linux 8 support and upgraded components (Hadoop 3.2.2 -> 3.2.3, Spark 3.0 -> 3.1, HBase 2.2 -> 2.4, Kafka 2.4 -> 2.8, etc.). - In addition, the work for new feature of Mpack-upgrade is in progress. We were discussing this feature requirement in the dev-ml thread. (https://lists.apache.org/thread/wj898zq8q348721xf460mttqlty4v3zw, https://lists.apache.org/thread/k8rm0k1tczs2o6cqmn91m8641yj4g607). - We are also having a brainstorming discussion about deployment tools of software stacks after Apache Ambari was retired in the dev-ml thread. (https://lists.apache.org/thread/k8rm0k1tczs2o6cqmn91m8641yj4g607, https://lists.apache.org/thread/c8jz4kz4z3xs236dy0qzg50y4845z4nm). ## Community Health: - Community health is good. Several contributors were actively fixing issues and developing the 3.0.1/3.1.0 release. The number of the PRs-closed was a bit decreased, but all other metrics were positive and reflect our active development and interactions. - 11 code contributors in the past quarter (57% increase). - 37 PRs opened on GitHub, past quarter (8% increase). - 33 PRs closed on GitHub, past quarter (-13% change). - 69 commits in the past quarter (27% increase).
WHEREAS, the Board of Directors heretofore appointed Kengo Seki (sekikn) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Kengo Seki from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Yuqi Gu (guyuqi) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Kengo Seki is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Yuqi Gu be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7B, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: As a result of active development, our CI jobs downloaded artifacts from the ASF repository so many times that some of the CI nodes were banned from them. It was already unblocked (INFRA-22953), and we're going to improve our CI environment to reduce the number of requests by introducing a local Nexus repository (BIGTOP-3644, BIGTOP-3649). ## Membership Data: Apache Bigtop was founded 2012-09-19 (9 years ago) There are currently 40 committers and 29 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - No new committers. Last addition was Luca Toscano on 2021-12-07. ## Project Activity: We're currently developing the following two versions: - 3.0.1 is a patch release for addressing the Log4Shell vulnerabilities with minimal changes for 3.0.0. Its development has been almost finished, and we're going to run the build and test jobs after setting up our CI jobs to use the local Nexus repository mentioned in the "Issues" section. - 3.1.0 is the next minor release, which provides new distro support (e.g., Rocky 8 and Debian 11) and upgraded components (Spark 3.0 -> 3.1, HBase 2.2 -> 2.4, Kafka 2.4 -> 2.8, etc). We need some additional work to upgrade Hadoop, so it will be released after 3.0.1. ## Community Health: Community health is good. The number of the code contributors were a bit decreased, but all other metrics are positive and reflect our active development and interactions. - 7 code contributors in the past quarter (-12% change) - 31 PRs opened on GitHub, past quarter (29% increase) - 34 PRs closed on GitHub, past quarter (54% increase) - 49 commits in the past quarter (11% increase)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (9 years ago) There are currently 40 committers and 30 PMC members in this project. The Committer-to-PMC ratio is 4:3. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - Luca Toscano was added as committer on 2021-12-07 ## Project Activity: - 3.0.0 was finally released on 2021-10-23. In this release we moved to Hadoop, Hive and Spark 3.x, and upgraded many other components for compatibility. Some new distros were also newly supported. - Definition of 3.1.0 BOM is in discussion on BIGTOP-3605. In addition, we are having a brainstorming about adding cutting-edge software and dropping obsolete features in the dev-ml thread (https://lists.apache.org/thread/bryf46kfbomt4zytgscjgvwvs6cy7mv2). ## Community Health: - Community health is good. Several contributors are actively fixing issues and developing the next release. - 8 code contributors in the past quarter (33% increase) - 22 PRs opened on GitHub, past quarter (-24% change) - 21 PRs closed on GitHub, past quarter (-27% change) - 43 commits in the past quarter (30% increase)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (9 years ago) There are currently 39 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - No new PMC members. Last addition was Masatake Iwasaki on 2021-03-11. - No new committers. Last addition was Yuqi Gu on 2020-06-10. ## Project Activity: - The community is mainly working on the upcoming 3.0.0 release, which is our first release based on Hadoop and Spark 3.x. We have already succeeded in building all components for all distros and platforms we support, so we are proceeding with the release process now. It will take a few weeks at least, since we support so many combinations of components and distros/platforms that one build cycle takes several days, but we can expect that we'll reach the release in the near future. - Community members gave two presentations in ApacheCon Asia 2021. https://www.youtube.com/watch?v=7aC98dZHQkU https://www.youtube.com/watch?v=Nlc56tSABwU ## Community Health: - Community health is good. Activity metrics decreased in comparison with the last quarter, but we've been moving forward steadily to the next release. - 5 code contributors in the past quarter (-16% change) - 19 PRs opened on GitHub, past quarter (-45% change) - 20 PRs closed on GitHub, past quarter (-39% change) - 24 commits in the past quarter (-29% decrease)
No report was submitted.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (9 years ago) There are currently 39 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - Masatake Iwasaki was added to the PMC on 2021-03-11 - No new committers. Last addition was Yuqi Gu on 2020-06-10. ## Project Activity: - The community is mainly working on the upcoming 3.0.0 release, which is our first release based on Hadoop and Spark 3.x. We still have some platform-specific problems in CI and several JIRA issues, but we can expect that we'll reach the release in the near future. - A community member from Wikimedia, which recently migrated their Hadoop cluster to Bigtop 1.5.0, shared their knowledge and findings learned through that migration by publishing a blog post. https://techblog.wikimedia.org/2021/05/07/upgrading-hadoop-in-just-one-day/ - The community member mentioned above and another member from ARM gave an presentation on Bigtop 1.5.0 to promote broader use. https://connect.linaro.org/resources/lvc21/lvc21-204/ - Community members submitted two proposals to ApacheCon Asia 2021 and both of them were successfully adopted. https://apachecon.com/acasia2021/sessions/1150.html https://apachecon.com/acasia2021/sessions/1152.html - A PowerPC worker node in our CI environment had been unavailable for past several months, but it was back online thanks to IBM's cooperation, so we can include ppc64le in the next release target. - Kengo Seki was elected as the new PMC chair. ## Community Health: - Community health is good. Activity metrics decreased in comparison with the last quarter, but we've been moving forward steadily to the next release. - 7 code contributors in the past quarter (-22% change) - 27 issues opened in JIRA, past quarter (-54% change) - 29 issues closed in JIRA, past quarter (-42% change) - 27 commits in the past quarter (-43% decrease)
WHEREAS, the Board of Directors heretofore appointed Jun He (junhe) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Jun He from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Kengo Seki (sekikn) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Jun He is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Kengo Seki be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7C, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (8 years ago) There are currently 39 committers and 29 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - Yuqi Gu was added to the PMC on 2021-01-04 - No new committers. Last addition was Yuqi Gu on 2020-06-10. ## Project Activity: - 1.5.0 was released on 2020-12-15. In this release new distros and components are added, and many components upgraded. - Definition of v3.0 BOM is in discussion. The core objective is to upgrade Hadoop to 3.x, and other core components compatible with it. - Community is working on documentation update to better organize materials and reflect the latest status. ## Community Health: - Community health is good. Wikimedia has successfully migrated its CDH cluster to Bigtop v1.5.0 based, where related topics were discussed in user mailing list. - Regularly received bug reports/feature requests/PRs from users and community members. Commit activity increased compared to last quarter. Code contributors counter increased to 9, and closed PR has 35% increase to 53.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (8 years ago) There are currently 39 committers and 28 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Kengo Seki on 2020-04-17. - No new committers. Last addition was Yuqi Gu on 2020-06-10. ## Project Activity: - Recreated CI with new instances and a couple of security fixes applied. - Due to PowerPC worker node in CI is not available since Sept, and no response from IBM on community's request for resource, the community agreed to temporarily drop the ppc64le support in v1.5.0. - V1.5.0 release candidate is ready. Voting is in progress and will be closed on Sunday, December 13th, 2020. - Bigtop Website is now automatically built and deployed with changes pushed to master. - Started work on Hadoop upgrade to 3.2.1. ## Community Health: - Community health is good. New users and contributors were seen in threads of user and dev mailing list, where developer documentation and release status were discussed. - 7 code contributors in the past quarter (40% increase) - 59 issues opened in JIRA, past quarter (78% increase) - 56 issues closed in JIRA, past quarter (69% increase) - 90 commits in the past quarter (221% increase)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (8 years ago) There are currently 39 committers and 28 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Kengo Seki on 2020-04-17. - Yuqi Gu was added as committer on 2020-06-10 ## Project Activity: - V1.5.0 release is in active developing. Community is mainly working on the distro and architecture (x86/arm/ppc) compatibility in this quarter. - Added support for two new components: Logstash and Kibana. ## Community Health: - Community elected Yuqi Gu as new committer for his continuous and considerable contributions to the project. - Regularly received bug reports/feature requests/PRs from users and community members. - dev@bigtop.apache.org had a 47% decrease in traffic in the past quarter (223 emails compared to 420) - issues@bigtop.apache.org had a 48% decrease in traffic in the past quarter (131 emails compared to 249) - user@bigtop.apache.org had a 53% increase in traffic in the past quarter (23 emails compared to 15) - 29 issues opened in JIRA, past quarter (-35% decrease) - 29 issues closed in JIRA, past quarter (-23% decrease) - 24 commits in the past quarter (-29% decrease)
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (8 years ago) There are currently 38 committers and 28 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - Kengo Seki was added to the PMC on 2020-04-17 - Masatake Iwasaki was added as committer on 2020-04-18 ## Recent releases - 1.4.0 was released on 2019-06-15. ## Project Activity: - V1.5.0 release is in active developing with major effort in components bumping up and compaitibily improvements with new distros. - Community decided to deprecat inactive projects, Apache Apex, Apache Hama and Apache Tajo, from supporting components. - Community decided to add a new bigtop-mpack component to enable Bigtop SW stack deployment using Apache Ambari. ## Community Health: - Community elected one PMC member, Kengo Seiki, and one committer, Masatake Iwasaki, who made considerable code contributions to project. - Community health is good. Kengo Seki is our release manager. Discussions and commits have increased along with v1.5 release in progress: - dev@bigtop.apache.org had a 29% increase in traffic in the past quarter (442 emails compared to 341) - issues@bigtop.apache.org had a 23% decrease in traffic in the past quarter (252 emails compared to 326) - 43 issues opened in JIRA, past quarter (10% increase) - 31 issues closed in JIRA, past quarter (-26% decrease) - Regularly recived bug reports/feature requests/PRs from user and community members
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (7 years ago) There are currently 37 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Jun He on 2018-11-25. - No new committers. Last addition was Jun He on 2018-02-23. ## Recent releases - 1.4.0 was released on 2019-06-15. ## Project Activity: - Bigtop community is actively working on v1.5.0 release. Kengo Seki volunteered as release manager. This release includes components bumping up and new Linux distros support. It is in good progress. - Several new contributors (a few from Wikimedia) get involved and are driving the dev momentum. - Jun He was elected as the new PMC chair. ## Community Health: - Community health is good. Discussions and commits have increased along with v1.5 release in progress: - dev@bigtop.apache.org had a 83% increase in traffic in the past quarter (342 emails compared to 186) - issues@bigtop.apache.org had a 36% increase in traffic in the past quarter (329 emails compared to 241) - 41 PRs opened on GitHub, past quarter (24% increase) - 29 PRs closed on GitHub, past quarter (11% increase) - Regularly recived bug reports/feature requests/PRs from user and community members
WHEREAS, the Board of Directors heretofore appointed Youngwoo Kim (ywkim) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Youngwoo Kim from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Jun He (junhe) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Youngwoo Kim is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Jun He be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7A, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (7 years ago) There are currently 37 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Jun He on 2018-11-25. - No new committers. Last addition was Jun He on 2018-02-23. ## Project Activity: * Bigtop community have discussed and developed next 1.5.0 release. In upcoming release, we will update the support matrix of Linux distributions and also bump up up-to-date version of Bigtop components. * Alongside 1.5 development, Bigtop community discussed about 'Cloud Native Bigtop' as well. The purpose of CNB is building a big data and analytics distribution for cloud native world. * What we are trying to achieve via Cloud Native Bigtop are pushing for replacing traditional packaging and provisioning to new container based tooling and platforms. Eventually, Bigtop project can help move data infrastructure to more simple and cloud native platform along with related projects in ASF. ## Community Health: * Overall, commits and discussions on the community have increased. * During the last period, there were discussions and development activities on upcoming release and new features.
## Description: Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem. The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects. In short we strive to be for Hadoop what Debian is to Linux. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Bigtop was founded 2012-09-19 (7 years ago) There are currently 37 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Jun He on 2018-11-25. - No new committers. Last addition was Jun He on 2018-02-23. ## Project Activity: Software development activity: - We released the 1.4.0 version on 2019-06-15. - We are discussing to making release 1.x for existing users and reshaping of current project for the future release. Meetups and Conferences: - Community members(including PMC members) will attend ApacheCon NA 2019. - Jay Vyas will give a talk on prototype of modern big data and analytics architecture and future direction of Apache Bigtop. ## Community Health: After 1.4.0 release, activity of development is decreasing but overall community health is good. We have been discussing maintenance release and future release for the Cloud Native deployments.
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: None ## Activity: The vote for accepting RC1 as 1.4.0 release is on-going and currently has enough +1s to pass the vote. The release is planned to be official this week. ## PMC changes: Last PMC addition was Jun He on Sun Nov 25 2018 Currently 26 PMC members ## Committer base changes: Last committer addition was Jun He on Fri Feb 23 2018 Currently 37 committers ## Releases: Last release was 1.3.0 on Sat Nov 17 2018
## Description:
- Apache Bigtop is a software related to a system for integration, packaging,
deployment and validation of a big data management software distribution
based on Apache Hadoop.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Bigtop community is working on 1.4.0 release. Evans Ye volunteered as
release manager for the release.
- Jun He, Evans Ye and Ganesh Raju will co-present Apache Bigtop and the
support of big data on Aarch64 on Linaro Connect Bangkok 2019
## PMC changes:
- Currently 27 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Jun He on Sun Nov 25 2018
## Committer base changes:
- Currently 37 committers.
- No new committers added in the last 3 months
- Last committer addition was Jun He at Fri Feb 23 2018
## Releases:
- Last release was 1.3.0 on Sat Nov 17 2018
## Mailing list activity:
- dev@bigtop.apache.org:
- 149 subscribers (down -1 in the last 3 months):
- 225 emails sent to list (277 in previous quarter)
- announce@bigtop.apache.org:
- 54 subscribers (up 2 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- ci@bigtop.apache.org:
- 15 subscribers (down -2 in the last 3 months):
- 249 emails sent to list (169 in previous quarter)
- issues@bigtop.apache.org:
- 41 subscribers (up 1 in the last 3 months):
- 393 emails sent to list (316 in previous quarter)
- user@bigtop.apache.org:
- 177 subscribers (down -3 in the last 3 months):
- 15 emails sent to list (17 in previous quarter)
## JIRA activity:
- 77 JIRA tickets created in the last 3 months
- 80 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache Bigtop is a software related to a system for integration, packaging,
deployment and validation of a big data management software distribution
based on Apache Hadoop.
## Issues:
- There are no issues at this time.
## Activity:
- Bigtop 1.3.0 was released on Sat Nov 17 2018. This release include the
AArch64 to supported architecture and also there are improvements and fixes
related to docker image, toolchains, smoke tests and support for recent
version of ecosystem projects.
- Youngwoo Kim was elected as the new PMC chair.
## PMC changes:
- Currently 27 PMC members.
- Jun He was added to the PMC on Sun Nov 25 2018
## Committer base changes:
- Currently 37 committers.
- No new committers added in the last 3 months
- Last committer addition was Jun He at Fri Feb 23 2018
## Releases:
- 1.3.0 was released on Sat Nov 17 2018
## Mailing list activity:
- Activity is consistent. No significant trends to be identified.
- dev@bigtop.apache.org:
- 152 subscribers (up 1 in the last 3 months):
- 307 emails sent to list (177 in previous quarter)
- announce@bigtop.apache.org:
- 52 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- ci@bigtop.apache.org:
- 17 subscribers (down -1 in the last 3 months):
- 163 emails sent to list (78 in previous quarter)
- issues@bigtop.apache.org:
- 40 subscribers (up 0 in the last 3 months):
- 357 emails sent to list (441 in previous quarter)
- user@bigtop.apache.org:
- 180 subscribers (up 1 in the last 3 months):
- 17 emails sent to list (12 in previous quarter)
## JIRA activity:
- 30 JIRA tickets created in the last 3 months
- 33 JIRA tickets closed/resolved in the last 3 months
WHEREAS, the Board of Directors heretofore appointed Peter Linnell (plinnell) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Peter Linnell from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Youngwoo Kim (ywkim) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Peter Linnell is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Youngwoo Kim be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7B, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: None ## Activity: The community is actively working on 1.3.0 release and target to be released before ApacheCon 2018. Committer Jun He is serving as the RM. Currently we see a good progress being made. ## PMC changes: Last PMC addition was Kevin Monroe on Mon Nov 27 2017 Currently 26 PMC members ## Committer base changes: Last committer addition was Jun He on Fri Feb 23 2018 Currently 37 committers ## Releases: Last release was 1.2.1 on Sun Nov 12 2017
## Issues: None ## Activity: * The community has an ongoing discussion with ODPi exploring possibility of adding s390x as supported arch. * PMC member Olaf Flebbe had a talk on Apache EU Roadshow: Attacking IoT Developers, which mentioned a security report of Bigtop. * Contributors from Linaro had a presentation on HKG18: State of Big Data on AArch64. – Apache BigTop [1]. ## PMC changes: Last PMC addition was Kevin Monroe on Mon Nov 27 2017 Currently 26 PMC members. ## Committer base changes: Last committer addition was Jun He on Fri Feb 23 2018 Currently 37 committers. ## Releases: Last release was 1.2.1 on Sun Nov 12 2017 ## Links [1] http://connect.linaro.org/resource/hkg18/hkg18-220
No report was submitted.
@Phil: pursue a report for Bigtop
WHEREAS, the Board of Directors heretofore appointed Evans Ye (evansye) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Evans Ye from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Peter Linnell (plinnell) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Evans Ye is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Peter Linnell be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7B, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: In reply to Board's comment on last report: We had to remove Kafka artifacts because they violate ASF's policy to ban Facebook BSD+Patents license. The PMC had a discussion in [1]. There's also a Legal Jira[2] linked with it. ## Activity: * The BoF at FOSDOM 2018 hosted by Olaf brought back a discussion to the community that Bigtop dev is slowing down. The community is reaching out to ODPi[3] for comments. * The community is mainly fixing issues after bumping up versions of supported Linux distros [4]. ## PMC changes: Last PMC addition was Kevin Monroe on Mon Nov 27 2017 Currently 26 PMC members. ## Committer base changes: Last committer addition was Jun He on Fri Feb 23 2018 Currently 37 committers. ## Releases: Last release was 1.2.1 on Sun Nov 12 2017 ## Links [1] https://s.apache.org/BEg1 [2] https://issues.apache.org/jira/browse/LEGAL-322 [3] https://www.odpi.org [4] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: None. ## Activity: * Bigtop 1.2.1 was released on Sun Nov 12 2017 along with a blog post to describe the content of the release [1]. * The community has gain a momentum to work on bumping up versions of supported Linux distros. Couple of new contributors to Bigtop were involving in this work. * The community is planning for a meetup at FOSDOM 2018 [2]. ODPi [3] is willing to help for hosting the meetup. ## PMC changes: Last PMC addition was Kevin Monroe on Mon Nov 27 2017 Currently 26 PMC members ## Committer base changes: Last committer addition was Jonathan Kelly on Thu Dec 08 2016 Currently 35 committers ## Releases: Last release was 1.2.1 on Sun Nov 12 2017 ## Links [1] https://blogs.apache.org/bigtop/ [2] https://fosdem.org/2018/ [3] https://www.odpi.org/
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: None. ## Activity: The PMC has done a scan for all Bigtop upstream projects to identify whether Facebook's BSD+Patents license effects Apache Bigtop[1]. Turns out only Apache Kafka uses RocksDB. The Kafka artifacts are removed from Bigtop's S3 repository on 8/31 with an announcement prior to the deletion. The next bug fixing release 1.2.1 is delayed due to above license issue. The RM plan to roll out the release at the end of Sept. ## PMC changes: Last PMC addition was Amir Sanjar on Mon May 08 2017 Currently 25 PMC members. ## Committer base changes: Last committer addition was Jonathan Kelly on Thu Dec 08 2016 Currently 35 committers. ## Releases: Last release was 1.2.0 on Tue Apr 04 2017 ## Links [1]. https://issues.apache.org/jira/browse/LEGAL-322
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: PMC spots that a company[1] is using name/trademark similar to Bigtop. We'll get this to Apache legal team to find out our next move. ## Activity: The community has released 1.2.0 on April 4th, 2017. The community is working on 1.2.1 release expected to be out at the end of June, which will mainly be a bug fixing release with minor upgrades for certain components. Folks had a meetup during DataWorks Summit San Jose 2017, laying down details of what need to be included in 1.2.1 release and what's our future directions. We'll bring that back on mailing list to reach consensus. There was a talk about Apache Bigtop at Apache: Big Data Miami: Leveraging Docker for Hadoop Build Automation and Big Data Provisioning, Evans Ye ## PMC changes: Last PMC addition was Amir Sanjar on Mon May 08 2017 Currently 25 PMC members. ## Committer base changes: Last committer addition was Jonathan Kelly on Thu Dec 08 2016 Currently 35 committers. ## Releases: Last release was 1.2.0 on Tue Apr 04 2017 ## Links
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: None ## Activity: The community is still working on 1.2 release with visible progress. There has been no schedule for the release yet. [1] A task to merge ODPi contributions back to Bigtop is in progress. [2] There have been a couple of talks around Apache Bigtop at FOSDEM 2017: Roman Shaposhnik: - Postgres MPP Data Warehousing joins Hadoop ecosystem Making two elephants dance Olaf Flebbe - Quickstart Big Data Roman also co-moderated a devroom "HPC, Big Data and Data Science". ## PMC changes: Last PMC addition was Nate D'Amico on Fri Jan 22 2016 ## Committer base changes: Last committer addition was Jonathan Kelly on Thu Dec 08 2016 ## Releases: Last release was 1.1.0 on Sat Jan 30 2016 ## Links 1. https://issues.apache.org/jira/browse/BIGTOP-2282 2. https://issues.apache.org/jira/browse/BIGTOP-2666
WHEREAS, the Board of Directors heretofore appointed Olaf Flebbe (oflebbe) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Olaf Flebbe from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by consensus to recommend Evans Ye (evansye) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Olaf Flebbe is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Evans Ye be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7D, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: None ## Releases: 1.1.0 was released on Fri Jan 29 2016 ## Activitiy Activity has been started again and work for a release 1.2.0 is in progress. We decided to invite two more committers and they accepted. We are monitoring if additional actions are required to drive the project forward. At ApacheCon Big Data Europe in Seville there were several talks with use cases for Apache Bigtop: * Implementing BigPetStore in Spark and Flink - Márton Balassi * Massively Parallel Data Warehousing in the Hadoop Stack (Greenplum) - Gregory Chase & Roman Shaposhnik * Attacking a Big Data Developer - Olaf Flebbe * Performance Tuning tips for Apache Spark Machine Learning workloads - Shreeharsha GN & Amir Sanjar ## PMC changes: Last PMC addition was Nate D'Amico on Fri Jan 22 2016 ## Committer base changes: Last committer additions: * Jonathan Kelly was added as a committer on Thu Dec 08 2016 * Kengo Seki was added as a committer on Tue Dec 06 2016
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: None ## Releases: 1.1.0 was released on Fri Jan 29 2016 ## Activitiy Activity has been stalled a bit because almost all Committer and PMC seem to have little time to spend on Apache Bigtop. A discussion started how to add new committers to keep suggested enhancements reviewed, which are still flowing in. The discussion ended by inviting a new committer, who proposed the Juju charms integration in the first place. Luckily he accepted a few days ago. We are monitoring if additional actions are required. ## PMC changes: - Last PMC addition was Nate D'Amico on Fri Jan 22 2016 ## Committer base changes: - Last committer addition: Fri Aug 26 2016 (Kevin Monroe)
## Description: Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop. ## Issues: Issues regarding ODPi's vs. Apache Bigtop position have been resolved on the private@ mailing list. ## Releases: 1.1.0 was released on Fri Jan 29 2016 ## Activitiy We see a 10% new members increase on the dev mailing list in the last three months and important new contributions to the project: An AARCH64 ARM Machine has been provided by Linaro via ODPi to the project. A major new feature contributed by ubuntu is in the queue: Juju charms for apache bigtop. [1] From the last uptick of patches for inclusion of additional big data components into the Bigtop Stack these have been processed: Apache Flink, Apache Apex (incubating) and Quanta File System (QFS) packaging has been included into the master branch now. Work is still continuing on further support, especially on Flink deployment. There have been a couple of talks around Apache Bigtop at ApacheCon Big Data NA: Konstantin Boudnik & Roman Shaposhnik: - How ODPi Leveraged Apache Bigtop to Get to Market Faster (and You Can Too!) Antonio Rosales & Konstantin Boudnik: - Apache BigTop Hadoop Dev Test Benchmark on Your Favorite Cloud or Laptop Konstantin Boudnik: - Apache Bigtop: Overview and 2016 Community Update Amir Sanjar & Evans Ye: - Dockerized Hadoop Platform and Recent Updates in Apache Bigtop Evans Ye: - Using the SDACK Architecture to Build a Big Data Product ## PMC changes: - Last PMC addition was Nate D'Amico on Fri Jan 22 2016 ## Committer base changes: - Amir Sanjar was added as a committer on Fri Jun 03 2016 ## Links: 1. https://issues.apache.org/jira/browse/BIGTOP-2435
WHEREAS, the Board of Directors heretofore appointed Andrew Purtell (apurtell) to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Andrew Purtell from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Olaf Flebbe (oflebbe) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Andrew Purtell is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Olaf Flebbe be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7J, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
ISSUES FOR THE BOARD’S ATTENTION There are no issues requiring board attention at this time. RELEASES 1.1.0 was released on Fri Jan 29 2016 ACTIVITY Evans Ye will be presenting "Dockerized Hadoop platform and recent updates in Apache Bigtop" at Apache Big Data NA 2016[1] Olaf Flebbe presented "Apache Bigtop" at FOSDEM '16 in the HPC, Big Data and Data Science Devroom on Jan 31th in Brussels[2] We have seen an uptick in requests or patches for inclusion of additional big data components into the Bigtop Stack: Apache Apex (incubating)[3], Druid[4], Apache Flink[5], Apache HAWQ (incubating)[6], QFS[7], HiBench[8]. This speaks to others sharing our vision of Bigtop as the "Debian of Big Data" and indicates continued if not increasing momentum for the project. Northwestern University and Boston University have four graduate students working on Apache Flink packaging for Bigtop, and testing it deployed on OpenStack. The Bigtop 1.1.0 release expands the reach of the Bigtop Stack with ppc64le (POWER8) platform support. We would like to extend this further to ARM platform support in upcoming releases and would welcome any contributions in that regard. COMMUNITY Nate D'Amico was added to the PMC on Thu Jan 21 2016 Last PMC addition: Thu Jan 21 2016 (Nate D'Amico) No new committers in the last 3 months. STATS 32 committers 24 PMC 139 subscribers to the dev list (up 9 in the last 3 months) 186 subscribers to the user list (up 14 in the last 3 months) 189 JIRA tickets created in the last 3 months 141 JIRA tickets closed/resolved in the last 3 months 1. http://events.linuxfoundation.org/events/apache-big-data-north-america 2. https://fosdem.org/2016/schedule/event/bigtop 3. https://issues.apache.org/jira/browse/BIGTOP-2313 4. https://issues.apache.org/jira/browse/BIGTOP-2348 5. https://issues.apache.org/jira/browse/BIGTOP-1927 6. https://issues.apache.org/jira/browse/BIGTOP-2320 7. https://issues.apache.org/jira/browse/BIGTOP-2283 8. https://github.com/intel-hadoop/HiBench
Apache Bigtop is software for integration, packaging, deployment, and validation of Apache big data ecosystem components. ISSUES FOR THE BOARD’S ATTENTION There are no issues requiring board attention at this time. RELEASES Last release was 1.0.0, released on Mon Aug 10 2015 ACTIVITY The bigpetstore-flink implementation was presented at Flink Forward in Berlin. [1] Bigtop artifacts are running as an integration test for the Google Cloud Platform/kubernetes, which indicates pickup of Bigtop outside of the Hadoop ecosystem as a generic tool for testing data driven workloads. IBM donated a VM on a POWER machine for porting Bigtop to the POWER hardware architecture. Porting is still in progress. After some churn due to sponsorship changes we finally have a stable Docker-based continuous integration environment and convenience binary artifact storage hosted on donated Amazon EC2 resources, to better support project development. COMMUNITY R J Nowling was added to the PMC on Mon Sep 14 2015 Youngwoo Kim was added to the PMC on Mon Sep 14 2015 No new committers in the last 3 months. Last committer addition: Tue Mar 24 2015 (Nate D'Amico) STATS 32 committers 23 PMC 130 subscribers to the dev list (up 5 in the last 3 months) 172 subscribers to the user list (up 7 in the last 3 months) 151 JIRA tickets created in the last 3 months 135 JIRA tickets closed/resolved in the last 3 months 1. http://s.apache.org/jTq
Apache Bigtop is software for integration, packaging, deployment, and validation of Apache big data ecosystem components. ISSUES FOR THE BOARD’S ATTENTION There are no issues requiring board attention at this time. RELEASES The last release was version 1.0.0, released on August 10, 2015. ACTIVITY The project recently reached a very important milestone with the 1.0.0 release. The release completes a reboot of our build and CI infrastructure now hosted on several EC2 cloud instances. All costs of these instances are defrayed by a generous grant of these resources from Amazon. We have just kicked off a new initiative, BigTop Data Generators, an effort to extract and clean up our data generator code into a set of generally usable libraries for building data generators. Our vision is for all of Apache to come to Bigtop for tools for building better, more comprehensive data generators and blueprints for scale system simulations. We note that Ubuntu and Kubernetes are already using the Bigtop Docker images of our pet store data generators for testing. COMMUNITY The first official Apache Bigtop Workshop will be held in Budapest on September 25th coinciding with Apache Big Data / Core events. [1] Nate D'Amico was added as a committer on 3/24/2015. Olaf Flebbe was added to the PMC on 6/8/2015. Evans Ye was added to the PMC on 6/8/2015. STATS 32 committers 21 PMC 126 subscribers to the dev list (up 4 in the last 3 months) 163 subscribers to the user list (up 9 in the last 3 months) 114 JIRA tickets created in the last 3 months 75 JIRA tickets closed/resolved in the last 3 months 1. https://docs.google.com/document/d/1T1QMqt4H_5KLzQjZd2cVcVsgFpZeED2Opo3U5p1Jl-8
Apache Bigtop is software for integration, packaging, deployment, and validation of Apache big data ecosystem components. ISSUES FOR THE BOARD’S ATTENTION There are no issues requiring board attention at this time. RELEASES The last release was version 0.8.0, released on Oct 5, 2014. ACTIVITY The project rebooted its CI infrastructure with Docker and several EC2 cloud instances. All costs of these instances are defrayed by a generous grant of these resources from Amazon. Development activity for the upcoming 1.0 release is almost complete. The release was blocked by the CI overhaul. The project has placed the Twitter @ASFbigtop account under joint management via TweetDeck. Several members of the PMC are able to tweet using the account. COMMUNITY Nate D'Amico was added as a committer on 3/24/2015. Olaf Flebbe was added to the PMC on 6/8/2015. Evans Ye was added to the PMC on 6/8/2015. Konstantin Boudnik presented at ApacheCon North America 2015. STATS 32 committers 21 PMC 123 subscribers to the dev list (up 3 in the last 3 months) 155 subscribers to the user list (up 1 in the last 3 months) 38 JIRA tickets created in the last 3 months 118 JIRA tickets closed/resolved in the last 3 months
WHEREAS, the Board of Directors heretofore appointed Konstantin Boudnik to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Konstantin Boudnik from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Andrew Purtell as the Successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Konstantin Boudnik is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Andrew Purtell be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7B, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
## Description:
A 100% community-driven Bigdata management platform.
## Activity:
- PMC has voted new project committer Nate D'Amico with assignment to be
Apache Bigtop community manager, helping PMC with project outreach,
conferences and marketing materials. Vote thread http://s.apache.org/1Mf
- Amazon EM2 team has reached with an offer to host Bigtop CI
infrastructure, which is CPU and RAM intensive. We are currently
investigating the options
- As per project bylaws a new PMC Chair election has been started
(vote thead: http://s.apache.org/B40; vote result: http://s.apache.org/Mla).
Andrew Purtell was elected as the new Chair.
- All other project activities were outlined in the March 2015 project
report to the board.
## Issues:
Following up on a number of discussion within this PMC and some of the now
former board directors the following "social media" guidelines were
developed in consensus with the project community
https://cwiki.apache.org/confluence/display/BIGTOP/Social+Media+Guidelines
The consensus has been confirmed by two votes:
http://s.apache.org/6i4 - Social media guidelines
http://s.apache.org/gMc - Amending the guidelines w/ more precise language
The twitter account @ASFBigtop is now hosted on Twitterdeck where any community
member can be added and make posts as per the guidelines above. Hence the issue
seems to be fully resolved via normal community process.
## PMC/Committership changes:
- Currently 32 committers and 20 PMC members in the project.
- New commmitters:
- Evans Ye was added as a committer on Fri Jan 02 2015
- Dasha Boudnik was added as a committer on Fri Jan 23 2015
- R J Nowling was added as a committer on Fri Mar 06 2015
- Olaf Flebbe was added as a committer on Fri Jan 23 2015
- Youngwoo Kim was added as a committer on Thu Mar 05 2015
- Nate D'Amico was added as a committer on Tue Mar 24 2015
- New PMC members
- Jay Vyas was added to the PMC on Wed Dec 17 2014
- Sean Mackrory was added to the PMC on Fri Jan 16 2015
## Releases:
- Last release was 0.8.0 on Fri Oct 03 2014
- Community is preparing to release Bigtop 1.0 around ApacheCon time in
April, 2015
## Mailing list activity:
- dev@bigtop.apache.org:
- 120 subscribers (up 1 in the last 3 months):
- 3203 emails sent to list (1815 in previous quarter)
- user@bigtop.apache.org:
- 154 subscribers (up 4 in the last 3 months):
- 137 emails sent to list (152 in previous quarter)
- ci@bigtop.apache.org:
- 13 subscribers (up 2 in the last 3 months):
- 418 emails sent to list (273 in previous quarter)
- announce@bigtop.apache.org:
- 30 subscribers (up 5 in the last 3 months):
- 0 emails sent to list (1 in previous quarter)
- issues@bigtop.apache.org:
- 5 subscribers (up 5 in the last 3 months)
## JIRA activity:
- 217 JIRA tickets created in the last 3 months
- 189 JIRA tickets closed/resolved in the last 3 months
## Description:
A 100% community-driven Bigdata management platform.
## Activity:
- Release 1.0 is getting into the final stages (blocked by CI overhaul).
The expected release date is around ApacheCon April, 2015
- We have fully migrated to to Puppet 3.x with use of Hiera configuration
management tool
- Docker containers support was added
- Bigtop has a workshop day and a 3-days booth at SCALE13x conference
- A talk about in-memory computing stacks has been accepted to ApacheCon
NorthAmerica 2015
- community is actively engaged into the conversations with a number of
companies and projects in the space for the code contributions
- a few new contributors started contributing to the project
- a meetup & hackathon was hosted by Amazon A9
## Issues:
- there are no issues requiring board attention at this time
## PMC/Committership changes:
- Currently 31 committers and 20 PMC members in the project.
- New PMC members
- Sean Mackrory was added to the PMC on Fri Jan 16 2015
- Jay Vyas was added to the PMC on Wed Dec 17 2014
- New committers
- RJ Nowling was added as a committer on Fri Mar 06 2015
- Youngwoo Kim was added as a committer on Thu Mar 05 2015
- Dasha Boudnik was added as a committer on Fri Jan 23 2015
- Olaf Flebbe was added as a committer on Fri Jan 23 2015
- Evans Ye was added as a committer on Fri Jan 02 2015
- Resigned PMC members
- John Sichi resigned on Mar 06 2015
- Travis Crawford resigned on Mar 06 2015
- Andrei Savu resigned on Mar 06 2015
## Releases:
- Community is preparing to release Bigtop 1.0 around ApacheCon time in
April, 2015
## Mailing list activity:
- dev@bigtop.apache.org: 120 subscribers (up 3 in the last 3 months):
2830 emails sent to list (2128 in previous quarter)
- user@bigtop.apache.org: 153 subscribers (up 4 in the last 3 months):
109 emails sent to list (203 in previous quarter)
- ci@bigtop.apache.org: 11 subscribers (up 0 in the last 3 months):
269 emails sent to list (351 in previous quarter)
- announce@bigtop.apache.org: 27 subscribers (up 3 in the last 3 months):
0 emails sent to list (1 in previous quarter)
## JIRA activity:
- 165 JIRA tickets created in the last 3 months
- 163 JIRA tickets closed/resolved in the last 3 months
@Ross: follow up with PMC regarding the resignation of PMC members and the health of the community
Apache Bigtop is a software related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop.
RELEASES
* The last release of Apache Bigtop was version 0.8.0, released on Oct 5, 2014
* Bigtop 0.9.0 is the next release scheduled for Q1 of 2015, based on Hadoop 2.6
CURRENT ACTIVITY
* Development activity for 0.9.0 release continues as can be seen from the
following list:
https://issues.apache.org/jira/issues/?filter=12329840
(since last board report, Sep 2014)
* Community is working on next release, build system usability and product
testability
* The project has fully migrated away from make to Gradle build infrastructure
* Two new software components were added since last release: GridGain Hadoop
Accelerator, and Tachyon FS cache
* The project has presented a talk at ApacheCon Europe 2014
* We are working to put together Bigtop workshop at Scale 13x conference
COMMUNITY
* Project has grown with a few new contributors since last report
* No other changes in the community in this period
* Currently there are:
- Total of 118 subscribers to the developer list
- Total of 149 subscribers to the user list
- Total of 25 subscribers to the announce list
- Total of 26 committers
- Total of 21 PMC members
ISSUES
* There are no issues requiring board attention at this time.
Apache Bigtop is a software related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop.
RELEASES
* The last release of Apache Bigtop was version 0.7.0, released on Nov 5, 2013
* Bigtop 0.8.0 is the next release scheduled for Q3 of 2014, based on
Hadoop 2.4.1
- RC1 is getting build at the time of the report writing
CURRENT ACTIVITY
* Development activity continues as can be seen from the following report:
https://issues.apache.org/jira/browse/?filter=12329170
(since last board report, June 2014)
* Bigtop 0.8.0 is the next release the community is working on
* Accommodations were made to include Hadoop 2.4.1
* CI system has been cleaned and improved to allow work on new release
* Project's meetup was held on July 22, 2014
COMMUNITY
* No changes in community in this period
* Currently there are:
- Total of 117 subscribers to the developer list
- Total of 140 subscribers to the user list
- Total of 24 subscribers to the announce list
- Total of 26 committers
- Total of 21 PMC members
ISSUES
* There are no issues requiring board attention at this time.
Apache Bigtop is a software related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop.
RELEASES
* The last release of Apache Bigtop was version 0.7.0, released on Nov 5, 2013
* Bigtop 0.8.0 is the next release scheduled for Q2 of 2014, based on Hadoop 2.3
- release is delayed from originally planned Q1 of 2014 because of the scope
of the changes: Hbase signularity release, causing Flume incompatibility.
CURRENT ACTIVITY
* Development activity continues as can be seen from the following report:
https://issues.apache.org/jira/issues/?filter=12327429
(since last board report, March 2014)
* Bigtop 0.8.0 is the next release the community is working on
* Accomodations are made to include HBase 0.98.2
* Spark 0.9.1 is added to the upcoming release
* Build system is migrating to the Gradle platform from make
* Two project's meetups/hackathons were put together:
- at ApacheCon April 7-8, 2014
- June 6,9 2014
COMMUNITY
* Jay Vyas has been added as a committer to the project
* Andrew Purtell has been added as a member to the PMC
* Currently there are:
- Total of 115 subscribers to the developer list
- Total of 137 subscribers to the user list
- Total of 24 subscribers to the announce list
- Total of 26 committers
- Total of 21 PMC members
ISSUES
* There are no issues requiring board attention at this time.
WHEREAS, the Board of Directors heretofore appointed Roman Shaposhnik to the office of Vice President, Apache Bigtop, and WHEREAS, the Board of Directors is in receipt of the resignation of Roman Shaposhnik from the office of Vice President, Apache Bigtop, and WHEREAS, the Project Management Committee of the Apache Bigtop project has chosen by vote to recommend Konstantin Boudnik as the Successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Roman Shaposhnik is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Bigtop, and BE IT FURTHER RESOLVED, that Konstantin Boudnik be and hereby is appointed to the office of Vice President, Apache Bigtop, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7D, Change the Apache Bigtop Project Chair, was approved by Unanimous Vote of the directors present.
Apache Bigtop is a software related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop.
RELEASES
* The last release of Apache Bigtop was version 0.7.0, released on Nov 5, 2013
* Bigtop 0.8.0 is the next release scheduled for Q2 of 2014, based on Hadoop 2.3
- release is delayed from originally planned Q1 of 2014 because of the scope
of the changes
CURRENT ACTIVITY
* Development activity continues as can be seen from the following report:
https://issues.apache.org/jira/issues/?filter=12326778
(since last board report, Dec 2013)
* Bigtop 0.8.0 is the next release the community is working on
* Groovy language runtime environment has been added to Bigtop
* Latest version of Hadoop 2.3 is being added to Bigtop
COMMUNITY
No changes
* Currently there are:
- Total of 115 subscribers to the developer list
- Total of 132 subscribers to the user list
- Total of 24 subscribers to the announce list
- Total of 25 committers
- Total of 20 PMC members
ISSUES
* The Apache Bigtop PMC has voted to recommend
Konstantin Boudnik <cos@apache.org>
be appointed to the office of Vice President, Apache Bigtop
* PMC has voted on and approved establishing term limits for
the position of PMC Chair. Adopted: a position of an Apache Bigtop Chair
gets elected for a year. After a year passes it is expected of the active
Chair to start a [DISCUSS] email thread on private@bigtop.apache.org asking
PMC members to nominate themselves for the next year. It is perfectly
acceptable for the active chair to nominate him or herself. There is no
limit on the number of terms that one person can server as an Apache Bigtop
Chair. Each term, however is limited to one year.
DESCRIPTION
Apache Bigtop is a software related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop
RELEASES
* The last release of Apache Bigtop was version 0.7.0, released on
Nov 5, 2013
* Bigtop 0.8.0 is the next release scheduled for Q1 of 2014 and based on
Hadoop 2 GA
CURRENT ACTIVITY
* Development activity continues as can be seen from the following report:
https://issues.apache.org/jira/issues/?filter=12325886
(since last board report, Sep 2013)
* Bigtop 0.7.0 was released with a approximately a month of schedule slip
* Bigtop 0.8.0 is the next release the community is working on.
* Phoenix (proposed for incubation) has been added to Bigtop
* Kite is in the process of being added to Bigtop
COMMUNITY
No changes
* Currently there are:
- Total of 118 subscribers to the developer list
- Total of 130 subscribers to the user list
- Total of 24 subscribers to the announce list
- Total of 23 committers
- Total of 20 PMC members
ISSUES
* There are no issues requiring board attention at this time.
DESCRIPTION Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop RELEASES * The last release of Apache Bigtop was version 0.6.0, released on Jun 18, 2013 * A maintenance release of 0.3.1 has now officially been put on hold because of lack of volunteers * Bigtop 0.7.0 is the next release scheduled to end of Sep/beginning of Oct 2013 CURRENT ACTIVITY * Development activity continues as can be seen from the following report: https://issues.apache.org/jira/issues/?filter=12324841 (since last board report, Jun 2013) * Bigtop 0.7.0 is progressing to be released on schedule * Bigtop 0.8.0 has been agreed upon to be allow breakage in compatibility in key Bigtop components compared to prior releases. * Apache Spark (incubating) has been added to Bigtop * A few podcasts/presentations: http://allthingshadoop.com/2013/08/12/apache-bigtop-and-how-packaging-infrastructure-binds-the-hadoop-ecosystem-together/ http://www.oscon.com/oscon2013/public/schedule/detail/28510 COMMUNITY * Alejandro Abdelnur requested going emeritus from Bigtop PMC * Andrew Purtell has been added as a committer to the project * Currently there are: - Total of 118 subscribers to the developer list - Total of 126 subscribers to the user list - Total of 24 subscribers to the announce list - Total of 23 committers - Total of 20 PMC members ISSUES * There are no issues requiring board attention at this time.
DESCRIPTION
Apache Bigtop is a software related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop
RELEASES
* The last release of Apache Bigtop was version 0.5.0, released on Dec 18, 2012
* There has not been much progress with a maintenance release of 0.3.1
* Bigtop 0.6.0 is currently being voted on
CURRENT ACTIVITY
* Development activity continues as can be seen from the following report:
https://issues.apache.org/jira/issues/?filter=12323696
(since last board report, Dec 2012)
* Bigtop community pitched in for RMing Hadoop 2.0.5-alpha bug fix release
* WANDisco has adopted Apache Bigtop as a basis for their enterprise Hadoop
distribution
* Bigtop meetups are back in the SF Bay Area:
http://www.meetup.com/HandsOnProgrammingEvents/events/122050632/
COMMUNITY
* PMC Composition has not changed since the last report.
* There were no new committers added to the project since the last report.
* Currently there are:
- Total of 106 subscribers to the developer list
- Total of 121 subscribers to the user list
- Total of 18 subscribers to the announce list
- Total of 22 committers
- Total of 21 PMC members
ISSUES
* There are no issues requiring board attention at this time.
DESCRIPTION
Apache Bigtop is a software related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop
RELEASES
* The last release of Apache Bigtop was version 0.5.0, released on Dec 18, 2012
* There has not been much progress with a maintenance release of 0.3.1
* Bigtop 0.6.0 release has been scoped and RM assigned (Roman Shaposhnik)
The target date for the release is end of Mar 2013
CURRENT ACTIVITY
* Development activity continues as can be seen from the following report:
https://issues.apache.org/jira/issues/?filter=12323696
(since last board report, Dec 2012)
* There was a good progress on a proposal for stabilizing the Hadoop
2.X codeline via utilizing test aspects of Bigtop.
COMMUNITY
* PMC Composition has not changed since the last report
The current affiliations in the PMC stand at: independent (3),
Cloudera (9), Hortonworks (3), Canonical(1), Oracle(1), Twitter(1),
Facebook(1), Amazon.com(1), WANDisco(1)
* Currently there are:
- Total of 98 subscribers to the developer list
- Total of 116 subscribers to the user list
- Total of 15 subscribers to the announce list
- Total of 22 committers
- Total of 21 PMC members
ISSUES
* There are no issues requiring board attention at this time.
DESCRIPTION Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop RELEASES * The last release of Apache Bigtop was version 0.4.0-incubating, released on Aug 20, 2012 while in Incubation. * There has been some progress with a maintenance release of 0.3.1 * Bigtop 0.5.0 RC0 is now being voted on CURRENT ACTIVITY * Development activity continues as can be seen from the following report: http://s.apache.org/dLE (since last board report, Nov 2012) COMMUNITY * Anatoli Fomenko (af@apache.org) has been voted in as a committer * Bigtop talk has been accepted for ApacheCON NA 2013 * PMC Composition has not changed since becoming a TLP. The current affiliations in the PMC stand at: independent (4), Cloudera (9), Hortonworks (3), Canonical(1), Oracle(1), Twitter(1), Facebook(1), Amazon.com(1) * Currently there are: - Total of 98 subscribers to the developer list - Total of 109 subscribers to the user list - Total of 22 committers - Total of 21 PMC members ISSUES * There are no issues requiring board attention at this time.
Bertrand to follow up regarding making reports standalone (with no external/unstable URLs)
DESCRIPTION Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop RELEASES * The last release of Apache Bigtop was version 0.4.0-incubating, released on Aug 20, 2012 while in Incubation. * There has not been much progress with a maintenance release of 0.3.1 * Bigtop 0.5.0 release has been scoped and RM assigned (Roman Shaposhnik) The target date for the release is end of Nov 2012 CURRENT ACTIVITY * Development activity continues as can be seen from the following report: http://s.apache.org/VRE (since last board report, Oct 2012) * All post-graduation tasks have been completed and all of the project infrastructure (web site, SCM, etc.) reflects its TLP status. COMMUNITY * PMC Composition has not changed since becoming a TLP. The current affiliations in the PMC stand at: independent (4), Cloudera (9), Hortonworks (3), Canonical(1), Oracle(1), Twitter(1), Facebook(1), Amazon.com(1) * Currently there are: - Total of 98 subscribers to the developer list - Total of 108 subscribers to the user list - Total of 21 committers - Total of 21 PMC members ISSUES * There are no issues requiring board attention at this time.
DESCRIPTION Apache Bigtop is a software related to a system for integration, packaging, deployment and validation of a big data management software distribution based on Apache Hadoop RELEASES * The last release of Apache Bigtop was version 0.4.0-incubating, released on Aug 20, 2012 while in Incubation. * A branch has been created for maintenance release 0.3.1 and it is currently being maintained by a 0.3.1 Release Manager (Konstantin Boudnik) * Planning for the next milestone release 0.5.0 are underway. CURRENT ACTIVITY * Development activity continues as can be seen from the following report: http://s.apache.org/Cnw (since last incubator report, Sep 2012) * Post-graduation tasks are under way. Details at: http://s.apache.org/kh COMMUNITY * PMC Composition has not changed since becoming a TLP. The current affiliations in the PMC stand at: independent (5), Cloudera (9), Hortonworks (3), Canonical(1), Oracle(1), Twitter(1), Facebook(1) * Currently there are: - Total of 49 subscribers to the developer list - Total of 52 subscribers to the user list - Total of 21 committers - Total of 21 PMC members ISSUES * There are no issues requiring board attention at this time.
WHEREAS, the Board of Directors deems it to be in the best
interests of the Foundation and consistent with the
Foundation's purpose to establish a Project Management
Committee charged with the creation and maintenance of
open-source software, for distribution at no charge to
the public, related to a system for integration,
packaging, deployment and validation of a big data management
software distribution based on Apache Hadoop.
NOW, THEREFORE, BE IT RESOLVED, that a Project Management
Committee (PMC), to be known as the "Apache Bigtop Project",
be and hereby is established pursuant to Bylaws of the
Foundation; and be it further
RESOLVED, that the Apache Bigtop Project be and hereby is
responsible for the creation and maintenance of software
related to a system for integration, packaging, deployment and
validation of a big data management software distribution based
on Apache Hadoop; and be it further
RESOLVED, that the office of "Vice President, Apache Bigtop" be
and hereby is created, the person holding such office to
serve at the direction of the Board of Directors as the chair
of the Apache Bigtop Project, and to have primary responsibility
for management of the projects within the scope of
responsibility of the Apache Bigtop Project; and be it further
RESOLVED, that the persons listed immediately below be and
hereby are appointed to serve as the initial members of the
Apache Bigtop Project:
* Alan Gates gates@apache.org
* Patrick Hunt phunt@apache.org
* Steve Loughran stevel@apache.org
* Tom White tomwhite@apache.org
* Alejandro Abdelnur tucu@apache.org
* Andrew Bayer abayer@apache.org
* Konstantin Boudnik cos@apache.org
* Stephen Chu schu@apache.org
* Bruno Mahe bmahe@apache.org
* Peter Linnell plinnell@apache.org
* James Page jamespage@apache.org
* Patrick Taylor Ramsey ptr@apache.org
* Roman Shaposhnik rvs@apache.org
* Michael Stack stack@apache.org
* Andrei Savu asavu@apache.org
* Edward J. Yoon edwardyoon@apache.org
* Andre Arcilla arcilla@apache.org
* Eli Collins eli@apache.org
* Travis Crawford traviscrawford@apache.org
* John Sichi jvs@apache.org
* Owen O'Malley omalley@apache.org
NOW, THEREFORE, BE IT FURTHER RESOLVED, that Roman Shaposhnik
be appointed to the office of Vice President, Apache Bigtop,
to serve in accordance with and subject to the direction of the
Board of Directors and the Bylaws of the Foundation until
death, resignation, retirement, removal or disqualification,
or until a successor is appointed; and be it further
RESOLVED, that the initial Apache Bigtop PMC be and hereby is
tasked with the creation of a set of bylaws intended to
encourage open development and increased participation in the
Apache Bigtop Project; and be it further
RESOLVED, that the Apache Bigtop Project be and hereby
is tasked with the migration and rationalization of the Apache
Incubator Bigtop podling; and be it further
RESOLVED, that all responsibilities pertaining to the Apache
Incubator Bigtop podling encumbered upon the Apache Incubator
Project are hereafter discharged.
Special Order 7D, Establish the Apache Bigtop Project, was
approved by Unanimous Vote of the directors present.
Bigtop is a project for the development of native packaging and stack tests of the Hadoop ecosystem. Bigtop entered incubation on June 20, 2011. Primary issues blocking graduation: None: the discussion thread on bigtop-dev and bigtop-user produced a unanimous +1 vote for starting the graduation process. Issues which Incubator PMC and/or ASF Board might need/wish to be aware of: Bigtop is about to start the graduation vote Community development since last report: Stephen Chu added as a Bigtop committer Bigtop has developed a very robust and high profile user community: https://cwiki.apache.org/confluence/display/BIGTOP/Powered+By+Bigtop Increased number of patches from our new community members Project development since last report: - released Bigtop 0.4.0-incubating - Bigtop 0.3.0 branch is now in active maintenance mode courtesy of Cos and Bruno - Bigtop 0.3.1 expected shortly - Giraph is now supported in Bigtop 0.4.0/trunk branches - Hue is now supported in Bigtop 0.4.0/trunk branches - Hama is now supported in Bigtop 0.3.0 branch - used Bigtop to validate Hadoop 1.0.* RC and Hadoop 2.0.1-alpha RC releases - used Bigtop to validate HBase 0.92.1 RC - increased the # and scope of integration tests Signed-off-by: tomwhite, mnour
Bigtop is a project for the development of native packaging and stack tests of the Hadoop ecosystem. Bigtop entered incubation on June 20, 2011. Primary issues blocking graduation: - Need for increased diversity and additional committers. Issues which Incubator PMC and/or ASF Board might need/wish to be aware of: A discussion of whether publishing non-ASF, but AL licensed binary convenience artifacts as part of Bigtop release is #1 consistent with Apache Software Foundation policies #2 desirable by Apache Software Foundation resulted in a very productive email exchange: http://thread.gmane.org/gmane.comp.apache.incubator.general/35545/focus=35627 A consensus was reached that doing so does NOT seem to violate any established Apache Software Foundation policies Given a difference of opinion on #2 a compromise was reached: starting from Bigtop 0.4.0 release, the project will vote exclusively on source artifacts and it will NOT use ASF infrastructure for hosting the resulting binary convenience artifacts. This decision was explicitly approved by one of our mentors -- Alan Gates. Community development since last report: Patrick Taylor Ramsey added as a Bigtop committer Our regular Bay Area Bigtop meetup/class is going strong with ~15 members http://www.meetup.com/HandsOnProgrammingEvents/ Bigtop meetup hackathon attracted more than 20 people: http://www.meetup.com/HandsOnProgrammingEvents/events/61455472/ Started submission process for a talk at ACM Bigdata camp Major Hadoop vendors/shops are slowly embracing Bigtop and using it as a basis of their infrastructure: - Cloudera: http://www.cloudera.com/cdh4/ - HortonWorks: http://drcos.boudnik.org/2012/05/hortonworks-disribution-secretly.html - Some uptake at EBay - Some uptake at TrendMicro Project development since last report: - released Bigtop 0.3.0-incubating - 0.4.0-incubating is on schedule to be release end of June 2012 - started working on supporting Giraph - started working on supporting Hue - started working on supporting Hama - used Bigtop to validate Hadoop 1.0.* RC and Hadoop 2.0.0-alpha RC releases - used Bigtop to validate HBase 0.92 RC - used Bigtop to validate Oozie 3.2 RC - increased the # and scope of integration tests - major re-factoring of package tests Signed off by mentor: phunt, tomwhite Shepherd: Matt Franklin
Bigtop is a project for the development of native packaging and stack tests of the Hadoop ecosystem. Bigtop entered incubation on June 20, 2011. Primary issues blocking graduation: - Need for increased diversity and additional committers. Issues which Incubator PMC and/or ASF Board might need/wish to be aware of: - None Community development since last report: - Invited talk at Softwarelivre http://softwarelivre.org/fisl12 - Our regular Bay Area Bigtop meetup/class is going strong with ~10 members http://www.meetup.com/HandsOnProgrammingEvents/ - Bigtop talk @Bay Are Hadoop User group: http://www.meetup.com/hadoop/events/36789782/ - Gave talks on Bigtop @ApacheCON 2011 - Submitted talk proposals to Hadoop summit (http://hadoopsummit.org/) and HBase conf. Project development since last report: - 0.3.0-incubating is in a process of being released - Significantly improved our deployment code (puppet) with the help of an external contributor (Patrick Ramsey) - Added code for producing virtual machine images with Bigtop Hadoop stack baked in - Added code for producing LiveCD/LiveUSB distros of Hadoop stack - Bigtop branch based on Hadoop 0.23 has stabilized to a point where we can start thinking of making 0.4.0 release based on it - Used Bigtop to validate Zookeeper 3.4.* releases - Used Bigtop to validate Hadoop 1.0.* RC and Hadoop 0.23.*RC release - Additional component project Bigtop-jsvc added. - Additional component project Bigtop-tomcat added. - Increased the # and scope of integration tests Signed off by mentor: phunt, tomwhite
Bigtop is a project for the development of native packaging and stack tests of the Hadoop ecosystem. Bigtop entered incubation on June 20, 2011. Primary issues blocking graduation: * Need for increased diversity and additional committers. Issues which Incubator PMC and/or ASF Board might need/wish to be aware of: * Due to limitations in available platforms on Apache Jenkins infrastructure and need for VM spin-up/spin-down for tests, we are working directly with OSUOSL on build/test setup. Community development since last report: * Community meetup held Nov 8th, with mentors and committers alike * Gave talks on Bigtop @ApacheCON 2011 * Bigtop was on the agenda of the HBase meetup on Nov 29th. * Started a regular Bay Area Bigtop meetup/class: http://www.meetup.com/HandsOnProgrammingEvents/events/43298072/ Project development since last report: * 0.2.0-incubating released * Added deployment code (puppet) to the project * Work on the Bigtop stack based on Hadoop 0.22 has started * Work on the Bigtop stack based on Hadoop 0.23 has started * Used Bigtop to validate Zookeeper 3.3.4 and 3.4.0 releases * Used Bigtop to validate HBase 0.92 RC * Used Bigtop to validate Hadoop 0.22 RC and Hadoop 0.23 release * Additional component project (Mahout) added. * Supported platforms voted on. * Next release of Bigtop has been voted on * Increased the # and scope of integration tests
Bigtop is a project for the development of native packaging and stack tests of the Hadoop ecosystem. Bigtop entered incubation on June 20, 2011. Primary issues blocking graduation: * Need for increased diversity and additional committers. * Incubating release including testing framework. * Incorporation of functional stack testing. Issues which Incubator PMC and/or ASF Board might need/wish to be aware of: * Due to limitations in available platforms on Apache Jenkins infrastructure and need for VM spin-up/spin-down for tests, we are working directly with OSUOSL on build/test setup. Community development since last report: * Community meetup held August 18th, with mentors and committers alike. Project development since last report: * 0.1.0-incubating released. * Website created. * Additional component project (Mahout) added. * Supported platforms voted on. * Initial implementation of package validation tests implemented and live.
Bigtop is a project for the development of native packaging and stack tests of the Hadoop ecosystem. Bigtop entered incubation on June 20, 2011. Primary issues blocking graduation: * Need for increased diversity and additional committers. * Incubating release including testing framework. * Incorporation of functional stack testing. Issues which Incubator PMC and/or ASF Board might need/wish to be aware of: * Due to limitations in available platforms on Apache Jenkins infrastructure and need for VM spin-up/spin-down for tests, we are working directly with OSUOSL on build/test setup. Community development since last report: * Community meetup held August 18th, with mentors and committers alike. Project development since last report: * 0.1.0-incubating released. * Website created. * Additional component project (Mahout) added. * Supported platforms voted on. * Initial implementation of package validation tests implemented and live.
Bigtop is a project for the development of packaging and tests of the Hadoop ecosystem. Bigtop entered incubation on June 20 2011 A list of the three most important issues to address in the move towards graduation: * Create Bigtop web site. Item in progress. See ticket BIGTOP-9 * Make an incubating release. * Grow the community size and diversity. Any issues that the Incubator PMC or ASF Board might wish/need to be aware of: * No issues How has the community developed since the last report: * Discussions have been started about how to organize the development (RTC vs CTR) How has the project developed since the last report. * Discussions have been started about how to organize our first release and what should it include. Licensing and other issues * Work to obtain CCLA from Cloudera including grant for existing Bigtop code from Cloudera GitHub repository is done.
Bigtop is a project for the development of packaging and tests of the Hadoop ecosystem. Bigtop entered incubation on June 20 2011 Community * Mailing lists have been created. * New committer accounts are being created, some pending ICLA. * SVN directory structure has been created, karma granted for initial committers. * JIRA has been initialized for BIGTOP. * Confluence Wiki space has been created. Issues before graduation * Migrate code to Apache SVN from Cloudera. * Create Bigtop web site. * Make an incubating release. * Grow the community size and diversity. Licensing and other issues * Work to obtain CCLA from Cloudera regarding license grant for existing Bigtop code from Cloudera GitHub repository is underway.