This was extracted (@ 2024-11-20 22:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Project Status: Current project status: Ongoing. High. Issues for the board: None. ## Membership Data: Apache NiFi was founded 2015-07-14 (9 years ago) There are currently 67 committers and 37 PMC members in this project. The Committer-to-PMC ratio is roughly 9:5. Community changes, past quarter: - No new PMC members. Last addition was Gabor Gyimesi on 2024-06-26. - No new committers. Last additional was Lehel Boer on 2024-06-16. ## Project Activity: The big push remains focused on making Apache NiFi 2.0.0 happen. We've completed four huge milestone releases to that and it looks likely our next release will be officially NiFi 2.0.0 and for GA usage. Toward making NiFi 2.0.0 official we've broken out into its own release the NiFi API which helps codify our core contract of backwards compatibility and points of extension for the project. We released the Apache NiFi API 2.0.0 on September 23, 2024. To leverage packaging NARs that understand the split of the NiFi API vs the core framework version now we also have the latest NiFi Nar Maven Plugin 2.1.0 as of Sep 26th. MiNiFi CPP continues to see JIRAs and PR activity as well. ## Community Health: JIRA and Mailing list activity remains consistent. The slack community grew by another 160 participants in the general channel alone increasing from 3,284 in our previous report and consistent with quarter over quarter growth for some time. Slack is generally quite busy with threads from people needing general user help or questions, development ideas, and review requests. As noted above we've split out the NiFi API. Part of this was so we can introduce a NiFI Improvement Process for changes to our core API. This process was inspired by the tremendous growth the communities of Kafka and Airflow have produced and these communities have healthy discussions on how to introduce changes to critical sections. We continue to produce frequent releases in the NiFi community and enjoy rather active vote participation. Releases we generate are substantial along all key dimensions of feature, improvements, bug fixes, and emphasis on security. The NiFi 2.0 release line is among the most vulnerability free we've ever had when it comes to dependency management. Mailing lists remain quite active despite the continued increase of activity in Slack.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Project Status: Current project status: Ongoing. High. Issues for the board: None. ## Membership Data: Apache NiFi was founded 2015-07-14 (8 years ago) There are currently 67 committers and 37 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. Community changes, past quarter: - Gabor Gyimesi was added as PMC member on 2024-06-26. - Lehel Boer was added as committer on 2024-06-16. ## Project Activity: We released Apache NiFi 2.0.0 milestone 4 (M4) on July 1st 2024. M4 contains more than 150 JIRAs including moving completely to the new UI and providing more integration options for Kafka, splitting packet capture data, and a new Python source component API. We released the NiFi NAR Maven Plugin 2.0.0 on May 28 2024 supporting the new rules extension API in build manifests. We released the MiNiFi CPP 0.99.0 on May 18 2024 including many improvements and MacOS service integration, SMB, Grafana, Jolt transforms for JSON data, greater efficiency when merging larger datasets with MergeContent. We released NiFi 2.0.0 milestone 3 (M3) on May 16 2024. M3 included more than 400 JIRAs with better integrations to AWS, Azure, OpenSearch and SMB. The new UI is now available and considered feature complete but the old UI remains available. ## Community Health: Community health remains strong and growing. JIRA and Mailing list activity remains consistent. The slack community grew by another 150 participants in the general channel alone increasing from 3,133 to 3,284 since the last report. We continue to produce frequent releases in the NiFi community and enjoy rather active vote participation even when it takes a few release candidates to get it right. We are seeing 30 or more unique contributors monthly with on average several commits per day landing and that is just the core nifi codebase. Code activity for NiFi this calendar year appears higher than any previous year when reviewing Github activity data.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Project Status: Current project status: Ongoing. High. Issues for the board: None. ## Membership Data: Apache NiFi was founded 2015-07-14 (8 years ago) There are currently 66 committers and 36 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. Community changes, past quarter: - No new PMC members. Last addition was Csaba Bejan on 2023-10-25. - Daniel Stieglitz was added as committer on 2024-02-09. - Mark Bathori was added as committer on 2024-02-09 ## Project Activity: We released Apache NiFi 2.0.0 milestone 2 January 29th with more than 200 completed JIRAs with new features. The release has seen quick adoption and found a variety of bugs and improvements. To that end the community is approaching a release of NiFi 2.0.0-M3 with already more than 235 resolved JIRAs. We anticipate a release for that soon as there are major improvements to the stability of the much anticipated first class integration with Python components which has been highly valuable to NiFi's emerging role in data pipelines to feed data to Generative AI applications. We also released Apache NiFi 1.25.0 with more than 100 JIRAs at the end of January and have more than 100 already resolved on the upcoming 1.26.0 line. ## Community Health: Consistent with past reports community health remains strong and growing. Mailing list activity remains consistent and we saw a 30% increase on the dev list in total emails. The slack community continues to grow with general hosting 3,133 users at the time of this report. A highly desirable pattern of engagement is present where it isn't just committers and PMC engaging to answer questions. A new venture backed startup in the US has formed as well which has led to an increase in traffic and discussion regarding Apache NiFi.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Project Status: Current project status: Ongoing. High. Issues for the board: None. ## Membership Data: Apache NiFi was founded 2015-07-14 (8 years ago) There are currently 64 committers and 36 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - Csaba Bejan was added to the PMC on 2023-10-25 - No new committers. Last addition was Timea Barna on 2023-08-02. ## Project Activity: The community conducted its first major (semantic versioning) milestone 1 release of Apache NiFi 2.0.0 M1 in November of 2023. The first new major release since 2016! This release is a total game changer for NiFi. In addition to the more than 900 JIRAs included which comprise of features, bug fixes, and security related changes this release makes major steps forward. The NiFi 2.0 means we are up to date with and based on Java 21 and the latest of many great projects like Apache Maven, Spring, Jetty, and many more. Users can now write legit NiFi components in Python and enjoy a first class integrated experience in NiFi as if they were written in Java. We eliminated many defunct code areas, improved and clarified APIs, eliminated poorly maintained code, and much more. We anticipate having a full blown 2.0 production release soon though we already know of several production users of the 2.0 M1 release now. We also kept the momentum up with the NiFi 1.x line releasing, also in November, Apache NiFi 1.24.0. Again this comes with improvements, security changes, and bug fixes. We have also at long last finally launched a revamped website for nifi.apache.org. ## Community Health: Community health remains strong and growing. Our mailing list activity as measured by the dev list dropped by 17% but overall activity remained busy. The dev list drop likely relates to the Holidays and the activity on Slack. PR activity, reviews, and merges remain highly active with more than 31 authors contributing code in this quarter. We added another 150 or so net Slack users this quarter now sitting at 2980 in the general channel. We continue to ensure discussions that should turn into JIRAs or other documented mailing lists do get sent to those mechanisms. We continue to see plenty of commercial activity around NiFi in the form of vendor material, blogs, social media posts, etc..
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Project Status: Current project status: Ongoing. High. Issues for the board: None. ## Membership Data: Apache NiFi was founded 2015-07-14 (9 years ago) There are currently 64 committers and 35 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - Chris Sampson was added to the PMC on 2023-08-19 - Timea Barna was added as committer on 2023-08-02 ## Project Activity: The community conducted at least four key feature, improvement, security related releases during the reporting period. These include MiNiFi CPP 0.15.0 on September 3rd and NIFi 1.23.2, 1.23.1, and 1.23.0 on Aug 22, 18, and Jul 28. The MiNiFi release adds support to TLS v1.3, PutS3 for multipart object upload, among other capabilities and several bug fixes. The NiFi 1.23.x line makes it easier to work Microsoft Excel documents in the flow and leverage AWS Glue Schema Registry and fixes a large range of defects or reported vulnerable libs across Spring Framework, Bouncy Castle and more. But the big news for the community remains all about the heavy push to Apache NiFi 2.0.0. With more than 740 JIRAs resolved and counting this major release will indeed be major. NiFi 2 now builds and runs and depends on Java 21. We've started adopting many of the nice language features including lightweight threads and cleaner syntax options. We're reducing far more code than ever before that is no longer maintained, no longer necessary, etc. NiFi 2.0 also makes running real processes in legit Python super easy which allows NiFi to help data engineers far more as they often found the Java development processes too slow for their use cases. We don't have a clear ETA for 2.0 but this calendar year is still in sight. ## Community Health: Community health is stronger than ever. Our mailing list activity has picked up in the past quarter with 36%, 26% and 70% increase across dev, users, and issues lists. There are more PRs coming in and getting reviews and merges - specifically a 10% increase in the period. Meanwhile, usage and popularity of the Slack channel is growing. We reported 2700 in our general slack channel last quarter and now we are at 2839. The depth of conversation on there is excellent spanning simple user questions, developer discussions which we do push to JIRA or mailing list as needed. And importantly we still see active blogging, videos, webinars, conference talks on NiFi.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Project Status: Current project status: Ongoing. High. Issues for the board: None. ## Membership Data: Apache NiFi was founded 2015-07-14 (9 years ago) There are currently 63 committers and 34 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. Community changes, past quarter: - Nándor Soma Abonyi was added to the PMC on 2023-06-25 - No new committers. Last addition was Ferenc Kis on 2023-03-23. ## Project Activity: The NiFi community released NiFi 1.22.0 Jun 2023 and NiFi 1.21.0 in Apr 2023. Each release provided new features, stability, and addressed reported vulnerabilities within NiFi and dependencies. Meanwhile the community is rapidly approaching a NiFi 2.0 major release already containing more than 466 changes. The MiNiFiCPP project also released 0.14.0 in April and we've released the latest NiFi Nar Maven Plugin version 1.5.1 in June. ## Community Health: Community health remains strong and we see high activity across the various channels of contribution and engagement including JIRA, Github, Slack, Mailing Lists and so on. Meetups are less common these days but we still see good activity in conferences, blog posts, and more. We also continue to enjoy excellent engagement for discussions, voting threads, and release candidate evaluation. Slack remains a super popular point of engagement and we've grown again this quarter to more than 2700 people in our 'general' slack channel alone. The dev mailing list activity was 20% higher this quarter than last while the user list is less active. Much of the user list activity has moved to slack as we've reported for a while now but still the user list is an effective tool for collaboration with more than 100 emails in this quarter. Via JIRA, commits, and our issues list we still see a lot of activity and even growth in activity this quarter. Importantly our rate of PR activity remains high with more than 350+ PRs in the quarter again but importantly we have more closed than opened showing we're finally turning the corner in this regard. Some of the activity levels and commit levels reflect that we're managing actively both the 1.x and 2.x release lines now so we do anticipate many of these productivity metrics will drop in the coming quarters as we get the 2.0 release out and stable.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (8 years ago) There are currently 63 committers and 33 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. Community changes, past quarter: - No new PMC members. Last addition was Nathan Gough on 2022-09-06. - Ferenc Kis was added as committer on 2023-03-23 - Nándor Soma Abonyi was added as committer on 2023-03-15 ## Project Activity: The NiFi community released NiFi 1.20.0 in Feb 2023 and is in the RC voting process for NiFi 1.21.0 now expected to be available in early April 2023. More than 170 JIRAs have already landed toward our upcoming NiFi 2.0.0 release as discussed in previous board reports. The 1.21 release is largely focused on stability and continuing to prepare to move 1.x users to 2.x with as minimal disruption as possible. As always we remain super focused on dependency maintenance as it relates to security vulnerabilities. ## Community Health: Community health remains a point of strength and emphasis. We have long enjoyed excellent engagement on release verification and voting. We have added a couple new committers in this cycle and there are more in the pipeline and discussions. Mailing list activity is stable if not a little slowed but again is countered by consistent growth of 100 or so users per quarter into Slack where we now see more than 2600 users in the general channel up by more than 100 from last report. Our JIRA and commit activity has increased and some of this is likely as we're working now two major feature lines both 1.x and 2.x.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (7 years ago) There are currently 61 committers and 33 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - No new PMC members. Last addition was Nathan Gough on 2022-09-06. - No new committers. Last addition was Peter Gyori on 2022-09-22. ## Project Activity: The NiFi community released NiFi 1.19.0 in November 2022 and NiFi 1.19.1 in December 2022 as well as NiFi MiNiFi CPP 0.13.0 in December. The community also discussed and voted up release goals for Apache NiFi 2.0. We are now in the process of executing on converting our main line to be the go forward NiFi 2.0 line while branching to continue to support the 1.x line. NiFi 2.0 will provide a necessary technical debt reduction while still heavily focusing on ensuring existing flows and setups are easily migrated. We will also move away from Java 8 to at least Java 11 consistent with what we're seeing with important dependencies. ## Community Health: Health of the community remains strong. We did not add any committers or PMC members this quarter though we did have a brief discussion on it. We simply didn't pursue it over the break. Despite the usual slowdown we see over the December Holidays and New Years times activity remains strong across the mailing lists, slack, JIRA, and Github. We have already nearly 100 JIRAs and commits for what will be NiFi 1.20.0 and we're conducting appropriate security work. Our general slack channel has just under 2500 people in at the time of this writing and remains an active and responsive channel. Growth of 100 to 200 users per quarter seems steady for nearly a year now.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (7 years ago) There are currently 61 committers and 33 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - Nathan Gough was added to the PMC on 2022-09-06. - Csaba Bejan was added as committer on 2022-09-09. - Ferenc Erdei was added as committer on 2022-09-09. - Peter Gyori was added as committer on 2022-09-23. ## Project Activity: The NiFi community released both NiFi 1.17.0 on August 1st and NiFi 1.18.0 on Oct 6th 2022. The 1.18 release included over 180 JIRAs including many new processors to talk with various SaaS endpoints and new parameter providers to leverage things like HashiCorp Vault, external databases, as well as AWS and GCP secret management. The 1.17 release had over 310 JIRAs completed ensuring NiFi can be built on ARM based platforms such as the latest macbooks, processors to connect with Salesforce and Google Drive as well as other stability and security focused improvements. ## Community Health: Community health remains strong. We grew the PMC and committer ranks again with more pipeline of people making progress as well. Mailing lists and slack remain quite busy and conference talks such as the recent 'Current' included talks featuring NiFi. The dev mailing list saw nearly 300 emails again this quarter. The users list showed a decrease in activity in raw number of emails but count of authors present remained strong. JIRA activity grew by 20% since last quarter with more than 300 issues closed with the expected increase in commits and pull requests along with it. Our general slack channel has grown to 2,388 users from 2262 in the previous quarter and 2042 the quarter before that. It also remains quite active with a lot of responsive threads asking for help on various issues, sharing ideas, talking about operations and so on.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (7 years ago) There are currently 62 committers and 36 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - Peter Turcsanyi was added to the PMC on 2022-05-11. - Simon Bence was added as a committer on 2022-05-09. ## Project Activity: The NiFi community has been extremely active this past quarter completing five releases. The releases include the NiFI NAR Maven Plugin 1.3.4 on June 20, NiFi 1.16.3 on June 14, NiFi MiNiFi C++ 0.12.0 on May 31, NiFi 1.16.2 on May 25, and NiFi 1.16.1 on April 29, 2022. These releases include hundreds of JIRAs providing new features, fixing defects, improving performance, addressing vulnerabilities in dependencies and our own. The entire NiFi project now builds and runs on Java 8, 11, and 17 and we're focusing on an upcoming major release which will drop support for Java 8 entirely as we're starting to see key dependencies do the same. We've been active in responding to reports in the security lists and promptly turned around releases where necessary with the latest example being https://nifi.apache.org/security.html#1.16.3. We are already 260+ JIRAs in on our Apache NiFi 1.17 line so we're likely to cut another significant release soon. This one will likely support building NiFi on the latest ARM based systems such as the latest Apple products. ## Community Health: Community health remains strong. This is evidenced by the frequency of meaningful releases and continued growth in the committer and PMC ranks. The mailing lists remain busy though we do see a decline in the users list activity. Instead what we're seeing is continued growth and usage of the Apache NiFi slack. We do encourage all things to occur on the lists and of course via JIRA but we still see a strong preference from the user community toward slack. We've again added more than 200 users this quarter in our general slack channel so we're now at 2262 as of the time of this writing versus 2042 as reported last quarter. We are also closing in on updating the apache nifi website which will improve our alignment with the preferred ASF infra and give us a much needed reboot and technology chain.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (7 years ago) There are currently 61 committers and 35 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - No new PMC members. Last addition was David Handermann on 2021-09-15. - Ádám Markovics was added as committer on 2022-03-23 - Paul Grey was added as committer on 2022-03-16 ## Project Activity: NiFi 1.16.0 was released on April 4th 2022. This release includes more than 400 JIRAs including features, improvements, bug fixes, and security related items. This release provides for the progression of NiFi, MiNiFi Java, Stateless NiFi, the NiFi registry, and the associated toolkits to ease deployment and management thereof. We are already well underway toward a 1.16.1 stability release with more than 37 JIRAs landed to update dependencies, fix bugs/regressions, and respond to the complex security environment such as the recent 'Springshell' finding. Even though we often find we aren't exposing vulnerabilities we find increasingly users want such dependencies removed/updated rapidly these days and we're trying to accomodate where reasonable. ## Community Health: The community health remains quite strong. We've added committers and have reasonable pipeline for PMC. We continue to see strong mailing list activity. The users email list is less active though we see that well offset with continued growth and activity in our Slack channels. Our general channel has 2042 users as of the time of this writing. We have a new contributor that has also started to express interest and make progress on revamping the Apache NiFi website which could definitely use a reboot and move us to preferred Apache infrastructure/processes. We also see strong growth in JIRAs and PRs both opened and closed this quarter landing more than 330 commits!
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (6 years ago) There are currently 59 committers and 35 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - No new PMC members. Last addition was David Handermann on 2021-09-15. - Martin Zink was added as committer on 2021-11-09 - Margot Tien was added as committer on 2021-12-14 ## Project Activity: NiFi 1.15.0 was released Nov 8 2021. This release included more than 245 JIRAs including many features across Apache NiFi, MiNiFi Java, Stateless NiFi, the NiFi Registry. We have since released bug fix and security focused releases of NiFI 1.15.1 and 1.15.2 largely focused on dealing with the fallout from log4shell. The NiFi community was able to react quickly here and had minimal exposure. But we are also highly impressed with the actions of the Log4j community and they should be commended for how quickly they acted initially and thereafter. We are likely to produce an Apache NiFi 1.15.3 release soon with additional bug focused work and are nearing a 1.16.0 release with again many new features. We have also produced an Apache NiFi MiNiFi CPP release of version 0.11.0. The agents are now in use in many organizations and the project continues to evolve well. ## Community Health: Health remains strong. Across mailing lists, Slack, various social media and developer oriented sites we see continued strong activity. We saw the common season decline in activity throughout the Holidays but progress remains. We've continued to be highly active in releases and growing committership and expect this to continue in the coming quarters. The users mailing list activity did decline substantially in the quarter but we have more than 2,000 people in our general Slack channel and it is quite active.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (6 years ago) There are currently 53 committers and 33 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - David Handermann was added to the PMC on 2021-09-15 - Joe Gresock was added as committer on 2021-09-17 - Gábor Gyimesi was added as committer on 2021-07-22 ## Project Activity: The last releases for NiFi were in July and this includes NiFi, the NiFi Registry, MiNiFi Java, and MiNiFi CPP. Since then the community is working aggressively on another significant release in NiFi 1.15 which is nearing release candidate stage. It already includes more than 180 issues including dozens of new features and improvements as well as many bug fixes. The updates also keep key dependencies updated due to evolving vulnerabilities for popular capabilities like Jetty and others. ## Community Health: The community remains strong. Mailing list activity for both the dev and users lists has increased (54%, 37%) this quarter in terms of total number of emails written but also interestingly in terms of the number of authors engaged. JIRA activity this quarter has increased by 17%. Github activity looks roughly unchanged and it is still too early to tell if our auto closing of PRs is having the desired effect though community health certainly remains strong and contributions continue to roll in. Our Slack activity levels remains very high and we have nearly 1900 people in the general channel. There does appear to be a 20% reduction in the number of unique contributors with commits in the quarter but that aligns to a roughly 35% drop in total commits. This is likely to rapidly turn around as we approach the release candidate for NiFi 1.15.0.
## Description: The mission of NiFi is the creation and maintenance of software related to Easy to use, powerful, and reliable system to process and distribute data ## Issues: There are no issues requiring board attention at this time. Apologies for missing the July reporting date. ## Membership Data: Apache NiFi was founded 2015-07-14 (6 years ago) There are currently 56 committers and 34 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - Marton Szasz was added to the PMC on 2021-06-21 - Chris Sampson was added as committer on 2021-05-13 - Denes Arvay was added as committer on 2021-06-22 - Gábor Gyimesi was added as committer on 2021-07-22 ## Project Activity: NiFi 1.14.0 was release July 16 2021. This release now includes the Registry, Stateless NiFi, MiNiFi Java, and all the related toolkits. This will ensure we keep these highly related sub-projects well aligned and maintained. This release includes hundreds of JIRAs and importantly means NiFi is now started by default out of the box with best practices security configuration. Users no longer get unauthenticated HTTP access by default and we instead are given a randomly generated username and password and HTTPS with a self-signed cert. NiFi MiNiFi CPP 0.10.0 was released Jun 11 2021. It brings new components for sending data to S3 and Azure Blog Storage as well as the ability to capture perfmon data and journald. Additionally users can get resource consumption data in heartbeats as well as developers can build with Visual Studio 2019 on Windows. ## Community Health: Activity in mailing lists, PRs, JIRA, and votes all remain strong. Our Apache NiFi slack #general channel continues to grow and is up to 1,792 members and we continue to see new people not only asking questions but contributing (good) answers which of course we love. There appears to be roughly a 15-20% decrease in number of mailing list traffic and JIRAs but during this time we had stabilized the 1.14 release which would account for both the previous quarter climb and current quarter dip as we wound down that release. We implemented an auto closure for stale PRs which has greatly reduced the number of open PRs of course. But also it seems to be helping contributors stay engaged. Time will tell if it leads to improved collaboration or just leads to frustration. We'll continue to closely monitor this.
No report was submitted.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (6 years ago) There are currently 53 committers and 33 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - Joey Frazee was added to the PMC on 2021-03-24 - Adam Debreceni was added as committer on 2021-01-20 - David Handermann was added as committer on 2021-01-20 - Ferenc Gerlits was added as committer on 2021-03-26 - Otto Fowler was added as committer on 2021-03-22 - Tamas Palfy was added as committer on 2021-01-20 ## Project Activity: NiFi 1.13.2 was released on 2021-03-20 NiFi 1.13.1 was released on 2021-03-15 NiFi MiNiFi CPP 0.9.0 was released on 2021-02-26 NiFi 1.13.0 was released on 2021-02-16 The releases of the Apache NiFi 1.13.x line and MiNiFi CPP 0.9.x line again represent hundreds of JIRAs and months of contributions within the community. They bring important features, improvements, bug fixes, and security fixes. Substantial improvements have been made that reduce the NiFi convenience binary by several hundred MB which is a great start in our journey to a more appropriate size. We will eventually have the core NiFi application/kernel then users can source extensions at runtime on demand from artifact repositories. ## Community Health: We have seen a huge increase in developer list email count increasing by more than 100% to 415 emails in the quarter. Our users list increased activity in terms of email count by nearly 20%. We saw a decrease in JIRA issues opened/closed by about 15% to total of 135 issues closed this past quarter in the NIFI JIRA alone. We saw in increase in the number of unique contributors by nearly 20% to a total 64 contributors of source in this reporting period. The total number of commits in that period increased 73%. The number of PRs opened and closed during the quarter increased 50% to around 320+. In recognition of the various discussions we've had on this topic in the community this past year and the continued challenge we've had staying on top off PR reviews and pruning those that won't be merged we finally implemented a stale marker and auto-close Github action to keep these manageable. We used other Apache projects as a guide. We'll keep an eye on the impact this has both positive and negative over the next few quarters.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (5 years ago) There are currently 48 committers and 32 PMC members in this project. The Committer-to-PMC ratio is 3:2. Community changes, past quarter: - No new PMC members. Last addition was Arpad Boda on 2020-05-24. - Marton Szasz was added as a committer on 2020-07-13 The PMC is discussion committer and PMC candidates right now. Three candidates are likely to be voted upon within the coming days and the pipeline remains strong. ## Project Activity: The last release of Apache NiFi was 1.12.1 on Sep 29, 2020. We're now in the release candidate creation phase of Apache NiFI 1.13.0 which is a full feature bearing release including over 200 JIRAs. With respect to Apache NiFi MiNiFi Java the work is still progressing for https://issues.apache.org/jira/browse/MINIFI-422 which will merge MiNiFi Java back into NiFi as a headless form of NiFi supporting both broad use case patterns well and reduce the release/codebase burden. Apache NiFi MiNiFi CPP 0.8.0 is still in progress with over 180 JIRAs with the 0.9.0 release already begun as well including nearly 20 JIRAs and an initial framing of a 1.0 (major) release in progress as well. ## Community Health: We observed a decline in mailing list activity as well as JIRAs and commits this quarter but this is largely due to what appeared to be a solid couple of weeks of limited engagement likely due to the holidays. However, there are many vibrant and engaging threads related to release activities or feature work and contribution reviews so health remains quite strong. The Apache NiFi slack channel activity continues its impressive growth in viewership and engagement growing another 200 users in the past quarter which seems to be consistent. It does seem like a lot of mailing list activities have moved there but we still encourage people to take anything lasting or for which they dont get prompt responses back to the mailing list. Activity on twitter, stackoverflow, youtube, blogs remains interesting and much of it happens by people not engaged in the Apache NiFi community at all. Stale PRs remains an area of concern as we've noted in previous reports though we are still not specifically addressing that problem. We've done some research into how other communities handle it (or dont) but do not yet have a specific plan.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. With the last board report JM continued the questions around communication channels and noted we should beware the auto closing stale PRs can be bad for community growth and that we should consider consolidating channels. Regarding auto close of PRs, we agree there is downside and this is why we've been slow to make changes here despite the clear challenges of action and inaction. We will eventually move beyond admiring this problem to some clear path with pros and cons. Regarding consolidation of the communication channels - we try to be where the community is. We use that presence to direct communications to the mailing list. Limiting spread to twitter, stackoverflow, etc.. is its own challenge as various community members have their own communication style and preferred channel. What we can influence is the convergence to channels we can as a community maturely support. It is going well overall but the popularity of the on-demand communication style of Slack is certainly significant. ## Membership Data: Apache NiFi was founded 2015-07-14 (5 years ago) There are currently 48 committers and 32 PMC members in this project. The Committer-to-PMC ratio is 3:2. Community changes, past quarter: - No new PMC members. Last addition was Arpad Boda on 2020-05-24. - Marton Szasz was added as a committer on 2020-07-13 ## Project Activity: Apache NiFi 1.12.0 released on Aug 20 2020 with a stability release of Apache NiFi 1.12.1 following behind on Sep 29 2020. These releases include significant features, bug fixes, improvements, and resolved CVEs. Apache NiFi Maven Plugin Released on Sep 21 2020. This plugin helps Maven users building NiFi extensions take advantage of our classloader isolation model. Apache NiFi Registry 0.7.0 released on Jul 20 2020. Consistent with the last report there have not been any Apache NiFi MiNiFi Java releases in some time. What is happening now is https://issues.apache.org/jira/browse/MINIFI-422 which will merge MiNiFi Java back into NiFi as a headless form of NiFi supporting both broad use case patterns well and reduce the release/codebase burden. Important work is on going and almost made it into the NiFi 1.12 release but had to be reverted as it created regressions. Apache NiFi MiNiFi CPP 0.8.0 is in progress with over 92 issues resolved. ## Community Health: Mailing list activity returned to growth across each of our lists notably including dev with 15% growth and users with 8% growth this quarter. This is in terms of number of emails of course. We see strong growth in commit activity at 23% with 314 commits over that time speaking of just Apache NiFi itself. Along with that though we saw a decrease in Github PRs opened and closed on the order of a 10% decline. The Apache NiFi slack channel activity continues to grow with now over 1250 users dwelling in the general channel alone growing from 1071 in the previous quarter. Activity on twitter, stackoverflow, youtube, blogs remains interesting as it has for many quarters now. Our number of stale PRs has again grown and this remains an important topic for us to determine a path forward. We find community members are much more motivated in contributing PRs than they are in reviewing them. Though building a strong and broad reviewer base is important and indeed this is where people really learn the framework. We have not yet focused on resolving this problem as current options we see happening in other communities like auto-stale PR closure also have downsides as noted in the board feedback above.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. With the last board report JM asked if there was anything we can do to ensure we don't have many threads go unanswered on our dev list. In reviewing threads that appear to have zero replies and thinking of what we've seen over time the following patterns are observed: 1. Users asking for help on dev list. We try to be specific for mailing list purpose. We redirect to users usually. 2. Many of these types of dead-end threads end up getting asked on numerous channels at once including stackoverflow, twitter, slack, both mailing lists. 3. Many conversations occur over multiple channels including mailing list, slack, JIRA and there is generally very little traceability across them. For a specific example of this pattern here is someone wanting to contribute. They filed a PR and want engagement on it. https://lists.apache.org/thread.html/rc7b1d28ab43567f21818dd1258650e4d236094dc9166598b950bcc27%40%3Cdev.nifi.apache.org%3E Indeed though the mailing list thread looks unreplied but in reality there has been vibrant discussion on the PR as seen here https://github.com/apache/nifi/pull/3543 A few threads might genuinely slip through the cracks but they're the exception. No specific action appears needed at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (5 years ago) There are currently 47 committers and 32 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - Arpad Boda was added to the PMC on 2020-05-24 - Andrew M. Lim was added to the PMC on 2020-05-24 - No new committers. Last addition was Peter Turcsanyi on 2019-10-25. Discussion is underway for voting in a new committer at the time of writing this board report. ## Project Activity: Apache NiFi Registry 0.6.0 we released in April containing security and bug fixes and minor features. Since the release of Apache NiFi 1.11.4 in late March the community has continued aggressively working toward Apache NiFi 1.12.0. There are already 240 fixes, improvements and features in this release and again it is shaping up as another high impact release. There have been considerable improvements to the many Public Cloud provider integrations. There have not been any Apache NiFi MiNiFi Java releases in some time. What is happening now is https://issues.apache.org/jira/browse/MINIFI-422 which will merge MiNiFi Java back into NiFi as a headless form of NiFi supporting both broad use case patterns well and reduce the release/codebase burden. Apache NiFi MiNiFi CPP 0.8.0 is in progress with over 76 issues resolved. ## Community Health: Mailing list activity overall seems to have leveled off. In the previous reporting period for the mailing lists we saw an increase and in the one prior a decrease. In this period we see a significant decrease in dev threads with a slight increase in users list. However, and as we noted previously the activity and growth seems to have moved heavily to the Apache NiFi slack channels. In the past many quarters we've reported 394, 523, 707, 895, and now 1071 persistent users in our general slack channel. So while the mailing list activity looks leveled or possibly declined we're seeing dramatically higher engagement on slack. The nice thing we're seeing there is more people engaging who do not have committer status that normally might not say much on email but now willing to engage in slack. Just a more comfortable communication mechanism for some it appears. Activity on twitter, stackoverflow, youtube, blogs remains impressive. Community activity level as measured in overall commits has regressed a bit this quarter versus last but that is pretty clearly related to release pushes. We see roughly the same number of unique authors. As we push to NiFi 1.12.0 I'd expect a rise again. Keeping up with the review/merge of pull requests remains a challenge. We're reviewing and merging at an overall impressive rate but it remains difficult to close the gap. We're likely to setup an auto-close based on age mechanism. The fundamental challenge is it is easier for new contributors to put up a PR that fixes some issue they have than it appears to be for those same types of folks to engage in reviewing and testing others PRs. Indeed that part while critical for the community is less exciting/interesting. The delta in opened versus closed this quarter was just 25 commits but add that up quarter over quarter and we end up with quite a backlog. We've done well with both PMC and committer pipeline and as noted above we anticipate a new committer being named very soon.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (4 years ago) There are currently 47 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Peter Wicks on 2019-05-29. - No new committers. Last addition was Peter Turcsanyi on 2019-10-25. We have strong committer and PMC pipeline to consider so we expect to see activity here pending discussions by the PMC. ## Project Activity: Apache NiFi Registry 0.6.0 is currently under Release Candidate vote. It is mostly stability and security related changes. Apache NiFi 1.11.0 through 1.11.4 have all been released in January, February, and March respectively. The 1.11 release line brought in some awesome features like better integration with Azure, all NiFi repositories can now be encrypted at an application level, class loader isolation now works across nars with native libraries, and more. We've also addressed a massive number of bugs, improvements, and security related fixes. Apache NiFi MiNiFi CPP 0.7.0 was released in January with 145 issues addressed. It includes a number of new features like SFTP support, running as a windows service, tail support for globs/wildcards, windows event log consumption, and a long list of stability improvements. ## Community Health: In our previous reporting period we noted a decline of roughly 15% mailing list activity in dev and users and attributed that to the time of year and the rise of engagements in slack. Slack engagement continues to rise but this period we see an increase of 58% on our dev list and 16% on users and also a large increase in issues activity of 61%. The community is very busy including more than a 100% increase in commits and 17% increase in the number of contributors of committed code in the quarter. Anecdotally a significant increase in new user activity is observed as well. Many mailing list questions are starting from very limited knowledge and folks are looking for a lot of assistance with patterns and getting started in terms of pure usage. We see also constant activity for Apache NiFi on Twitter, Stackoverflow, Youtube, etc. These are for tutorials, example use cases, job/ads, questions and answer created by people active in the community and not. For the past few quarters we've reported 394, 523, 707, and now 895 persistent users in our slack channels. While it appeared this might harm or reduce mailing list activity that doesn't seem to be the case. We've just opened up more ways for folks to collaborate in the community. The slack channels are extremely busy and the depth of questions range from very superficial questions easily answered to deeper and more complex situations that lead to JIRAs and mailing list discussions. Mostly though it just appears to be a communication mode some users and developers like far more than the lists. Our community activity level has certainly increased while at the same time we have not increased committer or PMC ranks. This is really a reflection of the fact that the PMC has been very focused on knocking out releases and engaging on the various mailing list and slack channels. We need to remind ourselves to groom and manage the committer/PMC pipeline and there are least a couple candidates well positioned for committer and/or PMC status based on past discussions. Overall the state of the community appears very strong.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (4 years ago) There are currently 47 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Peter Wicks on 2019-05-29. - Dániel Bakai was added as committer on 2019-10-19 - Kotaro Terada was added as committer on 2019-10-19 - Peter Turcsanyi was added as committer on 2019-10-25 ## Project Activity: We are nearing release of Apache NiFi Registry 1.0.0. The release includes support for common HTTP security headers, running on Java 11, updated to Ranger 2.0, and more. Released Apache NiFi 1.10.0. This brings powerful features such as sourcing extensions from the latest NiFi Registry at runtime, far better model for parameterized version controlled flows, Java 11 compatibility, back pressure prediction and more. In the release candidate phase of Apache NiFi 1.11.0 which provides a range of bug fixes, improvements and a handful of new features. This release will solve class-loader isolation to include native libraries as well. The release for MiNiFi CPP 0.7.0 is still being worked. There are nearly 140 closed JIRAs including many bug fixes and new features such as ensuring all inbound sockets are TLSv1.2 or newer, cron driven scheduling, support Kerberized connections to Kafka, support for packages with Python scripts, and ability to capture individual frames from an RTSP camera stream. ## Community Health: We have seen about a 15% decline in users and dev mailing list activity this quarter. This is likely due to the growing use of Slack for more direct/responsive interaction as well as seasonal considerations. We also saw a roughly 40% decrease in JIRA related activity. This is certainly related to the completion of the very significant Apache NiFi 1.10.0 release as well as seasonal aspects. We've brought in several new committers in this timeline and hopefully the current committer base leads to additional PMC members soon. The community remains active on numerous release lines as well. Community health continues to be a strong point with a healthy committer and PMC pipeline as well as high activity from current PMC members. We see numerous release lines across the mentioned parts of the Apache NiFi project all with very active development across features, bug fixes, and improvements. Our mailing list continues to be highly active and our slack room is also super active. For the past few quarters we've reported 394, 523, and now 707 persistent users in our slack channels. Interestingly we see more non committer based collaboration here than we have on the mailing lists. People seem to prefer the collaboration style of Slack quite a lot as well as more subject dedicated rooms to talk in. It isn't clear that this is leading to more committers and PMC members but does help the community in general.
## Description: The mission of NiFi is the creation and maintenance of software related to providing an easy to use, powerful, and reliable system to process and distribute data. Apache NiFi MiNiFi is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. Apache NiFi Registry is a centralized registry for key configuration items including flow versions, assets, and extensions for Apache NiFi and Apache MiNiFi. Apache NiFi Nar Maven Plugin is a release artifact used for supporting the NiFi classloader isolation model. Apache NiFi Flow Design System is a theme-able set of high quality UI components and utilities for use across the various Apache NiFi web applications in order to provide a more consistent user experience. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache NiFi was founded 2015-07-14 (4 years ago) There are currently 44 committers and 30 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Peter Wicks on 2019-05-29. - Rob Fellows was added as committer on 2019-09-24 ## Project Activity: Released Apache NiFi Registry 0.5.0 providing better proxy permissions, support for Apache Knox, and the ability to make buckets accessible by anonymous users. Apache NiFi 1.10.0 will have a release candidate likely by the time of this October board report. It includes more than 330+ JIRAs. This brings powerful features such as sourcing extensions from the latest NiFi Registry at runtime, far better model for paramaterized version controlled flows, Java 11 compatibility, back pressure prediction and more. The release for MiNiFi CPP 0.7.0 is closing in. There are nearly 100 closed JIRAs including many bug fixes and new features such as ensuring all inbound sockets are TLSv1.2 or newer, cron driven scheduling, support Kerberized connections to Kafka, support for packages with Python scripts, and ability to capture individual frames from an RTSP camera stream. ## Community Health: Community health continues to be a strong point with a healthy committer and PMC pipeline as well as high activity from current PMC members. We see numerous release lines across the mentioned parts of the Apache NiFi project all with very active development across features, bug fixes, and improvements. Our mailing list continues to be highly active and our slack room is also super active. As reported in the previous quarter we had 394 users in our slack room but now there are 523 and growing. This is a great sign of the interest in the community and the engagement level we see across PMC, committer, and pipeline for future committers. We continue to see highly active use and commentary related to Apache NiFi in social media, meetups, blogs, and conferences in various parts of the world. A NiFi PMC member presented on NiFi at the recent ApacheCon in Vegas. A recent tweet reads "Work with ApacheNiFi is very fast and productive. Counting now +290 processors to build both batch and streaming ETL data pipelines for any type of data source and destination you want." Another reads "ApacheNiFi thanks for the usual level of nonsensical obfuscated badly described prose on your homepage trying to describe your framework/product. As usual obfuscation is your the forte of the Apache Foundation..." Fortunately patches are welcome. This quarter we're seeing higher engagement across mailing lists, JIRA activity both opened and closed, commits, PRs opened and closed. This is likely due to the range of release activities for the NiFi Registry as well as the impending release of Apache NiFi 1.10.0 which is a huge feature, bug fix, and improvement release representing one of the longer gaps we've ever had since the previous feature bearing release.
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are both
Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi and Apache
MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting the
NiFi classloader isolation model.
- Apache NiFi Flow Design System is a theme-able set of high quality UI
components and utilities for use across the various Apache NiFi web
applications in order to provide a more consistent user experience.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Released Apache NiFi Registry 0.4.0 which allows storage of extensions
which is a critical step towards us breaking apart the monolithic release
of today resulting in smaller binaries in Apache infra a mirrors and will
also bring a better user experience for updating live running NiFi clusters
and operations in container based environments.
- The community is working the release preparation and voting process for
Apache NiFi MiNiFi CPP 0.6.1.
- Apache NiFi 1.10.0 is progressing nicely with nearly 200 JIRAs already
included. This brings powerful features such as sourcing extensions from
the latest NiFi Registry at runtime, far better model for paramaterized
version controlled flows, Java 11 compatibility, and much more.
## Health report:
- Health of the community remains strong with many active release lines,
feature development, active user and developer base including new
participants and continued participants.
- We see considerable commentary on Apache NiFi in the form of meetups,
conferences, training, and talks including from folks at Google, Cloudera
and others. A recent tweet from a Ford Motor Company employee says it best
"Love, love, love @apachenifi Using MiNiFi opens up IOT innovation in
amazing ways. Every IOT device manufacturer, including automotive, should
consider opening up API's to let developers do their thing! Bringing value
to your product! "
## PMC changes:
- Currently 30 PMC members.
- Peter Wicks was added to the PMC on Wed May 29 2019
## Committer base changes:
- Currently 43 committers.
- Arpad Boda was added as a committer on Thu May 23 2019
## Releases:
- Apache NiFi Registry 0.4.0 was released on Mon May 20 2019
## Mailing list activity:
- Activity on the mailing lists remains high with a mixture of new users,
contributors, and deeper more experienced users and contributors sparking
discussion and questions and filing bugs or new features.
- We do see a significant drop in users list usage while dev and issues
remains busy and even growing. Meanwhile we see strong growth in our slack
channel and it is very user centric.
- Slack Channel Usage: apachenifi.slack.com
- 394 users currently in the room. This has grown weekly.
- users@nifi.apache.org:
- 693 subscribers (up 18 in the last 3 months):
- 447 emails sent to list (800 in previous quarter)
- dev@nifi.apache.org:
- 443 subscribers (down -1 in the last 3 months):
- 357 emails sent to list (417 in previous quarter)
- issues@nifi.apache.org:
- 56 subscribers (up 0 in the last 3 months):
- 5371 emails sent to list (4140 in previous quarter)
## JIRA activity:
- 274 JIRA tickets created in the last 3 months
- 188 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are both
Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi and Apache
MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting the
NiFi classloader isolation model.
- Apache NiFi Flow Design System is a theme-able set of high quality UI
components and utilities for use across the various Apache NiFi web
applications in order to provide a more consistent user experience.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Released Apache NiFi 1.9.0 containing numerous new features, bug fixes, and
improvements. This includes support for several standard security headers
such as HSTS, X-XSS-Protection, and Content-Security-Policy.
- The community continues to make progress in externalizing all NiFi
extension components which would help us reduce the size of our convenience
binaries which reduces impact on infrastructure and mirrors.
## Health report:
- Health of the community remains strong with many releases and robust
discussion threads on new feature ideas like nifi-stateless and how to best
migrate to Java 11.
- The PMC has not discussed committer and PMC pipeline in some time and needs
to put renewed attention on it.
- As evidenced by the timeline between Apache NiFi 1.9.0 and 1.9.1 and 1.9.2
we have had important defects requiring prompt resolution but also strong
community effort to do so.
## PMC changes:
- Currently 29 PMC members.
- No new PMC members in the last three months.
- Last PMC additional was Jeremy Dyer on Mon Jul 30 2018.
## Committer base changes:
- Currently 42 committers.
- No new committers added in the last 3 months
- Last committer addition was Ed Berezitsky at Wed Jan 02 2019
## Releases:
- Apache NiFi 1.9.2 was released on Sun Apr 07 2019
- Apache NiFi MiNiFi C++ 0.6.0 was released on Fri Mar 22 2019
- Apache NiFi 1.9.1 was released on Sat Mar 16 2019
- Apache NiFi 1.9.0 was released on Mon Feb 18 2019
## Mailing list activity:
- Activity on the mailing lists remains high with a mixture of new users,
contributors, and deeper more experienced users and contributors sparking
discussion and questions and filing bugs or new features.
- In addition to the mailing lists the Apache NiFi Slack channel is very
active and seems to be a good source of contributor discussion and
knowledge sharing.
- users@nifi.apache.org:
- 673 subscribers (up 20 in the last 3 months):
- 822 emails sent to list (684 in previous quarter)
- dev@nifi.apache.org:
- 443 subscribers (up 11 in the last 3 months):
- 454 emails sent to list (399 in previous quarter)
- issues@nifi.apache.org:
- 56 subscribers (up 4 in the last 3 months):
- 4403 emails sent to list (5251 in previous quarter)
## JIRA activity:
- 291 JIRA tickets created in the last 3 months
- 183 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are both
Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi and Apache
MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting the
NiFi classloader isolation model.
- Apache NiFi Flow Design System is a theme-able set of high quality UI
components and utilities for use across the various Apache NiFi web
applications in order to provide a more consistent user experience.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Released Apache NiFi 1.8.0 containing numerous new features, bug fixes, and
improvements. This included powerful features like load-balanced cluster
aware connections and node decommissioning.
- Discussions and work are underway to release the Apache NiFi Registry and
necessary improvements to NiFi to support storing extensions in the
registry and accessing them at run-time as needed via NiFi. This will
reduce the size of our distribution greatly reducing burden on Apache
infrastructure and improving the overall user experience.
- Discussions and code review underway for a powerful and amazingly simple
concept of NiFi flows executed as functions. The model honors the NiFi API
but offers wide variation in execution environments and will be useful for
optimizing performance of certain common use cases.
## Health report:
- Health of the community remains strong. Mailing list and JIRA activity has
remains very active and we find the Apache NiFi slack channel increasing
valuable as a tool to engage with the community and as a source of redirect
to the mailing lists.
- We have voted in two new committers in this period and there appears to be
additional pipeline strength brewing as well for committer and PMC merit.
## PMC changes:
- Currently 29 PMC members.
- No new PMC members in the last three months.
- Last PMC additional was Jeremy Dyer on Mon Jul 30 2018.
## Committer base changes:
- Currently 42 committers.
- New committers:
- Ed Berezitsky was added as a committer on Wed Jan 02 2019.
- Nathan Gough was added as a committer on Wed Jan 02 2019.
## Releases:
- Apache NiFi 1.8.0 was released on Sat Oct 27 2018
## Mailing list activity:
- Activity on the mailing lists remains high with a mixture of new users,
contributors, and deeper more experienced users and contributors sparking
discussion and questions and filing bugs or new features.
- users@nifi.apache.org:
- 652 subscribers (up 6 in the last 3 months):
- 737 emails sent to list (702 in previous quarter)
- dev@nifi.apache.org:
- 432 subscribers (up 3 in the last 3 months):
- 436 emails sent to list (430 in previous quarter)
- issues@nifi.apache.org:
- 52 subscribers (down 2 in the last 3 months):
- 5439 emails sent to list (6245 in previous quarter)
## JIRA activity:
- 300 JIRA tickets created in the last 3 months
- 200 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are both
Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi and Apache
MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting the
NiFi classloader isolation model.
- Apache NiFi Flow Design System is a theme-able set of high quality UI
components and utilities for use across the various Apache NiFi web
applications in order to provide a more consistent user experience.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Conducted an important bug/security fix release in Apache NiFi 1.7.1 and
another feature/improvement release of the NiFi Registry 0.3.0
- The community is closing in on the release of Apache NiFi 1.8.0 which
brings highly valuable new features including the ability to load balance
data on connections across the cluster automatically and to offload data
from a node to support decommission of that node.
- There continues to be significant meetup, conference talks, on-line
articles, blogs, and podcast coverage of Apache NiFi in the past few
months.
## Health report:
- Health of the community remains strong. Mailing list and JIRA activity has
softened compared to the previous reporting period but remains very active.
ASF hipchat conversations are used to direct traffic to the mailing lists.
- We have not conducted a PMC discussion on committer/PMC pipeline in this
reporting period and we need to do so soon.
## PMC changes:
- Currently 29 PMC members.
- Jeremy Dyer was added to the PMC on Mon Jul 30 2018.
- Kevin Doran was added to the PMC on Mon Jul 30 2018.
## Committer base changes:
- Currently 40 committers.
- No new committers added in the last 3 months
- Last committer added was Sivaprasanna Sethuraman at Mon Jun 04 2018
## Releases:
- Apache NiFi 1.7.1 was released on Sun Jul 15 2018
- Apache NiFi Registry 0.3.0 was released Mon Sep 24 2018
## Mailing list activity:
- Activity on the mailing lists remains high with a mixture of new users,
contributors, and deeper more experienced users and contributors sparking
discussion and questions and filing bugs or new features.
- users@nifi.apache.org:
- 647 subscribers (up 4 in the last 3 months):
- 720 emails sent to list (664 in previous quarter)
- dev@nifi.apache.org:
- 427 subscribers (up 3 in the last 3 months):
- 451 emails sent to list (873 in previous quarter)
- issues@nifi.apache.org:
- 53 subscribers (up 4 in the last 3 months):
- 6536 emails sent to list (8310 in previous quarter)
## JIRA activity:
- 299 JIRA tickets created in the last 3 months
- 199 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are both
Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi and Apache
MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting the
NiFi classloader isolation model.
- Apache NiFi Flow Design System is a theme-able set of high quality UI
components and utilities for use across the various Apache NiFi web
applications in order to provide a more consistent user experience.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Conducted first release of Apache NiFi Flow Design System which will serve
as a reusable basis for front-end code/components in NiFi and Registry
giving a consistent look and feel.
- Conducted another significant release of Apache NiFi now 1.7.0. Users can
now kill hung processors without restarting NiFi, cluster operations are
significantly improved and all user initiated operations are asynchronous,
and new processors exist for operating with XML, Apache Hive 3.0, forking
records, and we can run on Java 9 with follow-on work to support running on
Java 10 or newer as well as doing full application builds on those target
JVMs.
- There has been significant meetup, conference talks, on-line articles,
blogs, and podcast coverage of Apache NiFi in the past few months.
## Health report:
- Health of the community remains strong. Mailing list and JIRA activity is
consistent. ASF Hipchat is serving as an on-ramp for new users to our
mailing list and JIRA systems.
- Added a new PMC member and a new committer and continue to see new and
continuing engagement signaling sustained community growth.
## PMC changes:
- Currently 27 PMC members.
- Mike Thomsen was added to the PMC on Tue Jun 05 2018.
## Committer base changes:
- Currently 40 committers.
- New commmitters:
- Sivaprasanna Sethuraman was added as a committer on Mon Jun 04 2018
- Last committer added Wed Mar 21 2018.
## Releases:
- Apache NiFi MiNiFi 0.5.0 was released on Jul 01 2018.
- Apache NiFi 1.7.0 was released Jun 25 2018.
- Apache NiFi Registry 0.2.0 was released Jun 19 2018.
- Apache NiFi Flow Design System 0.1.0 was released Jun 14 2018.
- Apache NiFi MiNiFi CPP 0.5.0 was released on Jun 04 2018.
## Mailing list activity:
- Activity on the mailing lists remains high with a mixture of new users,
contributors, and deeper more experienced users and contributors sparking
discussion and questions and filing bugs or new features.
- users@nifi.apache.org:
- 643 subscribers (up 22 in the last 3 months):
- 697 emails sent to list (662 in previous quarter)
- dev@nifi.apache.org:
- 424 subscribers (up 14 in the last 3 months):
- 896 emails sent to list (813 in previous quarter)
- issues@nifi.apache.org:
- 50 subscribers (up 2 in the last 3 months):
- 8747 emails sent to list (7790 in previous quarter)
## JIRA activity:
- 373 JIRA tickets created in the last 3 months
- 297 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are both
Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi and Apache
MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting the
NiFi classloader isolation model.
- Apache NiFi Fluid Design System is a theme-able set of high quality UI
components and utilities for use across the various Apache NiFi web
applications in order to provide a more consistent user experience.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Conducted another important feature bearing release of Apache NiFi 1.6.0.
It includes things like application level resource isolation for things
like Kerberos credentials and more, better integration to Apache HBase,
InfluxDB, Druid, MongoDB and a ton of bug fixes and improvements.
- The community voted to spawn a subproject called the Apache NiFi Fluid
Design System as called out above. Infra has created the Git repo and code
has started to land there. Once this is fully up and running we'll be able
to build these NiFi web components once and reuse them in NiFi, the NiFi
Registry and any other web applications that are part of the Apache NiFi
community.
- Several members of the community are hosting a meetup for the Maryland, DC,
Virginia area. It will have talks from large financial institution
engineering leads using NiFi and NiFi community members.
## Health report:
- Health of the community remains strong. Mailing list and JIRA activity is
consistent. ASF Hipchat is serving as an on-ramp for new users to our
mailing list and JIRA systems.
- Added a new committer and have noted an uptick in community engagement from
a developer/contributions/review engagement perspective which is really
cool.
## PMC changes:
- Currently 26 PMC members.
- No new PMC members added in the last 3 months.
- Last PMC member added Wed Dec 13 2017.
## Committer base changes:
- Currently 39 committers.
- New commmitters:
- Mike Thomsen was added as a committer on Wed Mar 21 2018
- Last committer added Wed Mar 21 2018.
## Releases:
- Apache NiFi 1.6.0 was released Apr 8 2018.
## Mailing list activity:
- Activity on the mailing lists remains high with a mixture of new users,
contributors, and deeper more experienced users and contributors sparking
discussion and questions and filing bugs or new features.
- users@nifi.apache.org:
- 614 subscribers (up 30 in the last 3 months):
- 742 emails sent to list (753 in previous quarter)
- dev@nifi.apache.org:
- 405 subscribers (up 11 in the last 3 months):
- 872 emails sent to list (636 in previous quarter)
- issues@nifi.apache.org:
- 48 subscribers (up 2 in the last 3 months):
- 8301 emails sent to list (6307 in previous quarter)
## JIRA activity:
- 391 JIRA tickets created in the last 3 months
- 266 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are both
Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi and Apache
MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting the
NiFi classloader isolation model.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Conducted several releases including Apache NiFi Registry, Apache NiFi
MiNiFi CPP and Apache NiFi MiNiFi Java. The Apache NiFi Registry release is
a very important step forward for the community as it provides a powerful
software development lifecycle mechanism for Apache NiFi users and answers
a long standing request and often discussed capability.
- Apache NiFi 1.5.0 Release Candidate under vote at the time of this board
report writing.
- Voted a significant number of new committers and PMC members and are
extremely fortunate to see strong committer pipeline continue through newer
contributors with significant contributions.
- The PMC has identified and worked with Trademarks/Legal at Apache for a
couple of potential trademark or licensing abuse issues. Consensus was
that neither issue rises to the level of requiring any specific official
response though in one case we intend to provide a courtesy notification to
a commercial entity that is heavily leverage Apache NiFi source code
without any attribution. It is more of a poor form issue than a real
problem. Thanks to several highly experienced Apache Members who helped
discuss the threads in detail.
## Health report:
- Health of the community remains strong. Mailing list and JIRA activity is
consistent. ASF Hipchat is serving as an on-ramp for new users to our
mailing list and JIRA systems. We continue to see new users and
contributors.
- The PMC continues to demonstrate ability to detect and handle potential
trademark issues though it needs to focus better on staying tight and
prompt on security matters all the way through resolution.
- As we called out in our previous report we anticipated significant
recognition of earned meritocracy within the committer and PMC ranks. That
held true and the pipeline remains encouraging.
## PMC changes:
- Currently 26 PMC members.
- New PMC members:
- Marc Parisi was added to the PMC on Wed Dec 13 2017
- Jeff Storck was added to the PMC on Mon Dec 04 2017
- Scott Aslan was added to the PMC on Fri Dec 01 2017
- Michael W Moser was added to the PMC on Sun Nov 19 2017
- Last PMC member added Wed Dec 13 2017.
## Committer base changes:
- Currently 38 committers.
- New commmitters:
- Kevin Doran was added as a committer on Wed Jan 03 2018
- Andrew Ian Christianson was added as a committer on Mon Nov 13 2017
- Mike Hogue was added as a committer on Thu Nov 09 2017
- Peter Wicks was added as a committer on Thu Nov 09 2017
- Last committer added Wed Jan 03 2018.
## Releases:
- Apache NiFi Registry 0.1.0 was released Jan 1 2018.
- Apache NiFi MiNiFi Java 0.3.0 was released Dec 22 2017.
- Apache NiFi MiNiFi CPP 0.3.0 was released Nov 30 2017.
## Mailing list activity:
- Activity on the mailing lists remains high with a mixture of new users,
contributors, and deeper more experienced users and contributors sparking
discussion and questions and filing bugs or new features.
- users@nifi.apache.org:
- 581 subscribers (up 25 in the last 3 months):
- 783 emails sent to list (721 in previous quarter)
- dev@nifi.apache.org:
- 388 subscribers (up 5 in the last 3 months):
- 679 emails sent to list (590 in previous quarter)
- issues@nifi.apache.org:
- 46 subscribers (up 0 in the last 3 months):
- 6950 emails sent to list (5388 in previous quarter)
## JIRA activity:
- 356 JIRA tickets created in the last 3 months
- 276 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are
both Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi
and Apache MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting
the NiFi classloader isolation model.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Released Apache NiFi 1.4.0 which is another very heavy feature, stability,
and bug fix release. It includes improvements on the web UI coming from new
contributors which is a great sign.
- The Apache NiFi downloads have been quite large and growing for some time.
The groundwork to solve this is the Apache NiFi Registry effort which is
coming along nicely and which the foundational elements of NiFi to integrate
with it are present. We're probably looking at two more releases for that
to land and for which we can drop the NiFi build size down.
- We continue to hover around the 100 outstanding pull requests number. What
is encouraging is we've seen an uptick in contributions both in code and
review feedback from new community members.
- The Apache NiFi MiNiFi C++ agent has rapidly matured over the past couple of
months and is serving as a new source for contributions and contributors.
## Health report:
- As stated in our past report, health of the community is strong and
indicators of strength continue trending in the right direction. Mailing
list and JIRA activity is strong. ASF Hipchat is serving as an on-ramp for
new users to our mailing list and JIRA systems. We continue to see new
users and contributors.
- The PMC and committer ranks did not grow during the reporting period. This
is a reflection of the PMC not focusing enough on the topic though as we're
seeing a very strong pipeline to both committer and PMC. Expect both
new committers and PMC members during our next reporting period.
## PMC changes:
- Currently 22 PMC members.
- Last PMC member added Fri May 26 2017.
## Committer base changes:
- Currently 34 committers.
- Last committer added Thu Jun 01 2017.
## Releases:
- Apache NiFi 1.4.0 was released Oct 2 2017.
## Mailing list activity:
- Activity on the mailing lists remains extremely high with a mixture
of new users, contributors, and deeper more experienced users and
contributors sparking discussion and questions and filing bugs or
new features.
- users@nifi.apache.org:
- 553 subscribers (up 34 in the last 3 months):
- 748 emails sent to list (862 in previous quarter)
- dev@nifi.apache.org:
- 383 subscribers (up 12 in the last 3 months):
- 604 emails sent to list (947 in previous quarter)
- issues@nifi.apache.org:
- 46 subscribers (up 4 in the last 3 months):
- 5775 emails sent to list (7457 in previous quarter)
## JIRA activity:
- 335 JIRA tickets created in the last 3 months
- 263 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data.
- Apache NiFi MiNiFi is an edge data collection agent built to seamlessly
integrate with and leverage the command and control of NiFi. There are
both Java and C++ implementations.
- Apache NiFi Registry is a centralized registry for key configuration items
including flow versions, assets, and extensions for Apache NiFi
and Apache MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact used for supporting
the NiFi classloader isolation model.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Based on board feedback in last report the descriptions above have been
simplified to avoid confusing child/subproject terminology. We have
successfully conducted and completed name searches for the MiNiFi and
Registry efforts.
- Conducted numerous releases as listed below. The 0.7.x releases focused
on providing simple bug fixes and resolving reported CVEs. The 1.x
releases brought about stability, performance improvements, and addressed
reported CVEs. Further, in the 1.x releases numerous substantive features
were introduced including the ability to run multiple versions of the same
components and support for both format and schema aware record processors
to easily handle cases like acquisition, SQL based routing, enrichment,
conversion, and delivery of record oriented data. These make many common
record oriented use cases far more performant, intuitive, and retain the
full power of NiFi's provenance features.
## Health report:
- Health of the community is strong and indicators of strength continue
trending in the right direction. Mailing list and JIRA activity is strong.
ASF Hipchat is serving as an on-ramp for new users to our mailing list and
JIRA systems. We continue to see new users and contributors. The PMC and
committer ranks grew again during this reporting cycle and the pipeline
is encouraging. We're generating many releases with new release managers
stepping up often. The team handles security reports swiftly and follows
ASF security team published processes effectively.
## PMC changes:
- Currently 22 PMC members.
- New PMC members:
- Koji Kawamura was added to the PMC on Fri May 26 2017
- Pierre Villard was added to the PMC on Sun May 21 2017
- Yolanda Davis was added to the PMC on Wed May 17 2017
## Committer base changes:
- Currently 34 committers.
- New commmitters:
- Marc Parisi was added as a committer on Thu Jun 01 2017
- Andrew M. Lim was added as a committer on Wed May 31 2017
## Releases:
- Apache NiFi 1.3.0 was released June 9 2017.
- Apache NiFi 0.7.4 was released June 9 2017.
- Apache NiFi MiNiFi (java) 0.2.0 was released May 19 2017.
- Apache NiFi 0.7.3 was released May 19 2017.
- Apache NiFi MiNiFi (cpp) 0.2.0 was released May 14 2017.
- Apache NiFi 1.2.0 was released May 10 2017.
## Mailing list activity:
- Activity on the mailing lists remains extremely high with a mixture
of new users, contributors, and deeper more experienced users and
contributors sparking discussion and questions and filing bugs or
new features.
- users@nifi.apache.org:
- 512 subscribers (up 39 in the last 3 months):
- 936 emails sent to list (846 in previous quarter)
- dev@nifi.apache.org:
- 367 subscribers (up 24 in the last 3 months):
- 1018 emails sent to list (925 in previous quarter)
- issues@nifi.apache.org:
- 42 subscribers (up 4 in the last 3 months):
- 7936 emails sent to list (6592 in previous quarter)
## JIRA activity:
- 573 JIRA tickets created in the last 3 months
- 421 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data.
- Apache MiNiFi, a child project of Apache NiFi, is an edge data
collection agent built to seamlessly integrate with and leverage the
command and control of NiFi. There are both Java and C++
implementations.
- Apache NiFi Registry, a child project of Apache NiFi, is a centralized
registry for key configuration items including flow versions, assets,
and extensions for Apache NiFi and Apache MiNiFi.
- Apache NiFi Nar Maven Plugin is a release artifact we use for supporting
the NiFi classloader isolation model.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Apache NiFi Nar Maven Plugin 1.2.0 was released on March 20, 2017
- Apache NiFi 1.1.2 was released on February 24, 2017.
- Apache NiFi 0.7.2 was released on February 24, 2017.
- We have launched a security@nifi alias and security procedure webpage.
Have reported several CVEs and conducted releases to address the findings.
- We have launched a new subproject called Apache NiFi Registry.
## Health report:
- The state of the community appears strong. We're seeing consistently
high activity on mailing lists, contributions of code and review feedback,
and are trending again toward a very significant release. We're seeing
signs of maturity for the project as well with a formalized security
reporting and handling process.
- We are closing in on a significant release of Apache NiFi and both the
Apache MiNiFi CPP and Java implementations.
## PMC changes:
- Currently 19 PMC members.
- New PMC members:
- James Wing was added to the PMC on Mon Feb 20 2017
- Oleg Zhurakousky was added to the PMC on Mon Apr 03 2017
## Committer base changes:
- Currently 32 committers.
- New commmitters:
- Bin Qiu was added as a committer on Tue Apr 04 2017
- Jeff Storck was added as a committer on Sat Feb 18 2017
## Releases:
- nifi-0.7.2 was released on Fri Feb 24 2017
- nifi-1.1.2 was released on Fri Feb 24 2017
## Mailing list activity:
- We continue to see steady growth in the number of participants on our
developer and user mailing lists as well as increased collaboration between
new community members. We're also seeing strong interactions on other sites
such as Twitter and StackOverflow.
- users@nifi.apache.org:
- 473 subscribers (up 40 in the last 3 months):
- 972 emails sent to list (790 in previous quarter)
- dev@nifi.apache.org:
- 343 subscribers (up 33 in the last 3 months):
- 1027 emails sent to list (855 in previous quarter)
- issues@nifi.apache.org:
- 38 subscribers (up 6 in the last 3 months):
- 7271 emails sent to list (6683 in previous quarter)
## JIRA activity:
- 452 JIRA tickets created in the last 3 months
- 321 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data.
- Apache MiNiFi, a child project of Apache NiFi, is an edge data
collection agent built to seamlessly integrate with and leverage the
command and control of NiFi. There are both Java and C++
implementations.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Apache NiFi 1.1.1 was released (12/22/16)
- Apache NiFi 1.0.1 was released (12/19/16)
- Apache NiFi MiNiFi 0.1.0 Java released (12/4/16)
- Apache NiFi MiNiFi 0.1.0 C++ released (12/2/16)
- Apache NiFi 1.1.0 was released (11/29/16)
## Health report:
- We have grown both the PMC and committer ranks during the reporting period.
- We've produced both significant feature and bug fix releases during the
reporting period.
- Discussions on dev and in our wiki are evolving well regarding future
feature ideas and we continue to see new contributors participating.
## PMC changes:
- Currently 17 PMC members.
- New PMC members:
- Joe Skora was added to the PMC on Wed Dec 28 2016
- Andre Fucs de Miranda was added to the PMC on Wed Nov 02 2016
## Committer base changes:
- Currently 30 committers.
- New commmitters:
- Joey Frazee was added as a committer on Thu Dec 29 2016
- Jeremy Dyer was added as a committer on Mon Dec 19 2016
- Scott Aslan was added as a committer on Fri Nov 04 2016
- Bryan Rosander was added as a committer on Mon Oct 24 2016
## Releases:
- Last release was Apache NiFi 1.1.1 on Dec 22 2016
- There were five releases during the reporting period.
## Mailing list activity:
- Mailing list activity remained strong throughout the reporting period.
- users@nifi.apache.org:
- 433 subscribers (up 39 in the last 3 months):
- 810 emails sent to list (847 in previous quarter)
- dev@nifi.apache.org:
- 310 subscribers (up 14 in the last 3 months):
- 862 emails sent to list (909 in previous quarter)
- issues@nifi.apache.org:
- 32 subscribers (up 4 in the last 3 months):
- 6600 emails sent to list (11361 in previous quarter)
## JIRA activity:
- 491 JIRA tickets created in the last 3 months
- 367 JIRA tickets closed/resolved in the last 3 months
## Description: - Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. - Apache MiNiFi, a child project of Apache NiFi, is an edge data collection agent built to seamlessly integrate with and leverage the command and control of NiFi. There are both Java and C++ implementations. ## Issues: - There are no issues requiring board attention at this time. ## Activity: - Apache NiFi 0.7.0 and Apache MiNiFi 0.0.1 Java implementation was produced. - The first release of Apache MiNiFi's C++ based implementation was produced. - The Apache NiFi 1.0.0 release occurred as the culmination of more than a year's worth of discussion, planning, and contributions. - Preparations are underway to produce Apache NiFi 0.7.1 and 1.1.0 releases. ## Health report: - Activity on mailing lists, JIRA, Git remains strong including code contributions from 47 different individuals in this period. - We've introduced new committers, PMC members, and recent reviews of the pipeline suggest both committer and PMC progression is very promising. - Recent efforts have occurred to work down the PR backlog and to close out stagnant submissions. - The JIRA open/close rate was excellent during the 1.0 release push. We need to continue to monitor this and ideally have periods where closure exceeds creation. ## PMC changes: - Currently 15 PMC members. - Matt Burgess was added to the PMC on Oct 6 2016 ## Committer base changes: - Currently 26 committers. - New commmitters: - Koji Kawamura was added as a committer on Wed Jul 20 2016 - Yolanda Davis was added as a committer on Sat Jul 30 2016 - Andre Fucs De Miranda was added as a committer on Sun Aug 07 2016 - Rob Moran was added as a committer on Mond Sep 19 2016 ## Releases: - minifi 0.0.1 was released on Sun Jul 10 2016 - nifi 0.7.0 was released on Tue Jul 12 2016 - nifi 1.0.0 was released on Tue Aug 30 2016 - minifi c++ 0.0.1 was released on Fri Sep 2 2016 ## Mailing list activity: - We introduced an issues list and moved many dev emails there which has improved the quality of discussion on dev. - users@nifi.apache.org: - 385 subscribers (up 48 in the last 3 months): - 809 emails sent to list (945 in previous quarter) - dev@nifi.apache.org: - 289 subscribers (up 22 in the last 3 months): - 1129 emails sent to list (3701 in previous quarter) - issues@nifi.apache.org: - 26 subscribers (up 26 in the last 3 months): - 10702 emails sent to list (0 in previous quarter) ## JIRA activity: - 753 JIRA tickets created in the last 3 months - 652 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process
and distribute data.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- First RC for MiNiFi which is a subproject of Apache NiFi is being
reviewed and voted upon. It will be Apache MiNiFi 0.0.1.
- Second RC for Apache NiFi 0.7.0 is being prepared for a vote.
The first RC was cancelled due to licensing concerns and a couple blockers
found by community members during testing.
- Apache NiFi 1.0.0 is nearing RC stage. Looks like it could happen in a
couple of weeks but significant effort remains to pull that release
together.
- Numerous meetups and conference presentations featuring Apache NiFi and
its collaborative role with other Apache technologies have occurred in the
past few months. Social media commentary and Q&A for NiFi on various
channels (twitter, stackoverflow) has increased considerably.
- We have created a new issues mailing list for automated updates from
Github and JIRA so that we can keep the signal to noise level on the dev
list higher.
## Health report:
- Activity on mailing lists, JIRA, Git remains strong.
- During the last review cycle we have new committers and PMC progression.
- The pipeline of committers working toward PMC status remains strong and
the community documented how to progress to PMC https://s.apache.org/Ogm7
- However, we are not without risk. Supporting both the 0.x and 1.x lines
is taxing. We've documented the support plan https://s.apache.org/I9Rf but
as it is early we need to closely review this to ensure it is working.
- The rate of PR production to PR review and disposition means we have a
growing trail of PRs. We need to focus on this in the coming quarter.
- The rate of JIRA creation to JIRA disposition means we have a growing
number of JIRAs. We need to focus on this in the coming quarter.
## PMC changes:
- Currently 14 PMC members.
- Andy LoPresto was added to the PMC on July 7 2016
- Joe Percivall was added to the PMC on May 16 2016
- Last PMC addition was Andy LoPresto on July 7 2016
## Committer base changes:
- Currently 22 committers.
- New commmitters:
- Pierre Villard was added as a committer on Sun May 29 2016
- James Wing was added as a committer on Tues May 10 2016
## Releases:
- nifi-0.6.1 was released on Mon April 18 2016
## Mailing list activity:
- users@nifi.apache.org:
- 337 subscribers (up 69 in the last 3 months):
- 1006 emails sent to list (802 in previous quarter)
- dev@nifi.apache.org:
- 267 subscribers (up 33 in the last 3 months):
- 4046 emails sent to list (2412 in previous quarter)
## JIRA activity:
- 487 JIRA tickets created in the last 3 months
- 265 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process
and distribute data.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Released NiFi 0.5 with considerable new core features and extensions.
- Released NiFi 0.6 adding features to set stage for 1.0 release.
- Key features and milestones for 1.0 release have been put together by the
community in a public roadmap and are in active development. Our default
version control branch (master) is now dedicated to 1.0 development.
- The community has put together a plan and guidelines for
contributors to develop features for both 1.0 and 0.X lines concurrently
- Meetups featuring NiFi talks have occurred in the reporting period in
Santa Clara, Chicago, WashingtonDC, New York City, Baltimore, Seattle,
Toronto, Dublin, Denmark, Montreal
- Established child project known as 'MiNiFi' to provide an
alternative command and control and implementation model tailored
toward the first mile challenges of data acquisition. JIRA and Git
infrastructure setup and contributions underway.
## Health report:
- Activity on mailing lists, JIRA, Git continues trending well.
- During the last review cycle several new committers have joined.
- Based on growth of active committers the pipeline for
PMC progression is strong. We need to better formulate how to progress
to PMC.
## PMC changes:
- Currently 13 PMC members.
- No new PMC members in the last three months.
- Last PMC addition was Sean Busbey on Wed Nov 25 2015
## Committer base changes:
- Currently 21 committers.
- New commmitters:
- Andy LoPresto was added as a committer on Sat Apr 02 2016
- Oleg Zhurakousky was added as a committer on Wed Mar 16 2016
- Matt Burgess was added as a committer on Fri Mar 04 2016
- Joe Skora was added as a committer on Mon Feb 15 2016
## Releases:
- nifi-0.6.0 was released on Fri Mar 26 2016
- nifi-0.5.1 was released on Thu Feb 25 2016
- nifi-0.5.0 was released on Mon Feb 15 2016
## Mailing list activity:
- users@nifi.apache.org:
- 262 subscribers (up 56 in the last 3 months):
- 832 emails sent to list (709 in previous quarter)
- dev@nifi.apache.org:
- 231 subscribers (up 23 in the last 3 months):
- 2610 emails sent to list (1389 in previous quarter)
## JIRA activity:
- 388 JIRA tickets created in the last 3 months
- 237 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process
and distribute data.
## Issues:
- There are no issues requiring board attention at this time.
## Activity:
- Released NiFi 0.4 with extensive stability and feature enhancements.
- Upcoming NiFi releases will provide important features frequently
requested and discussed by the community and as found on feature proposals
in the NiFi Wiki. Discussion of moving toward a 1.0 release are underway.
- Members of the NiFi community have created new or improved integrations
with several Apache projects including HBase, Kafka, Avro, Flink, and Apex.
## Health report:
- Activity on mailing lists, JIRA, Git remains strong.
- During the last review cycle the PMC has grown and a newly formed
committer tier has been established.
- The pipeline for people progressing toward committer and/or PMC status
is highly encouraging.
## PMC changes:
- Currently 13 PMC members.
- One new PMC members added in the last 3 months
- Last PMC addition was Sean Busbey on Wed Nov 25 2015
## Committer base changes:
- Currently 17 committers.
- New commmitters:
- Joe Percivall was added as a committer on Mon Dec 14 2015
- Sean Busbey was added as a committer on Wed Nov 25 2015
- Toivo Adams was added as a committer on Tue Nov 03 2015
- Ricky Saltzer was added as a committer on Wed Oct 21 2015
- Michael W Moser was added as a committer on Sun Oct 18 2015
## Releases:
- nifi-0.4.1 on Wed Dec 23 2015
- nifi-0.4.0 on Mon Dec 14 2015
## Mailing list activity:
- users@nifi.apache.org:
- 200 subscribers (up 66 in the last 3 months):
- 726 emails sent to list (343 in previous quarter)
- dev@nifi.apache.org:
- 203 subscribers (up 37 in the last 3 months):
- 1413 emails sent to list (968 in previous quarter)
- commits@nifi.apache.org:
- 37 subscribers
## JIRA activity:
- 324 JIRA tickets created in the last 3 months
- 215 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful,
and reliable system to process and distribute data.
## Activity:
- Completed release of NiFi 0.3.0
- Published numerous feature proposals
- Numerous meetups/talks have occurred since the last report featuring Apache
NiFi at locations including Washington DC, Maryland, South Korea, Montreal,
Phoenix, Seattle.
## Health report:
- Activity on mailing lists, JIRA, Git remains strong. The user mailing list
is growing. Feedback from the community on the responsiveness of the
community has been encouraging.
- The PMC is discussing the establishment of bylaws similar to those of
Hadoop, Hive, HTTPD.
## Issues:
- there are no issues requiring board attention at this time
## PMC changes:
- Currently 12 PMC members.
- New PMC members:
- None since TLP status in July 2015
## LDAP changes:
- Currently 12 committers and 12 committee group members.
- Last committer addition was Bryan Bende at Mon Jun 15 2015
## Releases:
- nifi-0.2.0-incubating was released on Sun Jul 12 2015
- nifi-0.2.1 was released on Sun Jul 26 2015
- nifi-0.3.0 was released on Fri Sep 18 2015
## Mailing list activity:
- users@nifi.apache.org:
- 132 subscribers (up 84 in the last 3 months):
- 369 emails sent to list (57 in previous quarter)
- dev@nifi.apache.org:
- 165 subscribers (up 38 in the last 3 months):
- 1018 emails sent to list (962 in previous quarter)
## JIRA activity:
- 265 JIRA tickets created in the last 3 months
- 138 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute data.
## Activity:
- We have not yet completed the NiFi 0.3.0 release but tremendous progress
has been made. We've really focused over the past couple of weeks on
testing and as a result have identified and addressed important defects.
- There have been several healthy feature and roadmap discussions on the
developer mailing lists leading to the establishment of several wiki
documented feature proposals and progress against them.
- Several talks have been given recently or are planned in the near future
including:
- Aug 11, 2015 - Joe Witt, Matt Gilman, Enterprise dataflow with Apache NiFi,
Global Big Data Conference Boston
- Aug 13, 2015 - Joe Witt, Enterprise Dataflow with Apache NiFi,
AOL Codebrew Sterling, VA
- Aug 26, 2015 - Matt Gilman, Mark Payne, Global Big Data Conference Raleigh
- Sep 2, 2015 - Matt Gilman, Mark Payne, Global Big Data Conference Santa
Clara
- Sep 3, 2015 - Ricky Saltzer, Designing Scaleable Data Pipelines with
Apache NiFi, Triangle Hadoop Users Group
- Sep 15, 2015 - Aldrin Piri, Enterprise Dataflow with Apache NiFi,
Deview 2015 Seoul South Korea
- Sep 22, 2015 - Mark Payne, Spark Streaming Integration with Apache NiFi,
Apache Spark Maryland
- Sep 23, 2015 - Bryan Bende, Building Data Pipelines for Solr with Apache
NiFi, DC Area (NOVA) Apache Lucene/Solr Meetup
- Oct 1, 2015 - Joe Witt, Enterprise Dataflow with Apache NiFi,
Hadoop User Group Phoenix, AZ.
- Oct 19, 2015 - Ricky Saltzer, Designing Scaleable Pipelines with Apache
NiFi, All things Open Conference Raleigh NC
## Health report:
- JIRA, mailing list, and new and existing contributor activity all suggest
the project is on a good growth path.
## Issues:
- There are no issues requiring board attention at this time.
## LDAP committee group/Committership changes:
- Currently 12 committers and 12 LDAP committee group members.
- Aldrin Piri was added to the LDAP committee group on Fri Jul 17 2015
- Bryan Bende was added as a committer on Mon Jun 15 2015
## Releases:
- nifi-0.2.0-incubating was released on Sun Jul 12 2015
- nifi-0.2.1 was released on Sun Jul 26 2015
## Mailing list activity:
- users@nifi.apache.org:
- 93 subscribers (up 53 in the last 3 months):
- 225 emails sent to list (61 in previous quarter)
- dev@nifi.apache.org:
- 142 subscribers (up 16 in the last 3 months):
- 1050 emails sent to list (913 in previous quarter)
## JIRA activity:
- 268 JIRA tickets created in the last 3 months
- 200 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data.
## Activity:
- Completed transition from Incubator to TLP infrastructure.
- Completed first release as a TLP
- Closing in on the 0.3.0 release.
- Corrects several defects.
- Adds support for integration with several Apache projects
including Ambari and Flume
- Adds support for interaction with several of Amazon's Web Services.
## Issues:
- There are no issues requiring board attention at this time.
## LDAP committee group/Committership changes:
- Currently 12 committers and 12 LDAP committee group members.
- No new LDAP committee group members added in the last 3 months
- New commmitters:
- Dan Bress was added as a committer on Wed May 27 2015
- Bryan Bende was added as a committer on Mon Jun 15 2015
## Releases:
- nifi-0.1.0-incubating was released on Thu May 14 2015
- nifi-0.2.0-incubating was released on Sun Jul 12 2015
- nifi-0.2.1 was released on Sun Jul 26 2015
## Mailing list activity:
- users@nifi.apache.org:
- 65 subscribers (up 35 in the last 3 months):
- 108 emails sent to list (17 in previous quarter)
- dev@nifi.apache.org:
- 129 subscribers (up 4 in the last 3 months):
- 1089 emails sent to list (823 in previous quarter)
## JIRA activity:
- 227 JIRA tickets created in the last 3 months
- 193 JIRA tickets closed/resolved in the last 3 months
WHEREAS, the Board of Directors deems it to be in the best
interests of the Foundation and consistent with the
Foundation's purpose to establish a Project Management
Committee charged with the creation and maintenance of
open-source software, for distribution at no charge to
the public, related to an automated and durable data broker
between systems providing interactive command and control
and detailed chain of custody for data.
NOW, THEREFORE, BE IT RESOLVED, that a Project Management
Committee (PMC), to be known as the "Apache NiFi Project",
be and hereby is established pursuant to Bylaws of the
Foundation; and be it further
RESOLVED, that the Apache NiFi Project be and hereby is
responsible for the creation and maintenance of software
related to an automated and durable data broker
between systems providing interactive command and control
and detailed chain of custody for data; and be it further
RESOLVED, that the office of "Vice President, Apache NiFi" be
and hereby is created, the person holding such office to
serve at the direction of the Board of Directors as the chair
of the Apache NiFi Project, and to have primary responsibility
for management of the projects within the scope of
responsibility of the Apache NiFi Project; and be it further
RESOLVED, that the persons listed immediately below be and
hereby are appointed to serve as the initial members of the
Apache NiFi Project:
* Brandon DeVries (devriesb@apache.org)
* Matt Gilman (mcgilman@apache.org)
* Tony Kurc (tkurc@apache.org)
* Mark Payne (markap14@apache.org)
* Aldrin Piri (aldrin@apache.org)
* Dan Bress (danbress@apache.org)
* Jennifer Barnabee (jbarnabee@apache.org)
* Joe Witt (joewitt@apache.org)
* Jason Carey (jcarey@apache.org)
* Adam Taft (taftster@apache.org)
* Benson Margulies (bimargulies@apache.org)
* Bryan Bende (bbende@apache.org)
NOW, THEREFORE, BE IT FURTHER RESOLVED, that Joe Witt
be appointed to the office of Vice President,
Apache NiFi, to serve in accordance with and subject to the
direction of the Board of Directors and the Bylaws of the
Foundation until death, resignation, retirement, removal or
disqualification, or until a successor is appointed;
and be it further
RESOLVED, that the initial Apache NiFi PMC be and hereby is
tasked with the creation of a set of bylaws intended to
encourage open development and increased participation in the
Apache NiFi Project; and be it further
RESOLVED, that the Apache NiFi Project be and hereby
is tasked with the migration and rationalization of the Apache
Incubator NiFi podling; and be it further
RESOLVED, that all responsibilities pertaining to the Apache
Incubator NiFi podling encumbered upon the Apache Incubator
Project are hereafter discharged.
Special Order 7B, Establish the Apache NiFi Project, was
approved by Unanimous Vote of the directors present.
NiFi is a dataflow system based on the concepts of flow-based programming. NiFi has been incubating since 2014-11-24. Three most important issues to address in the move towards graduation: 1. Continue to grow the community and support the new user base 2. Establish rhythm for releases and improve documentation and procedures 3. Provide a clear and expedient process for code contribution and review Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? - We have a new PPMC member - Aldrin Piri. - We completed our second release on March 17 2015. - Two talks were given at ApacheCon NA 2015 featuring Apache NiFi (incubating) - The first Apache NiFi meetup was held in the Baltimore/Washington area. - The project has code contributions from more than 25 people. - The mailing lists are quite active with developer questions and an increasing amount of user focused questions. The dev list has 118 registered addresses. Commits has 30 and our brand new 'users' list established in mid April has 20. How has the project developed since the last report? - We have produced our second release within the Apache Incubator. - We are in the closing stages of our third release and includes bug fixes, new features, and improved documentation with significant representation of contribution outside of the PPMC. Date of last release: 2015-03-16 When were the last committers or PMC members elected? 2015-03-17 Signed-off-by: [X](nifi) Billie Rinaldi [ ](nifi) Arvind Prabhakar [X](nifi) Sergio Fernandez [ ](nifi) Benson Margulies [ ](nifi) Brock Noland [X](nifi) Drew Farris [X](nifi) Andrew Purtell Shepherd/Mentor notes: P. Taylor Goetz (ptgoetz): Mentors engaged. Podling seems to be doing well with no issues requiring mentor assistance.
NiFi is a dataflow system based on the concepts of flow-based programming.
NiFi has been incubating since 2014-11-24.
Three most important issues to address in the move towards graduation:
1. Grow our community.
2. Establish rhythm for releases, review processes, and document how to
most effectively bring on new committers.
3. Update our release process with items learned from initial release.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
Nothing we wish to raise at this time.
How has the community developed since the last report?
We have a new PPMC member - Jenn Barnabee.
We continue to receive patches, code ideas, and bug reports from the
community. Notable contributions during this reporting period outside the
PPMC and committer base include a new website design, code which will
automate much of the documentation production, and refactoring to improve
code reuse.
The dev mailing list has grown from 62 to 80 in the last report (commits
has grown to 29).
How has the project developed since the last report?
We have successfully produced our first release within the Apache
Incubator!
Date of last release:
2015-01-29
When were the last committers or PMC members elected?
2015-01-17
Signed-off-by:
[X](nifi) Billie Rinaldi
[X](nifi) Arvind Prabhakar
[X](nifi) Sergio Fernandez
[ ](nifi) Benson Margulies
[x](nifi) Brock Noland
[X](nifi) Drew Farris
[X](nifi) Andrew Purtell
Shepherd/Mentor notes:
Drew Farris (drew):
Great report. Congratulations on the first release of NiFi at
Apache. Excellent job honing the release process and keeping
up the momentum with the Release Candidates.
P. Taylor Goetz (ptgoetz):
The podling looks healthy, with active participation from 6
out of 7 mentors. Mentors were particularly helpful in
guiding the community through a first release.
NiFi is a dataflow system based on the concepts of flow-based programming.
NiFi has been incubating since 2014-11-24.
Three most important issues to address in the move towards graduation:
1. Produce an initial release.
2. Grow our community beyond the initial set of committers.
3. Establish rhythm for releases, review processes, and document how to
most effectively bring on new committers.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
Nothing we wish to raise at this time.
How has the community developed since the last report?
The dev mailing list has picked up 20 new e-mails since the last report
and is now at 62 (commits has grown to 25).
At the suggestion of the community we've adopted a review-then-commit
strategy which is designed to among other things help with community
development.
We've received several patches from members outside the initial committer
list including changes which dramatically improved our build process and
provide new extensions.
How has the project developed since the last report?
All of our current infrastructure needs are setup and things are working
really well. Our focus now is on working towards our first release which
is 0.0.1 and presently comprised of 85 JIRA issues the vast majority of
which are resolved. We've conducted a thorough review of all source files
to ensure proper license headers/notices/disclaimers are present. We've
completed a thorough review and modification of the overall LICENSE and
NOTICE files in preparation for release. We've conducted the initial
podling name search and submitted the ticket for that analysis to be
verified and confirmed.
Date of last release:
N/A
When were the last committers or PMC members elected?
We have not grown the official committer list beyond the initial committer
list. Though there are a couple of folks who are committing fairly
consistently now and a new member to join the dev mailing list that is
very promising.
Signed-off-by:
[X](nifi) Billie Rinaldi
[x](nifi) Arvind Prabhakar
[ ](nifi) Sergio Fernandez
[x](nifi) Benson Margulies
[x](nifi) Brock Noland
[ ](nifi) Drew Farris
[X](nifi) Andrew Purtell
Shepherd notes (Tim Chen):
Project is still setting up and in the early phase. Mailing list and commits
are fairly active.
NiFi is a dataflow system based on the concepts of flow-based programming.
NiFi has been incubating since 2014-11-24.
Three most important issues to address in the move towards graduation:
1. Establishment of Apache Infrastructure. Git establishment is
outstanding with INFRA-8707
2. Produce an initial release.
3. Grow the community beyond those involved in the incubator proposal.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None at this time.
How has the community developed since the last report?
Since podling initiation our dev mailing list has 42 subscribers and the
commits mailing list has 19.
How has the project developed since the last report?
Since podling initiation the team has mailing lists, website, and Jira
setup. Awaiting INFRA action for Git. We should then be able to better
communicate and grow. We fully understand though that Infra has been
very busy addressing the SVN server issues.
Date of last release:
N/A
When were the last committers or PMC members elected?
Entered incubation 2014-11-24. There have been comments/messages/
subscriptions on the mailing lists from folks not on the initial
contributors list. We believe there is a good opportunity to bring on
more folks from a more diverse base fairly quickly.
Signed-off-by:
[X](nifi) Billie Rinaldi
[X](nifi) Arvind Prabhakar
[X](nifi) Sergio Fernández
[X](nifi) Benson Margulies
[X](nifi) Drew Farris
[ ](nifi) Brock Noland
[X](nifi) Andrew Purtell