Community-led development "The Apache Way"
This was extracted (@ 2021-06-16 23:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Report was filed, but display is awaiting the approval of the Board minutes.
## Description: The mission of Apache Airflow is the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines. ## Membership Data: There are currently 39 committers and 24 PMC members in this project. The Committer-to-PMC ratio is roughly 7:4. Community changes, past quarter: - Xiaodong Deng was added to the PMC on 2020-12-25 - Daniel Standish was added as committer on 2021-03-01 - Elad Kalif was added as committer on 2021-02-26 - Ephraim Anierobi was added as committer on 2021-02-17 - James Timmins was added as committer on 2021-02-26 - Vikram Koka was added as committer on 2021-01-05 ## Project Activity: ### Releases: - 2.0.1 was released on 2021-02-08. - 2.0.0 was released on 2020-12-17. - 1.10.14 was released on 2020-12-10 - upgrade-check-1.2.0 was released on 2021-02-12. - A batch of provider packages (a "sub"/plugin package of apache-airflow) were released on 2021-02-08 and again on 2021-03-08. - Backport Provider Packages (the same code as the normal provider packages, but compatible with 1.10.x series) were released on 2021-02-10 and again on 2021-03-08 ### CVEs published Airflow published four CVEs this past quarter: - CVE-2020-17513: Apache Airflow Server-Side Request Forgery (SSRF) in Charts & Query View - CVE-2021-26697: Apache Airflow: Lineage API endpoint for Experimental API missed authentication check - CVE-2021-26559: CWE-284 Improper Access Control on Configurations Endpoint for the Stable API - CVE-2020-17526: Apache Airflow Incorrect Session Validation in Airflow Webserver with default config - CVE-2020-17511: Apache Airflow Airflow admin password gets logged in plain text - CVE-2020-17515: Apache Airflow Reflected XSS via Origin Parameter ### Events: - “Airflow Virtual Meetup” was organized on 2021-01-28 - “Bangalore Airflow Virtual Meetup” was organized on 2021-02-12 - Airflow Virtual meet-up will be held on 2021-04-08 - We are working on organizing a virtual Airflow Summit 2021 conference which will be held on May 20-28 2021. The call for papers is already open and will close on April 12. ## Community Health: Despite the decrease in activity we are pretty healthy. - We created a community-managed Airflow publication on medium.com and dev.to to gather Airflow-related blog posts under one umbrella to promote the project. - We have two recurring community calls organized every fortnight: - Airflow Dev Call - Airflow Issue Triage process - Apache Airflow project started using Github Discussions and we observed a constant flow of users' questions. - We are also releasing a “Airflow Newsletter” to dev@airflow once a month. - We conducted a community survey among Airflow users and the results are here: http://airflow.apache.org/blog/airflow-survey-2020/ - In Q4 2020, there was a very large effort to make major upgrades in preparation for 2.0. This effort, while necessary, was also an unsustainable effort (lots of nights and weekends from committers/PMC members). Since 2.0 is now released, it is both reasonable and healthy for there to be a drop in the commit and PR pace (48% decrease in commits vs the previous quarter). However overal commits are still continuing at a healthy pace - 1535 commits form 199 contributors in in Q1 - We have seen a slight decrease in issues being opened (543, down 16%) possibly as a result of enabling GitHub Discussions, meaning users have an alternative means of asking for help rather than opening GitHub issues or posting on the lists.
## Description: The mission of Apache Airflow is the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines ## Issues: ## Membership Data: Apache Airflow was founded 2018-12-19 (2 years ago) There are currently 35 committers and 24 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Daniel Imberman on 2020-07-07. - Ryan Hamilton was added as committer on 2020-10-29 ## Project Activity: Apache Airflow 1.10.13 was released on Nov 25. Although it contains a bug related to task_concurrency and depends_on_past: Issue Link. The fix for it has been merged and 1.10.14rc1 would be cut this week and if the VOTE passes, 1.10.14 will be released early next week apache-airflow-upgrade-check 1.0.0 was released on Nov 25 too and is available for download via PIP: pip install apache-airflow-upgrade-check We have received credits from AWS to speed up our CI! [PAST EVENTS] Nov 17 — https://www.meetup.com/NYC-Apache-Airflow-Meetup/events/274289245/ [To Be Confirmed]: We’ve just closed all the Airflow Summit proceedings and we are going to donate $8,863.95 profit from Airflow Summit to the Apache Software Foundation. Many thanks to Software Guru for ]managing the conference efforts] - or something similar! 1.10.13 was released on 2020-11-25. upgrade-check-1.0.0 was released on 2020-11-25. Backport Provider Packages 2020.11.23 was released on 2020-11-24. Backport Provider Packages 2020.11.13 was released on 2020-11-13. Backport Provider Packages 2020.10.29 was released on 2020-11-02. Backport Provider Packages 2020.10.5 was released on 2020-10-06. ## Community Health: We are pretty healthy :-). The numbers speak for themselves we think: dev@airflow.apache.org had a 23% increase in traffic in the past quarter (669 emails compared to 540) 2825 commits in the past quarter (53% increase) 201 code contributors in the past quarter (-13% decrease) 1422 PRs opened on GitHub, past quarter (21% increase) 1410 PRs closed on GitHub, past quarter (21% increase) 633 issues opened on GitHub, past quarter (23% increase) 491 issues closed on GitHub, past quarter (63% increase)
## Description: The mission of Apache Airflow is the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines ## Issues: We would like guidance from the Board about what constitutes a release when it comes to Docker images and Helm Charts. For context: https://lists.apache.org/x/thread.html/rcb608739206d788785081073a0deb417ffa9981634975fc5525dc769@%3Cdev.community.apache.org%3E The ASF release policy says: "Every ASF release must contain a source package, which must be sufficient for a user to build and test the release provided they have access to the appropriate platform and tool" Our specific question: - Does the reproducibility of a Helm chart include the images it depends on? - Or do we count the Helm chart as "stand-alone" (it is just text files/text templates and references which docker files to use. We (Airflow PMC) weren't able to reach a conclusion ourselves https://github.com/apache/airflow/issues/10753 ## Membership Data: Apache Airflow was founded 2018-12-19 (2 years ago) There are currently 34 committers and 24 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - Daniel Imberman was added to the PMC on 2020-07-07 - Kamil Breguła was added to the PMC on 2020-07-07 - Tomasz Urbaszek was added to the PMC on 2020-07-07 - QP Hou was added as committer on 2020-07-13 - Leah Cole was added as committer on 2020-07-20 - Ry Walker was added as committer on 2020-07-16 ## Project Activity: - 1.10.12 was released on 2020-08-25. - 1.10.11 was released on 2020-07-10. - "Backport Provider Packages" was released on 2020-06-24. (This is a early release of some components that will be available in Airflow 2.0 but available on the 1.10 series.) - Weekly dev calls for "Releasing 2.0" are happening (minutes in Confluence and on list), strong focus on releasing 2.0 this year. ## Community Health: - AirflowSummit 2020 was a huge success - with over 6,000 people registering and 3,000 watching the (virtual) sessions live.
## Description: The mission of Apache Airflow is the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Airflow was founded 2018-12-19 (a year ago) There are currently 31 committers and 21 PMC members in this project. The Committer-to-PMC ratio is roughly 4:3. Community changes, past quarter: - No new PMC members. Last addition was Kengo Seki on 2019-12-01. - Jiajie Zhong was added as committer on 2020-04-03 ## Project Activity: Recent releases: 1.10.10 was released on 2020-04-09. 1.10.8 was released on 2020-02-07. 1.10.9 was released on 2020-02-07. The Airflow Summit is now scheduled for early July (6-17) and will of course be virtual. https://airflowsummit.org/ ## Community Health: The community is very healthy. We are in the process of moving from JIRA to Github issues. 868 PRS have been closed and 881 PRs have been filed. Its always hard to keep up with reviewing although this has been made a lot easier with some of the development tools that have been contributed. Mailinglists are healthy and the split between user and dev seems to work well. dev@airflow.apache.org had a 11% decrease in traffic in the past quarter (746 emails compared to 831) users@airflow.apache.org had a 64% decrease in traffic in the past quarter (79 emails compared to 214) 53 issues opened in JIRA, past quarter (-93% decrease) 129 issues closed in JIRA, past quarter (-80% decrease) 1211 commits in the past quarter (-27% decrease) 202 code contributors in the past quarter (1% increase) 881 PRs opened on GitHub, past quarter (-5% decrease) 868 PRs closed on GitHub, past quarter (-10% decrease) 602 issues opened on GitHub, past quarter (3662% increase) 344 issues closed on GitHub, past quarter (6780% increase)
## Description: The mission of Apache Airflow is the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines ## Issues: Due to Corona virus concerns the first ever Airflow Summit was delayed until further notice. ## Membership Data: Apache Airflow was founded 2018-12-19 (a year ago) There are currently 30 committers and 21 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - No new PMC members. Last addition was Kengo Seki on 2019-12-01. - Tomasz Urbaszek was added as committer on 2019-12-20 ## Project Activity: 1.10.9 was released on 2020-02-07 (quick fix release). 1.10.8 was released on 2020-02-07. 1.10.7 was released on 2019-12-24. ## Community Health: We have a very healthy community with lots of activity. Apache Airflow jobs rank 4 for data engineering jobs. Airflow's Slack channels are active. dev@airflow.apache.org had a 12% increase in traffic in the past quarter (823 emails compared to 733) users@airflow.apache.org had a 115% increase in traffic in the past quarter (198 emails compared to 92) 801 issues opened in JIRA, past quarter (6% increase) 654 issues closed in JIRA, past quarter (35% increase) 1607 commits in the past quarter (36% increase) 199 code contributors in the past quarter (11% increase) 910 PRs opened on GitHub, past quarter (7% increase) 944 PRs closed on GitHub, past quarter (12% increase)
## Description: The mission of Apache Airflow is the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines ## Issues: ## Membership Data: Apache Airflow was founded 2018-12-19 (a year ago) There are currently 29 committers and 21 PMC members in this project. The Committer-to-PMC ratio is roughly 4:3. Community changes, past quarter: - Aizhamal Nurmamat kyzy was added to the PMC on 2019-11-21 - Kevin Yang was added to the PMC on 2019-11-21 - Jarek Potiuk was added to the PMC on 2019-10-18 - Kengo Seki was added to the PMC on 2019-12-01 - Kengo Seki was added as committer on 2019-12-01 ## Project Activity: Recent releases: 1.10.6 was released on 2019-10-28. 1.10.5 was released on 2019-09-04. 1.10.4 was released on 2019-08-06. ## Community Health: We have quite a few active discussions on Airflow Improvement Proposals (AIP) which are more and more being picked up by the community to steer large changes. Mailinglist and PRs remain very active as well. The growth of committers and PMC members is therefore very welcome. dev@airflow.apache.org had a 8% decrease in traffic in the past quarter (735 emails compared to 791) users@airflow.apache.org had a 360% increase in traffic in the past quarter (92 emails compared to 20) 751 issues opened in JIRA, past quarter (7% increase) 474 issues closed in JIRA, past quarter (no change) 1117 commits in the past quarter (no change) 176 code contributors in the past quarter (-12% decrease) 841 PRs opened on GitHub, past quarter (21% increase) 826 PRs closed on GitHub, past quarter (13% increase)
## Description: The mission of Apache Airflow is the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines ## Issues: * There are no issues requiring board attention ## Membership Data: Apache Airflow was founded 2018-12-19 (9 months ago) There are currently 28 committers and 17 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - No new PMC members. Last addition was Alex Van Boxel on 2018-12-19. - Felix Uellendall was added as committer on 2019-09-05 - Chao-Han Tsai was added as committer on 2019-08-17 ## Project Activity: * Two new releases have been made since the last report * A new logo has been designed and voted upon ## Community Health: * We started the user mailing list to reduce the amount of message on dev. It is not very active yet * The slack community is very active across many channels * We have grown to 922 contributors, with 198 active in the last quarter * A ridiculous 1081 commits have been made in the past quarter
## Description:
- Apache Airflow (or simply Airflow) is a platform to programmatically
author, schedule, and monitor workflows. When workflows are defined as
code, they become more maintainable, versionable, testable, and
collaborative. Use Airflow to author workflows as directed acyclic graphs
(DAGs) of tasks. The Airflow scheduler executes your tasks on an array of
workers while following the specified dependencies. Rich command line
utilities make performing complex surgeries on DAGs a snap. The rich user
interface makes it easy to visualize pipelines running in production, monitor
progress, and troubleshoot issues when needed.
## Issues:
- there are no issues requiring board attention at this time
## Activity:
- Increasing community engagement from several companies (e.g. Astronomer,
Google)
- Airflow has been accepted as part of Google's Summer of Docs. This is
effort coordinated by Aizhamal on Airflow's side.
- We received and addressed three vulnerability reports (two were the same
issue manifesting in different ways plus one duplicate.) in the 1.10.3
release: CVE-2019-0216, CVE-2019-0229. We also received a duplicate report
after the release.
## Health report:
- We have grown from 743 to 807 contributors since our last report. Many only
submit one small fix and don't commit further.
- We have invited a 7 new committers (and confirmed) since our last report.
- 158 commits have made to the 1.10 release branch since our last release[1]
- 339 commits to master branch (which will become Airflow 2.0.0) since our
last report
- We have started planning a roadmap for Airflow 2.0
## PMC changes:
- Currently 17 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Alex Van Boxel on Wed Dec 19 2018
## Committer base changes:
- Currently 26 committers.
- New commmitters:
- Aizhamal Nurmamat kyzy was added as a committer on Thu May 30 2019
- Bas Harenslak was added as a committer on Mon Apr 22 2019
- Daniel Imberman was added as a committer on Tue Mar 19 2019
- Joshua Carp was added as a committer on Tue Apr 30 2019
- Kamil Breguła was added as a committer on Fri May 03 2019
- Kevin Yang was added as a committer on Tue Apr 30 2019
- Jarek Potiuk was added as a committer on Thu Apr 18 2019
## Releases:
- 1.10.3 was released on Wed Apr 10 2019
## Mailing list activity:
- users mailinglist was just opened up
- users@airflow.apache.org:
- 36 subscribers (up 36 in the last 3 months):
- 4 emails sent to list (0 in previous quarter)
- dev@airflow.apache.org:
- 598 subscribers (up 19 in the last 3 months):
- 884 emails sent to list (616 in previous quarter)
## JIRA activity:
- 644 JIRA tickets created in the last 3 months
- 507 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache Airflow (or simply Airflow) is a platform to programmatically
author, schedule, and monitor workflows. When workflows are defined as
code, they become more maintainable, versionable, testable, and
collaborative. Use Airflow to author workflows as directed acyclic graphs
(DAGs) of tasks. The Airflow scheduler executes your tasks on an array of
workers while following the specified dependencies. Rich command line
utilities make performing complex surgeries on DAGs a snap. The rich user
interface makes it easy to visualize pipelines running in production, monitor
progress, and troubleshoot issues when needed.
## Issues:
- there are no issues requiring board attention at this time
## Activity:
- New committer added: Xiaodong Deng
- Healthy discussions on the mailinglist around DAG serialization
## Health report:
- We have grown from 712 to 743 contributors since our last report. We do
monitor for potential committers, but we also see a lot of "hit and run"
contributors that particularly add to the 'periphery' of our code.
- Since latest release 1058 commits have been made
## PMC changes:
- Currently 17 PMC members.
- No new PMC members added in the last 3 months
## Committer base changes:
- Currently 19 committers.
- Xiaodong Deng was added as a committer on Sat Mar 09 2019
## Releases:
- 1.10.2 was released on Tue Jan 22 2019
## Mailing list activity:
- dev@airflow.apache.org:
- 578 subscribers (up 0 in the last 3 months):
- 665 emails sent to list (757 in previous quarter)
## JIRA activity:
- 578 JIRA tickets created in the last 3 months
- 420 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache Airflow (or simply Airflow) is a platform to programmatically
author, schedule, and monitor workflows. When workflows are defined as
code, they become more maintainable, versionable, testable, and
collaborative. Use Airflow to author workflows as directed acyclic graphs
(DAGs) of tasks. The Airflow scheduler executes your tasks on an array of
workers while following the specified dependencies. Rich command line
utilities make performing complex surgeries on DAGs a snap. The rich user
interface makes it easy to visualize pipelines running in production,
monitor progress, and troubleshoot issues when needed.
## Issues:
## Activity:
- Most of our assets have been moved to TL. We might have some remnants here
and there, which we try to track down
- We released a new version (1.10.2)
- We are in the process (or have done so) in promoting one of the
contributors to committer.
- We are, measured by GitHub stars, the most popular project for data
orchestration comparing Apache Oozie, Spotify's Luigi, Pinterest's Pinball
and LinkedIn's Azkaban
- Note: Apologies for not responding to the question by posting comments, it
was unclear how this worked
## Health report:
- We have grown from 674 to 712 contributors since our last report. We do
monitor for potential committers, but we also see a lot of "hit and run"
contributors that particularly add to the 'periphery' of our code.
- Since the 1.10.2 release 914 commits have been made
## PMC changes:
- Currently 17 PMC members.
- No new PMC members added in the last 3 months
## Committer base changes:
- Currently 18 committers.
- In process of adding one.
## Releases:
- 1.10.2 was released on Tue Jan 22 2019
## Mailing list activity:
- dev@airflow.apache.org:
- 576 subscribers (up 5 in the last 3 months):
- 660 emails sent to list (883 in previous quarter)
## JIRA activity:
- 545 JIRA tickets created in the last 3 months
- 383 JIRA tickets closed/resolved in the last 3 months
## Description:
- Apache Airflow (or simply Airflow) is a platform to programmatically
author, schedule, and monitor workflows. When workflows are defined as
code, they become more maintainable, versionable, testable, and
collaborative. Use Airflow to author workflows as directed acyclic graphs
(DAGs) of tasks. The Airflow scheduler executes your tasks on an array of
workers while following the specified dependencies. Rich command line
utilities make performing complex surgeries on DAGs a snap. The rich user
interface makes it easy to visualize pipelines running in production,
monitor progress, and troubleshoot issues when needed.
## Issues:
## Activity:
- Apache Airflow just graduated from the incubator. We are in the process of
moving our assets to top level.
## Health report:
- We have grown from 580 contributors to 674 since October 2018
- Since the November release 729 commits have been made
## PMC changes:
- Currently 17 PMC members.
- No new PMC members added in the last 3 months
## Committer base changes:
- Currently 18 committers.
- No changes (the PMC was established in the last 3 months)
## Releases:
- Latest release, v1.10.1, is from November 2018. This was during incubation.
## Mailing list activity:
- dev@airflow.apache.org:
- 578 subscribers (up 24 in the last 3 months)
## JIRA activity:
- 476 JIRA tickets created in the last 3 months
- 325 JIRA tickets closed/resolved in the last 3 months
WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to workflow automation and scheduling that can be used to author and manage data pipelines. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache Airflow Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Airflow Project be and hereby is responsible for the creation and maintenance of software related to workflow automation and scheduling that can be used to author and manage data pipelines; and be it further RESOLVED, that the office of "Vice President, Apache Airflow" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Airflow Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Airflow Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Airflow Project: * Alex Guziel <saguziel@apache.org> * Alex Van Boxel <alexvanboxel@apache.org> * Arthur Wiedmer <arthur@apache.org> * Ash Berlin-Taylor <ash@apache.org> * Bolke de Bruin <bolke@apache.org> * Chris Riccomini <criccomini@apache.org> * Dan Davydov <davydov@apache.org> * Fokko Driesprong <fokko@apache.org> * Hitesh Shah <hitesh@apache.org> * Jakob Homan <jghoman@apache.org> * Jeremiah Lowin <jlowin@apache.org> * Joy Gao <joygao@apache.org> * Kaxil Naik <kaxilnaik@apache.org> * Maxime Beauchemin <maximebeauchemin@apache.org> * Siddharth Anand <sanand@apache.org> * Sumit Maheshwari <msumit@apache.org> * Tao Feng <tfeng@apache.org> NOW, THEREFORE, BE IT FURTHER RESOLVED, that Bolke de Bruin be appointed to the office of Vice President, Apache Airflow, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache Airflow Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Airflow podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Airflow podling encumbered upon the Apache Incubator Project are hereafter discharged. Special Order 7F, Establish the Apache Airflow Project, was approved by Unanimous Vote of the directors present.
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. Once we make a release with the licensing fix we will move forward with
graduation.
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
No!
How has the community developed since the last report?
1. Since our last podling report 1 month ago (i.e. between September 4 &
October 1, inclusive), we grew our contributors from 548 to 580 (32 new
contributors)
2. Since our last podling report 1 month ago (i.e. between September 4 &
October 1, inclusive), we resolved 151 pull requests (currently at 3114
closed PRs)
3. Since being accepted into the incubator, the number of companies
officially using Apache Airflow has risen from 193 to 206, 13 new from
the last podling report 1 month ago.
How has the project developed since the last report?
See above : 151 PRs resolved, 32 new contributors, & 13 new companies
officially using it.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[x] Nearing graduation
[ ] Other:
Date of last release:
2018-08-27
When were the last committers or PPMC members elected?
Tao Feng on Aug 3
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
One of our mentors is pretty active and helpful, one of our mentors has
never been involved, and one is in the middle.
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[x](airflow) Hitesh Shah
Comments:
[x](airflow) Jakob Homan
Comments:
IPMC/Shepherd notes:
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1.Once we make a release with the licensing fix we will move forward
with graduation.
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of? None
How has the community developed since the last report?
1. Since our last podling report 1 month ago (i.e. between August 5 &
September 4, inclusive), we grew our contributors from 512 to 548 (36 new
contributors)
2. Since our last podling report 1 month ago (i.e. between August 5 &
September 4, inclusive), we resolved 129 pull requests (currently at 2963
closed PRs)
3. Since being accepted into the incubator, the number of companies
officially
using Apache Airflow has risen from 30 to 193, 10 new from the last
podling report 1 month ago.
How has the project developed since the last report?
See above : 129 PRs resolved, 36 new contributors, & 10 new companies
officially using it. We also released 1.10.0, our 4th Apache Release while
in the incubator as seen on https://pypi.org/project/apache-airflow/ #history
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[x] Nearing graduation
[ ] Other:
Date of last release:
2018-08-27
When were the last committers or PPMC members elected?
Kaxil Naik on May 7 & Tao Feng on Aug 3
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[ ](airflow) Hitesh Shah
Comments:
[x](airflow) Jakob Homan
Comments:
IPMC/Shepherd notes:
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1.Once we make a release with the licensing fix we will move forward with
graduation.
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of? None
How has the community developed since the last report?
1. Since our last podling report 5 months ago (i.e. between March
28 & August 5, inclusive), we grew our contributors from 427 to 512
2. Since our last podling report 5 months ago (i.e. between March
28 & August 5, inclusive), we resolved 554 pull requests (currently at
2834 closed
PRs)
3. Since being accepted into the incubator, the number of companies
officially
using Apache Airflow has risen from 30 to 183, 34 new from the last
podling
report 5 months ago.
How has the project developed since the last report?
See above : 554 PRs resolved, 85 new contributors, & 34 new companies
officially using it. We have also added 2 new committers : Kaxil Naik on
May 7 & Tao Feng on Aug 3.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[x] Nearing graduation
[ ] Other:
Date of last release:
2017-12-15
When were the last committers or PPMC members elected?
2 new committers : Kaxil Naik on May 7 & Tao Feng on Aug 3
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[ ](airflow) Hitesh Shah
Comments:
[ ](airflow) Jakob Homan
Comments:
IPMC/Shepherd notes:
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. Once we make a release with the licensing fix we will move forward with
graduation.
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
None
How has the community developed since the last report?
1. Since our last podling report 1.5 months ago (i.e. between Feb 8 & March
28, inclusive), we grew our contributors from 375 to 427
2. Since our last podling report 1.5 months ago (i.e. between Feb 8 & March
28, inclusive), we resolved 152 pull requests (currently at 2280 closed
PRs)
3. Since being accepted into the incubator, the number of companies officially
using Apache Airflow has risen from 30 to 149, 17 new from the last podling
report 1.5 months ago.
How has the project developed since the last report?
See above : 152 PRs resolved, 52 new contributors, & 17 new companies
officially using it.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[x] Nearing graduation
[ ] Other:
Date of last release:
2018-01-02
When were the last committers or PPMC members elected?
2017-11-30 joygao a.k.a Joy Gao (committer/PMC)
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[x](airflow) Hitesh Shah
Comments:
[x](airflow) Jakob Homan
Comments: Ready for graduation
IPMC/Shepherd notes:
I checked into the licensing issue and it is resolved, but it seems that a
release will be needed before graduation. Dave Fisher
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. We have had 4 releases and are working toward our 5th. We are getting better at releases.
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
1. We had our forth official release 1.9.0 on Jan 2, 2018.
2. Since our last podling report 4 months ago (i.e. between Sept 25 & Feb 8,
inclusive), we grew our contributors from 315 to 385
3. Since our last podling report 4 months ago (i.e. between Sept 25 & Feb 8,
inclusive), we resolved 331 pull requests (currently at 2128 closed PRs)
4. Since being accepted into the incubator, the number of companies officially
using Apache Airflow has risen from 30 to 132, 18 new from the last podling
report.
How has the project developed since the last report?
See above : 331 PR resolved, 70 new contributors, & 18 new companies
officially using it.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[x] Nearing graduation
[ ] Other:
Date of last release:
2018-01-02
When were the last committers or PPMC members elected?
2017-11-30 joygao a.k.a Joy Gao (committer/PMC)
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[x](airflow) Hitesh Shah
Comments:
[x](airflow) Jakob Homan
Comments: Ready for graduation
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. We are working on our 4th apache release 1.9.0 and are getting better at releases
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
1. We had our third official release 1.8.2 on Aug 7th 2017.
2. Since our last podling report 3 months ago (i.e. between July
5 & Sept 25, inclusive), we grew our contributors from 280 to 315
4. Since our last podling report 3 months ago (i.e. between July
5 & Sept 25, inclusive), we resolved 167 pull requests (currently at 1797 closed
PRs)
5. Since being accepted into the incubator, the number of companies
officially using Apache Airflow has risen from 30 to 114, 16 new from the last podling report.
How has the project developed since the last report?
See above : 167 PR resolved, 35 new contributors, & 16 new companies officially using it.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[x] Nearing graduation
[ ] Other:
Date of last release:
2017-08-07
When were the last committers or PPMC members elected?
2017-01-01 fokko a.k.a Fokko Driespong (committer/PMC)
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[x](airflow) Hitesh Shah
Comments:
[ ](airflow) Jakob Homan
Comments:
IPMC/Shepherd notes:
A quick look at this month's email and it looks like Airflow is ready to graduate.
Dave Fisher
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. We are working on our third apache release 1.8.2 to get more experience
with the process
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
1. We had our second official release. 1.8.1 on May 9th 2017.
2. Since our last podling report 3 months ago (i.e. between Apr 1 and July
5, inclusive), we grew our contributors from 256 to 280
4. Since our last podling report 3 months ago (i.e. between Apr 1 and July
5, inclusive), we resolved 151 pull requests (currently at 1630 closed
PRs)
5. A new meet-up group formed in Tokyo, Japan - they held their first
meet-up on May 11.
6. Since being accepted into the incubator, the number of companies
officially using Apache Airflow has risen from 30 to 98, 15 new from
last podling report.
How has the project developed since the last report?
See above : 151 PR resolved, 24 new contributors, & 15 new companies
officially using it.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[x] Nearing graduation
[ ] Other:
Date of last release:
2017-05-09
When were the last committers or PPMC members elected?
As mentioned on
https://cwiki.apache.org/confluence/display/AIRFLOW/Announcements#Announcements-Mar14,2017
Alex Guziel joined the Apache Airflow PPMC/Committer group.
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[X](airflow) Hitesh Shah
Comments:
[ ](airflow) Jakob Homan
Comments:
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. We are working on our second apache release 1.8.1 to get more experience
with the process
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
1. We had our first official release. 1.8.0 on March 19th 2017.
2. We elected 1 new PPMC Member/Committer: Alex Guziel (a.k.a saguziel)
3. Since our last podling report 3 months ago (i.e. between Jan 1 and Mar
31, inclusive), we grew our contributors from 224 to 256
4. Since our last podling report 3 months ago (i.e. between Jan 1 and Mar
31, inclusive), we resolved 216 pull requests (currently at 1479 closed
PRs)
5. Three meet-ups, one in San Francisco, CA hosted by Clover Health, one in
New York, NY hosted by Blue Apron and one in San Jose, CA hosted by PayPal
were held by the community.
6. Since being accepted into the incubator, the number of companies
officially using Apache Airflow has risen from 30 to 83.
How has the project developed since the last report?
1. As noted above, 216 pull requests were merged since our last report
(i.e. between Jan 1 and Mar 31, inclusive).
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[X] Nearing graduation
[ ] Other:
The Airflow community continues to grow, and we have successfully created
our first Apache release. We want to continue on this momentum and create
another release to solidify our process and tools around it, but we feel
we are nearing graduation. We are open to feedback and guidance to make
sure we can do so.
Date of last release:
2017-03-19
When were the last committers or PPMC members elected?
As mentioned on
https://cwiki.apache.org/confluence/display/AIRFLOW/Announcements#Announcements-Mar14,2017
Alex Guziel joined the Apache Airflow PPMC/Committer group.
Signed-off-by:
[ ](airflow) Chris Nauroth
Comments:
[x](airflow) Hitesh Shah
Comments:
[x](airflow) Jakob Homan
Comments:
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. Getting an Apache release out
2.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
1. We elected 1 new PPMC Member/Committer : Alex Van Boxel a.k.a.
alexvanboxel
2. Since our last podling report 3 months ago (i.e. between Oct 4 and Dec
31, inclusive), we grew our contributors from 191 to 224
3. Since our last podling report 3 months ago (i.e. between Oct 4 and Dec
31, inclusive), we resolved 202 pull requests (currently at 1263 closed
PRs)
4. One meet-up, hosted at WePay, was held by the community
5. Since being accepted into the incubator, the number of companies
officially using Apache Airflow has risen from 30 to 74
How has the project developed since the last report?
See above
Date of last release:
None. First ASF release currently being discussed.
When were the last committers or PPMC members elected?
As mentioned on
https://cwiki.apache.org/confluence/display/AIRFLOW/Announcements#Announcements-Nov28,2016,
Alex Van Boxel joined the Apache Airflow PPMC/Committer group.
Signed-off-by:
[X](airflow) Chris Nauroth
[x](airflow) Hitesh Shah
[ ](airflow) Jakob Homan
Airflow is a workflow automation and scheduling system that can be used to author and manage data pipelines. Airflow has been incubating since 2016-03-31. Three most important issues to address in the move towards graduation: 1. Getting an Apache release out 2. 3. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? We discovered a private Gitter channel for committers that was created during the days when the Git project was owned by Airbnb. When the Github project’s ownership moved to the ASF, so did that of all the Gitter channels. We killed the channel - all committers left the channel and can no longer even see/discover it. How has the community developed since the last report? 1. We elected 2 new PPMC Members/Committers (Li Xuanji a.k.a. Zodiac & Sumit Maheshwari a.k.a. msumit) 2. Since our last podling report 3 months ago (i.e. between Jul 7 and Oct 4, inclusive ), we grew our contributors from 160 to 191 3. Since our last podling report 3 months ago (i.e. between Jul 7 and Oct 4, inclusive ) , we merged >142 pull requests 4. Two meet-ups (One for HUG Warsaw, the other an Airflow meet-up @Stripe HQ in SF) and several public talks (e.g. DataDaySeattle, PyData SF) were held by the community 5. Since being accepted into the incubator, the number of companies using Apache Airflow has risen from 30 to 58 How has the project developed since the last report? 1. Podling name search approved : https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-110 2. Very active discussion list, public Gitter channels and JIRA (more than 500 issues) Date of last release: None. First ASF release currently being discussed. When were the last committers or PMC members elected? As mentioned on https://cwiki.apache.org/confluence/display/AIRFLOW/Announcements, 1. On Aug 16, Sumit Maheshwari (a.k.a. msumit) was elected to the PPMC and Committer group 2. On Aug 19, Li Xuanji (a.k.a. zodiac) was elected to the PPMC and Committer group Signed-off-by: [x](airflow) Chris Nauroth [x](airflow) Hitesh Shah [x](airflow) Jakob Homan
Airflow is a workflow automation and scheduling system that can be used to author and manage data pipelines. Airflow has been incubating since 2016-03-31. Three most important issues to address in the move towards graduation: 1. Getting an Apache release out. 2. Podling name search has to happen. 3. Verify distribution rights Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? We've done a lot of work on distribution rights (3), but we need to wrap it up. We've been pushing out our release due to stability concerns and the need for a testing framework How has the community developed since the last report? - Since our last podling report 1 month ago, we grew our contributors from 148 to 160. - In June 2016 we had 56 commits. - We organized a meet up at WePay. We also had one before at Airbnb. - We had several committers meetings. - 1 new committer. 2 offers were given but 1 was declined. How has the project developed since the last report? - Migrated all files to contain Apache 2.0 license headers. - Replaced charting library that was non-Apache 2.0 compliant (a large effort). - Release Airflow incubator website, and added appropriate branding and disclaimers. Date of last release: None (had a non-Apache release on 2016-06-13)* * Release was discussed and approved here: https://mail-archives.apache.org/mod_mbox/incubator-general/201605.mbox/%3CEF1D08AF-80DD-4614-BC74-BBCED9251BE1@gmail.com%3E When were the last committers or PMC members elected? 2016-05-20 Signed-off-by: [X](airflow) Chris Nauroth [x](airflow) Hitesh Shah [x](airflow) Jakob Homan
Airflow is a workflow automation and scheduling system that can be used to
author and manage data pipelines.
Airflow has been incubating since 2016-03-31.
Three most important issues to address in the move towards graduation:
1. Releases
2. Grow up user and contributor communities
3. Improve and extend documentation and samples on the website
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
* Since our last podling report 1 month ago, we grew
our contributors from 137 to 148
* Since our last podling report 1 month ago, we
accepted/merged 51 PRs
* We voted on the following matters according to Apache guidelines:
* We voted to make all current and future committers part of the PPMC
* We voted in a new committer and PPMC member : Steven Yvinec-Kruyk and
he accepted
* We voted in a commit policy of "RTC with a +1 vote from a committer
other than the author (assuming no vetos)"
How has the project developed since the last report?
* All resources have been created and all migrations are complete - code
donation included
* The website is in progress
Date of last release:
N/A - we are still working out releases as we are new to Apache.
When were the last committers or PMC members elected?
On May 20, 1 committer/PPMC member(Steven Yvinec-Kruyk) was elected and he
accepted.
Signed-off-by:
[X](airflow) Chris Nauroth
[x](airflow) Hitesh Shah
[x](airflow) Jakob Homan
Airflow is a workflow automation and scheduling system that can be used to author and manage data pipelines. Airflow has been incubating since 2016-03-31. Three most important issues to address in the move towards graduation: 1. Continued releases 2. Grow up user and contributor communities 3. Improve and extend documentation and samples on the website Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None How has the community developed since the last report? * Since we applied to the incubator in March 17 (proposal email), we grew our contributors from 100 to 137 * Since we applied to the incubator in March 17 (proposal email), we accepted/merged 119 PRs * Dev mailing lists activity increased How has the project developed since the last report? * All resources have been created (website, Jira, git & github mirror, ...) but not all migrations are complete * The code donation (and Pull Request migration) is in progress * The website is in progress * The previous wiki has been migrated to confluence, Jira is now used instead of the old Github issues, and the old google group is being EOLd on May 2 as users migrate to the dev mailing list Date of last release: N/A - we are still working out releases as we are new to Apache. When were the last committers or PMC members elected? N/A - we are still new to Apache and have not gotten to the point of electing new committers/PMC members. Signed-off-by: [ ](airflow) Chris Nauroth [X](airflow) Hitesh Shah [x](airflow) Jakob Homan