Community-led development "The Apache Way"
This was extracted (@ 2021-07-21 23:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Report was filed, but display is awaiting the approval of the Board minutes.
Report was filed, but display is awaiting the approval of the Board minutes.
## Description: Apache DolphinScheduler is a distributed, extensible visual Big Data workflow scheduler system. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache DolphinScheduler was founded 2021-03-17 (2 months ago) There are currently 32 committers and 16 PMC members in this project. The Committer-to-PMC ratio is 2:1. Community changes, past quarter: - Calvin Kirs was added to the PMC on 2021-05-07 - Shiwen Cheng was added as committer on 2021-04-01 - Chong Zhuang was added as committer on 2021-04-09 ## Project Activity: DolphinScheduler 1.3.6 was released on 2021-04-28. Contributors are working on an architecture refactoring for DolphinScheduler - version 2.0 ## Community Health: We will hold a global online co-meetup outside of China for the first time on May 15 with the Apache ShardingSphere community. We are working hard to build a global community, we created slack workspace and some instant talks move to slack channel, and we also create tag as apache-dolphinscheduler on stackoverflow. 434 PRs opened on GitHub, past quarter (no change) 436 PRs closed on GitHub, past quarter (no change) 307 issues opened on GitHub, past quarter (-14% change) 352 issues closed on GitHub, past quarter (-8% change) dev@dolphinscheduler.apache.org had a 48% decrease in traffic in the past quarter (138 emails compared to 261)
## Description: Apache DolphinScheduler is a distributed, extensible visual Big Data workflow scheduler system. As a distributed and extensible data workflow scheduler platform with rich directed acyclic graph (DAG) visual interfaces, DolphinScheduler solves complex task dependencies and triggers in the data pipeline. Out-of-the-box, its easy-to-extend processing connects numerous systems to 100,000-level data task scheduling. Apache DolphinScheduler is: - Cloud Native — support multi-cloud/data center workflow management, also supports Kubernetes, Docker deployment and custom task types, distributed scheduling, with overall scheduling capability increased linearly with the scale of the cluster - Highly Reliable — decentralized multi-master and multi-worker, high availability, supported by itself, overload processing - User-Friendly — all process definition operations are visualized, defines key information at a glance, one-click deployment - Supports Rich Scenarios — includes streaming, pause, recover operation, multi-tenant, and additional task types such as spark, hive, mr, shell, python, flink, sub_process, and more. ## Issues: There are no issues requiring board attention at this time. ## Membership Data: 2019-08-29 - Apache DolphinScheduler was accepted as Incubator project. 2021-03-17 - Apache DolphinScheduler graduated as a Top-Level Project. There are currently 32 committers and 15 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. Community changes, past quarter: - No new PMC members (project graduated recently). - Shiwen Cheng was added as committer on 2021-04-01. - Chong Zhuang was added as committer on 2021-04-09. ## Project Composition Sections: MasterServer ----- master service WorkerServer ----- worker service LoggerServer ----- logger service ApiApplicationServer ----- api service AlertServer ----- alert service ## Project Activity: DolphinScheduler 1.3.5 was released on 2021-02-14. Apache DolphinScheduler 1.3.6 is in the process of releasing voting process. this version contained some new features, some important features like `Support task scalability on K8s such as Spark, Flink and DataX`,`Support turning off sudo permissions` and so on. this version also fix some bugs. now we are also focusing on trying to prepare the big release of 2.0.0, this will take a long time to finalize.we have discussed a lot and the work have begun, 2.0 looks to achieve these goals: - First goal was `Complete Workflow DAG json split` - Second goal was `Task plug-in SPI, support extended task types` - Third goal was `Master refactor and add coordinator module` ## Community Health: we are electing new PMC member. mails to dev mailing list had a 20% decrease in the past quarter(204 emails). 662 commits in the past quarter (28% increase). 78 code contributors in the past quarter (5% increase). 517 PRs opened on GitHub in past quarter (82% increase). 505 PRs closed on GitHub in past quarter (72% increase). 337 issues opened on GitHub in past quarter (no change). 373 issues closed on GitHub in past quarter (17% decrease).
WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache DolphinScheduler Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache DolphinScheduler be and hereby is responsible for the creation and maintenance of software related to a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces; and be it further RESOLVED, that the office of "Vice President, Apache DolphinScheduler" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache DolphinScheduler Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache DolphinScheduler Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache DolphinScheduler Project: * Leon Bao <leonbao@apache.org> * Wu Baoqi <baoqiwu@apache.org> * Lidong Dai <lidongdai@apache.org> * Jun Gao <gaojun2048@apache.org> * ZijJian Gong <millionfor@apache.org> * Guo Jiwei <technoboy@apache.org> * Furkan Kamaci <kamaci@apache.org> * Gang Li <lgcareer@apache.org> * Liang Chen <chenliang613@apache.org> * Xiaochun Liu <liuxiaochun@apache.org> * Kevin Ratnasekera <djkevincr@apache.org> * Shao Feng Shi <shaofengshi@apache.org> * Guo William <guowei@apache.org> * Sheng Wu <wusheng@apache.org> * Qiao Zhanwei <journey@apache.org> NOW, THEREFORE, BE IT FURTHER RESOLVED, that Lidong Dai be appointed to the office of Vice President, Apache DolphinScheduler, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache DolphinScheduler Project be and hereby is tasked with the migration and rationalization of the Apache Incubator DolphinScheduler podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator DolphinScheduler podling encumbered upon the Apache Incubator PMC are hereafter discharged. Special Order 7A, Establish the Apache DolphinScheduler Project, was approved by Unanimous Vote of the directors present.
DolphinScheduler is a distributed ETL scheduling engine with powerful DAG
visualization interface..
DolphinScheduler has been incubating since 2019-08-29.
### Three most important unfinished issues to address before graduating:
None
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. GitHub code contributors grew from 136 to 169.
2. Raise a discussion about graduation and do preparation.
### How has the project developed since the last report?
1. Apache Dolphin Scheduler 1.3.3, 1.3.4 has released. 1.3.5 is ready for
voting next week.
2. Discuss Apache Dolphin Scheduler 2.0 architecture.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-12-31
### When were the last committers or PPMC members elected?
2020-10-27
### Have your mentors been helpful and responsive?
Our mentors were very helpful, help us in graduation progress.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments: Glad to see the community is closing the graduation.
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [ ] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Guide community to commit code and code review using Apache way.
2. Develop more committers and contributors.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
#### How has the community developed since the last report?
1. GitHub code contributors grew from 116 to 136. two new Committers join
the community.
2. Hold a co-meetup with Apache Pulsar and 1500+ viewers join the on-line
meetup on September, 5.
3. PPMC William Guo Wei share the story about open source on the Apache
Local Community Beijing meetup.
4. PPMC William Guo Wei attend the Apache Roadshow-China and give the
session about 'how to build the community from 0 to 1'
### How has the project developed since the last report?
1. Maven Plugin 1.0.0 has released.
2. Apache Dolphin Schedule1.3.2 has released and 1.3.3 is ready for
releasing.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-09-01
### When were the last committers or PPMC members elected?
2020-10-27
### Have your mentors been helpful and responsive?
Our mentors were very helpful, help us to refine release process and how
to release a plug-in.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments:
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [ ] (dolphinscheduler) Liang Chen
Comments:
- [ ] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
DolphinScheduler is a distributed ETL scheduling engine with powerful DAG
visualization interface..
DolphinScheduler has been incubating since 2019-08-29.
### Three most important unfinished issues to address before graduating:
1.Guide community to commit code and code review using Apache way.
2.Develop more committers and contributors.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. GitHub code contributors grew from 100 to 116.
2. Hold a co-meetup with Apache Doris and 1900 people join the on-line
meetup on July, 25.
### How has the project developed since the last report?
1. Apache Dolphin Schedule1.3.1 has released and 1.3.2 is ready for
voting.
2. Maven Plugin 1.0.0 is in voting progress.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-7-13
### When were the last committers or PPMC members elected?
2019-5-28
### Have your mentors been helpful and responsive?
Our mentors were very helpful, help us to refine release process and how
to release a plug-in.
### Is the PPMC managing the podling's brand / trademarks?
Yes. We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments:
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Guide community to commit code and code reivew using Apache way.
2. Develop more commiters and contributors.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Github code contributors grew from 86 to 100, and document contributor
grew to 27.
2. Dolphin Scheduler's users wrote their success use case and spread on
Internet.
3. Hold a live telecast about new feature of Dolphin Scheduler with local
media, and about 400 people join the on-line event.
### How has the project developed since the last report?
1. License re-check due to find a conflicts code license announcement by
contributor.
2. 1.3.1 was ready to release.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-2-24
### When were the last committers or PPMC members elected?
2020-5-28
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our progress on restruction.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments: Good to see some PPMC member could identify the LICENSE issue even after release.
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [ ] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Develop more committers and contributors.
2. Polish the document and let user more easily to find their questions.
3. Guide community discuss more complicated topic via e-mail instead of
other channel.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. 5 committers was voted.
2. Github code contributors grew from 77 to 86.
3. Organized 1 on-line communication about Apache Dolphin Scheduler 1.3,
about 700 people watch the program and a few of them asked questions.
### How has the project developed since the last report?
1. Support DATAx,sqoop tranfomation and Apache Ambari plug-in
installation.
2. Support condition module on etl process.
3. Support K8s deployment.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-2-24
### When were the last committers or PPMC members elected?
2020-5-28
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our progress on restruction.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments:
- [X] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Develop more committers and contributors.
2. Polish the document and let user more easily to find their questions.
3. Guide community discuss more complicated topic via e-mail instead of
other channel.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Github code contributors grew from 71 to 77.
2. Voted 2 PPMC and voting for 5 committers.
### How has the project developed since the last report?
1. Still refactoring worker architecture for better performance and
augmentability.
2. Working for new feature about new data connectors for more data source.
3. Add "condition" module in the work-flow unit.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-2-24
### When were the last committers or PPMC members elected?
2020-4-23
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our progress on restruction.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments:
- [X] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Develop more committers and contributors. 2. Make the architecture easily to expand for plug-ins. 3. Make intallation more easily to use. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. Github code contributors grew from 62 to 71. 2. More articles were written by users and contributors initiatively. ### How has the project developed since the last report? 1. Support Apache Ambari install and DataX data ETL. 2. Refactor worker architecture for better performance and augmentability. 3. Add resource management tree structure. ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [ ] Working towards first release - [X] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: 2020-2-24 ### When were the last committers or PPMC members elected? 2020-1-24 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our progress on restruction. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [X] (dolphinscheduler) Sheng Wu Comments: - [ ] (dolphinscheduler) ShaoFeng Shi Comments: - [X] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan Comments: - [X] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Develop more committers and contributors. 2. Make development document more easily to read. 3. make E-mail as an official discussion tool in our communities. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. New committers is active in answer Jira issue and other contributions. 2. More articles were written by users and contributors initiatively. ### How has the project developed since the last report? 1. Apache 1.2.1 without WIP has been released. 2. Restructure the Master/Worker model for easily to expand. 3. Refine CI/CD process for more contributors easily to join. ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [ ] Working towards first release - [X] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: 2020-2-24 ### When were the last committers or PPMC members elected? 2020-1-24 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our progress on restruction. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [x] (dolphinscheduler) Sheng Wu Comments: - [ ] (dolphinscheduler) ShaoFeng Shi Comments: - [x] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan KAMACI Comments: - [x] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Make first no-WIP Apache releases. (in progress) 2. Make development document more easily to read 3. Develop more committers and contributors. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. Developed 7 more committers, commiters grew from 15 to 22. 2. More than 10 experienced users grew to be active contributors. 3. E-mail is popular between developers on serious topic discussion. ### How has the project developed since the last report? 1. Apache 1.2.0 with WIP has been released while non-WIP 1.2.1 version was ready to vote. 2. Substantially reduced config file and options to make the project easy to install 3. Modified CSS JS code to follow Apache license ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [ ] Working towards first release - [X] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: 2020-1-2 ### When were the last committers or PPMC members elected? 2020-1-24 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our firtst Apache Release. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [X] (dolphinscheduler) Sheng Wu Comments: - [X] (dolphinscheduler) ShaoFeng Shi Comments: - [X] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan KAMACI Comments: - [x] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes: Justin Mclean: For an active project there is very list email on the devlist. Can you provide some insight to why this might be? Is conversation and planning happening off list?
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Make first Apache releases. (In 3rd round voting progress) 2. Develop more committers and contributors. 3. Clean up the license issue on JS lib. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. Developed 13 more contributors from 42 to 55 who contributes codes to github. 2. Successfully held a co-meetup with Sharding Sphere in Dec, 8th in Beijing, more than 70 people attended the meet up. 3. E-mail discussion was accepted by community step by step: about 9 proposals and many discussion were communicated by e-mail since the training on the last meet-up. 4. Many contributors were developed and found while overcoming the difficulty on Apache release, and some of them would be voted to committers next month. ### How has the project developed since the last report? 1. Apache 1.2.0 release was still in progress. Committers fix the commercial problems on fonts and icons, and was cleaning up the dependencies on JS libs. 2. Formal auto CI/CD was accepted by community with UT 60%. 3. 1.2.x was developing and there is a proposal to refactor some key part of the project for better concurrent performance. ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [x] Working towards first release - [ ] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: No answer. ### When were the last committers or PPMC members elected? 2019-11-11 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our first Apache Release. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [x] (dolphinscheduler) Sheng Wu Comments: Mail list communications become more active. Good to see this. - [ ] (dolphinscheduler) ShaoFeng Shi Comments: - [X] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan KAMACI Comments: - [X] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Make first Apache releases. (In voting progress)
2. Appeal more users and contributors.
3. Make more interactive e-mail discussion besides github, wechat
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Now there are 42 external contributors, keep the same as November.
2. 2 committers were voted to join Dolphin Scheduler committers group
last month, and there is a plan to vote 3-4 more committers next month.
3. 131 users subscribed the mail(from 67 subscribers) of dev and
dev-notification and we got 113 mails formal discussions（from about 60
mails).
4. There is a plan to hold a co-meetup with Sharding Sphere in Dec, 8th
in Beijing.
### How has the project developed since the last report?
1. PPMC is voting for an Apache release 1.2.0 on Nov,27,which includes 9
features and 18 enhancements and bug fix.
2. Build a CI/CD base on Github actions.
3. Default DB is changed from MySQL to PostgreSQL.
4. 241 issues created，237 PRs merged .
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [ ] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
No answer.
### When were the last committers or PPMC members elected?
2019-11-11
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our first Apache Release, including first
time on CI/CD, license check, Apache checklist, and so on. Wu Sheng gave
us many useful advice.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments: Need more works on working in Apache way, especially remote
work mode, mail list discussion and decision. Good start for a new
project. Hope they are learning fast.
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
#### Three most important unfinished issues to address before graduating:
1. Make first Apache releases (In progress)
2. Fix the content of official website about Non-ASF release and notice.
3. Make more interactive e-mail discussion besides github, wechat
#### Are there any issues that the IPMC or ASF Board need to be aware of?
None
#### How has the community developed since the last report?
1. Now there are 42 external contributors besides 8 PPMC members who
contributes codes to github.
2. We held a offline Meetup in Shanghai. 5 Speakers (including 4 PPMC
member and 1 user) gave their presentation. 30 people came and 10
people online watch the meetup.
3. Github star grew from 2291 to 2648 in October.
4. Over 61 company users is willing to announce that he is using Dolphin
Scheduler:
<https://github.com/apache/incubator-dolphinscheduler/issues/57>
#### How has the project developed since the last report?
1. Solid Apache verson plan is created and we planed to start a Apahce
release in November.
2. Some new important feature developerd by contributor was merge to
project(Docker file, S3 support, Flink job support, job import/export,
etc.)
3. 178 issues created，181 PRs merged (from #932 to #1113) .
4. Developers and Contributors are steadily developing the project
<https://github.com/apache/incubator-dolphinscheduler/issues/690
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [ ] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
None.
### When were the last committers or PPMC members elected?
2019-8-29
### Have your mentors been helpful and responsive?
Yes, our mentors noticed some issue of DolphinScheduler and give useful
advice to PPMC especially on first Apache version. I want to thank
Wusheng for many good advice for community operation and Apache first
release.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments:
- [x] (dolphinscheduler) ShaoFeng Shi
Comments: LGTM
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dave Fisher: A good start. Please listen about labeling of non-Apache
Releases.
I'd like to see discussion on email threads on dev@ in addition to
announcements.
Listen to Sheng Wu regarding the branding of Events.
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. GPL license issue about MySQL.
2. Make first Apache releases.
3. Build the CI/CD process, which will help more developers to
participate in the contribution.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Now there are 30 external contributors on Github besides 8 PPMC
members who contributes codes to github.
2. Champion hold a on-line training about Apache release for Developer
and Committers
3. Github stars grew from 1700 to 2291 in September
4. Over 58 company users is willing to announce that he is using Dolphin
Scheduler: https://github.com/apache/incubator-dolphinscheduler/issues/57
### How has the project developed since the last report?
* Champoin setup project infra and PPMC member learned how to use the
infra.
* Our Apache website is constructed by a contributor name khadgarmage.
* 145 issues created, 55 issues resolved, 85 pull-requests committed.
* Developers and Contributors are steadily developing the project
https://github.com/apache/incubator-dolphinscheduler/issues/690
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [x] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
None
### When were the last committers or PPMC members elected?
2019-8-29
### Have your mentors been helpful and responsive?
Our mentors were amazingly helpful. They setup the project infra and give
us a online training about Apache release and help us to join the Apache
meetup in Shanghai. We learned a lot from our mentors about Apache Way.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments: Good start for a new project.
- [x] (dolphinscheduler) ShaoFeng Shi
Comments: Good start, keep going!
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [x] (dolphinscheduler) Kevin Ratnasekera
Comments: Good start indeed. I am happy to see the enthusiasm from
community in Apache process.
### IPMC/Shepherd notes: