Community-led development "The Apache Way"
This was extracted (@ 2020-10-11 16:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
DolphinScheduler is a distributed ETL scheduling engine with powerful DAG
visualization interface..
DolphinScheduler has been incubating since 2019-08-29.
### Three most important unfinished issues to address before graduating:
1.Guide community to commit code and code review using Apache way.
2.Develop more committers and contributors.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. GitHub code contributors grew from 100 to 116.
2. Hold a co-meetup with Apache Doris and 1900 people join the on-line
meetup on July, 25.
### How has the project developed since the last report?
1. Apache Dolphin Schedule1.3.1 has released and 1.3.2 is ready for
voting.
2. Maven Plugin 1.0.0 is in voting progress.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-7-13
### When were the last committers or PPMC members elected?
2019-5-28
### Have your mentors been helpful and responsive?
Our mentors were very helpful, help us to refine release process and how
to release a plug-in.
### Is the PPMC managing the podling's brand / trademarks?
Yes. We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments:
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Guide community to commit code and code reivew using Apache way.
2. Develop more commiters and contributors.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Github code contributors grew from 86 to 100, and document contributor
grew to 27.
2. Dolphin Scheduler's users wrote their success use case and spread on
Internet.
3. Hold a live telecast about new feature of Dolphin Scheduler with local
media, and about 400 people join the on-line event.
### How has the project developed since the last report?
1. License re-check due to find a conflicts code license announcement by
contributor.
2. 1.3.1 was ready to release.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-2-24
### When were the last committers or PPMC members elected?
2020-5-28
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our progress on restruction.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments: Good to see some PPMC member could identify the LICENSE issue even after release.
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [ ] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Develop more committers and contributors.
2. Polish the document and let user more easily to find their questions.
3. Guide community discuss more complicated topic via e-mail instead of
other channel.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. 5 committers was voted.
2. Github code contributors grew from 77 to 86.
3. Organized 1 on-line communication about Apache Dolphin Scheduler 1.3,
about 700 people watch the program and a few of them asked questions.
### How has the project developed since the last report?
1. Support DATAx,sqoop tranfomation and Apache Ambari plug-in
installation.
2. Support condition module on etl process.
3. Support K8s deployment.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-2-24
### When were the last committers or PPMC members elected?
2020-5-28
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our progress on restruction.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments:
- [X] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Develop more committers and contributors.
2. Polish the document and let user more easily to find their questions.
3. Guide community discuss more complicated topic via e-mail instead of
other channel.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Github code contributors grew from 71 to 77.
2. Voted 2 PPMC and voting for 5 committers.
### How has the project developed since the last report?
1. Still refactoring worker architecture for better performance and
augmentability.
2. Working for new feature about new data connectors for more data source.
3. Add "condition" module in the work-flow unit.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-2-24
### When were the last committers or PPMC members elected?
2020-4-23
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our progress on restruction.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [X] (dolphinscheduler) Sheng Wu
Comments:
- [X] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Develop more committers and contributors. 2. Make the architecture easily to expand for plug-ins. 3. Make intallation more easily to use. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. Github code contributors grew from 62 to 71. 2. More articles were written by users and contributors initiatively. ### How has the project developed since the last report? 1. Support Apache Ambari install and DataX data ETL. 2. Refactor worker architecture for better performance and augmentability. 3. Add resource management tree structure. ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [ ] Working towards first release - [X] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: 2020-2-24 ### When were the last committers or PPMC members elected? 2020-1-24 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our progress on restruction. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [X] (dolphinscheduler) Sheng Wu Comments: - [ ] (dolphinscheduler) ShaoFeng Shi Comments: - [X] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan Comments: - [X] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Develop more committers and contributors. 2. Make development document more easily to read. 3. make E-mail as an official discussion tool in our communities. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. New committers is active in answer Jira issue and other contributions. 2. More articles were written by users and contributors initiatively. ### How has the project developed since the last report? 1. Apache 1.2.1 without WIP has been released. 2. Restructure the Master/Worker model for easily to expand. 3. Refine CI/CD process for more contributors easily to join. ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [ ] Working towards first release - [X] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: 2020-2-24 ### When were the last committers or PPMC members elected? 2020-1-24 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our progress on restruction. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [x] (dolphinscheduler) Sheng Wu Comments: - [ ] (dolphinscheduler) ShaoFeng Shi Comments: - [x] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan KAMACI Comments: - [x] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Make first no-WIP Apache releases. (in progress) 2. Make development document more easily to read 3. Develop more committers and contributors. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. Developed 7 more committers, commiters grew from 15 to 22. 2. More than 10 experienced users grew to be active contributors. 3. E-mail is popular between developers on serious topic discussion. ### How has the project developed since the last report? 1. Apache 1.2.0 with WIP has been released while non-WIP 1.2.1 version was ready to vote. 2. Substantially reduced config file and options to make the project easy to install 3. Modified CSS JS code to follow Apache license ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [ ] Working towards first release - [X] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: 2020-1-2 ### When were the last committers or PPMC members elected? 2020-1-24 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our firtst Apache Release. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [X] (dolphinscheduler) Sheng Wu Comments: - [X] (dolphinscheduler) ShaoFeng Shi Comments: - [X] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan KAMACI Comments: - [x] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes: Justin Mclean: For an active project there is very list email on the devlist. Can you provide some insight to why this might be? Is conversation and planning happening off list?
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Dolphin Scheduler has been incubating since 2019-8-29. ### Three most important unfinished issues to address before graduating: 1. Make first Apache releases. (In 3rd round voting progress) 2. Develop more committers and contributors. 3. Clean up the license issue on JS lib. ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? 1. Developed 13 more contributors from 42 to 55 who contributes codes to github. 2. Successfully held a co-meetup with Sharding Sphere in Dec, 8th in Beijing, more than 70 people attended the meet up. 3. E-mail discussion was accepted by community step by step: about 9 proposals and many discussion were communicated by e-mail since the training on the last meet-up. 4. Many contributors were developed and found while overcoming the difficulty on Apache release, and some of them would be voted to committers next month. ### How has the project developed since the last report? 1. Apache 1.2.0 release was still in progress. Committers fix the commercial problems on fonts and icons, and was cleaning up the dependencies on JS libs. 2. Formal auto CI/CD was accepted by community with UT 60%. 3. 1.2.x was developing and there is a proposal to refactor some key part of the project for better concurrent performance. ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [x] Working towards first release - [ ] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: No answer. ### When were the last committers or PPMC members elected? 2019-11-11 ### Have your mentors been helpful and responsive? Yes, our mentors help a lot on our first Apache Release. ### Is the PPMC managing the podling's brand / trademarks? Yes, We keep tracking podling's brand / trademarks. ### Signed-off-by: - [x] (dolphinscheduler) Sheng Wu Comments: Mail list communications become more active. Good to see this. - [ ] (dolphinscheduler) ShaoFeng Shi Comments: - [X] (dolphinscheduler) Liang Chen Comments: - [X] (dolphinscheduler) Furkan KAMACI Comments: - [X] (dolphinscheduler) Kevin Ratnasekera Comments: ### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. Make first Apache releases. (In voting progress)
2. Appeal more users and contributors.
3. Make more interactive e-mail discussion besides github, wechat
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Now there are 42 external contributors, keep the same as November.
2. 2 committers were voted to join Dolphin Scheduler committers group
last month, and there is a plan to vote 3-4 more committers next month.
3. 131 users subscribed the mail(from 67 subscribers) of dev and
dev-notification and we got 113 mails formal discussions（from about 60
mails).
4. There is a plan to hold a co-meetup with Sharding Sphere in Dec, 8th
in Beijing.
### How has the project developed since the last report?
1. PPMC is voting for an Apache release 1.2.0 on Nov,27,which includes 9
features and 18 enhancements and bug fix.
2. Build a CI/CD base on Github actions.
3. Default DB is changed from MySQL to PostgreSQL.
4. 241 issues created，237 PRs merged .
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [ ] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
No answer.
### When were the last committers or PPMC members elected?
2019-11-11
### Have your mentors been helpful and responsive?
Yes, our mentors help a lot on our first Apache Release, including first
time on CI/CD, license check, Apache checklist, and so on. Wu Sheng gave
us many useful advice.
### Is the PPMC managing the podling's brand / trademarks?
Yes, We keep tracking podling's brand / trademarks.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments: Need more works on working in Apache way, especially remote
work mode, mail list discussion and decision. Good start for a new
project. Hope they are learning fast.
- [ ] (dolphinscheduler) ShaoFeng Shi
Comments:
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
#### Three most important unfinished issues to address before graduating:
1. Make first Apache releases (In progress)
2. Fix the content of official website about Non-ASF release and notice.
3. Make more interactive e-mail discussion besides github, wechat
#### Are there any issues that the IPMC or ASF Board need to be aware of?
None
#### How has the community developed since the last report?
1. Now there are 42 external contributors besides 8 PPMC members who
contributes codes to github.
2. We held a offline Meetup in Shanghai. 5 Speakers (including 4 PPMC
member and 1 user) gave their presentation. 30 people came and 10
people online watch the meetup.
3. Github star grew from 2291 to 2648 in October.
4. Over 61 company users is willing to announce that he is using Dolphin
Scheduler:
<https://github.com/apache/incubator-dolphinscheduler/issues/57>
#### How has the project developed since the last report?
1. Solid Apache verson plan is created and we planed to start a Apahce
release in November.
2. Some new important feature developerd by contributor was merge to
project(Docker file, S3 support, Flink job support, job import/export,
etc.)
3. 178 issues created，181 PRs merged (from #932 to #1113) .
4. Developers and Contributors are steadily developing the project
<https://github.com/apache/incubator-dolphinscheduler/issues/690
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [ ] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
None.
### When were the last committers or PPMC members elected?
2019-8-29
### Have your mentors been helpful and responsive?
Yes, our mentors noticed some issue of DolphinScheduler and give useful
advice to PPMC especially on first Apache version. I want to thank
Wusheng for many good advice for community operation and Apache first
release.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments:
- [x] (dolphinscheduler) ShaoFeng Shi
Comments: LGTM
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [X] (dolphinscheduler) Kevin Ratnasekera
Comments:
### IPMC/Shepherd notes:
Dave Fisher: A good start. Please listen about labeling of non-Apache
Releases.
I'd like to see discussion on email threads on dev@ in addition to
announcements.
Listen to Sheng Wu regarding the branding of Events.
Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow
scheduling system dedicated to solving the complex dependencies in data
processing, making the scheduling system out of the box for data processing.
Dolphin Scheduler has been incubating since 2019-8-29.
### Three most important unfinished issues to address before graduating:
1. GPL license issue about MySQL.
2. Make first Apache releases.
3. Build the CI/CD process, which will help more developers to
participate in the contribution.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
1. Now there are 30 external contributors on Github besides 8 PPMC
members who contributes codes to github.
2. Champion hold a on-line training about Apache release for Developer
and Committers
3. Github stars grew from 1700 to 2291 in September
4. Over 58 company users is willing to announce that he is using Dolphin
Scheduler: https://github.com/apache/incubator-dolphinscheduler/issues/57
### How has the project developed since the last report?
* Champoin setup project infra and PPMC member learned how to use the
infra.
* Our Apache website is constructed by a contributor name khadgarmage.
* 145 issues created, 55 issues resolved, 85 pull-requests committed.
* Developers and Contributors are steadily developing the project
https://github.com/apache/incubator-dolphinscheduler/issues/690
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [x] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
None
### When were the last committers or PPMC members elected?
2019-8-29
### Have your mentors been helpful and responsive?
Our mentors were amazingly helpful. They setup the project infra and give
us a online training about Apache release and help us to join the Apache
meetup in Shanghai. We learned a lot from our mentors about Apache Way.
### Signed-off-by:
- [x] (dolphinscheduler) Sheng Wu
Comments: Good start for a new project.
- [x] (dolphinscheduler) ShaoFeng Shi
Comments: Good start, keep going!
- [X] (dolphinscheduler) Liang Chen
Comments:
- [X] (dolphinscheduler) Furkan KAMACI
Comments:
- [x] (dolphinscheduler) Kevin Ratnasekera
Comments: Good start indeed. I am happy to see the enthusiasm from
community in Apache process.
### IPMC/Shepherd notes: