Community-led development "The Apache Way"
This was extracted (@ 2022-05-18 16:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Report was filed, but display is awaiting the approval of the Board minutes.
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Push packages of next release to repositories.
3. Release a new architecture.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
Community has discussed new approaches to integrate Apache Marvin-AI to
new schedulling softwares like Apache Airflow, Kubeflow Pipelines and
Tekton. It can simplify the codebase and make Marvin more useful for many
more users.
### How has the project developed since the last report?
New functionalities (Minor Airflow integration, CLI capabilities) and
preparation to release a new version in progress.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
Wei Chen added as new PPMC member (2019-06-07).
New committer Lucas Cardoso (2021-09-17).
### Have your mentors been helpful and responsive?
Yes.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [ ] (marvin-ai) Luciano Resende
Comments:
- [X] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Release a new architecture.
3. Integration with workflow frameworks.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
Three new undergraduated students to join our Marvin-lab.
### How has the project developed since the last report?
- Redesigned integrations with popular frameworks as: TFX, Apache Airflow
and Kubernetes.
- New CLI commands.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
- Wei Chen added as new PPMC member (2019-06-07).
- New committer Lucas Cardoso in approval process.
### Have your mentors been helpful and responsive?
Yes.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [ ] (marvin-ai) Luciano Resende
Comments:
- [ ] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Finish the new version of Toolbox.
3. Release a new architecture.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
We had an online meeting to confirm inicial steps for the new
architectural with most of members.
Our "Marvin-lab" at the university keeps attracting new postgraduate
students in the artificial intelligence field.
### How has the project developed since the last report?
1. Minor bug fix.
2. Last adjustments on the new toolbox version.
3. New Architecture confirmation meeting finished.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
Yes.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [ ] (marvin-ai) Luciano Resende
Comments:
- [ ] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Finish the new version of Toolbox.
3. Release a new version.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
We have expanded "Marvin-lab" at the university and several postgraduate
students in the artificial intelligence field are using marvin as their
research tool.
We had an online meeting to discuss architectural approaches, we also
found out about new members joining the community, some of them are
utilizing the platform in their companies.
### How has the project developed since the last report?
1. Minor bug fix.
2. Last adjustments on the new toolbox version.
3. Added Airflow support.
4. Added TFX integration.
5. Architecture meeting to be scheduled.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
Yes.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [ ] (marvin-ai) Luciano Resende
Comments:
- [ ] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Finish the new version of Toolbox.
3. Release a new version.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
We have expanded "Marvin-lab" at the university and several postgraduate
students in the artificial intelligence field are using marvin as their
research tool.
We had an online meeting to discuss architectural approaches, we also
found out about new members joining the community, some of them are
utilizing the platform in their companies.
### How has the project developed since the last report?
1. Minor bug fix;
2. Last adjustments on the new toolbox version;
3. Preliminary version of AutoML wrapper (Marvin AutoML);
4. Organization of the structure of a documentation for the new toolbox;
5. Architectural discussions on dev mailing list and online meeting about
integrating TFX and Apache Beam.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
Yes.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [X] (marvin-ai) Luciano Resende
Comments:
- [X] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Build new release.
3. Bring more new committers.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
We are expanding at local universities with AI/ML related events to publish
Marvin for all computer science students.
### How has the project developed since the last report?
1. Minor bug fix;
2. Preliminary version of the new cli and integration with the daemon;
3. Benchmark system for model testing in development;
4. Preliminary version of Kubernetes deploy;
5. Architectural discussions on dev mailing list.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
Yes.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [X] (marvin-ai) Luciano Resende
Comments:
- [ ] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Finish the new version of Toolbox.
3. Update old examples
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
We have expanded "Marvin-lab" at the university and several postgraduate
students in the artificial intelligence field are using marvin as their
research tool.
### How has the project developed since the last report?
1. Minor bug fix
2. Refactoring the toolbox to allow the architecture change (Marvin
Daemon).
3. Discussions about architectural changes and a plugin system to make
the code less bloated.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
Yes.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [X] (marvin-ai) Luciano Resende
Comments:
- [X] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Dave Fisher: There are discussions and it looks like Luciano is providing
guidance.
If there were another mentor involved it might help the podling.
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Build compatibility with all the mainstream storages for artifact
persistence.
3. Finish the new version of Toolbox.
### Are there any issues that the IPMC or ASF Board need to be aware of?
* A lot of conversations about the project in last few months happened
in private channel, because of some contributing groups known to each
other. We have already warned everyone about the importance of
discussing on open lists.
### How has the community developed since the last report?
* in the last few months we have focused on development of university
communities,
we set up "Marvin-lab" at the university we have the partnership, and
several postgraduate
students in the artificial intelligence field started using marvin as
their main tool for their research.
### How has the project developed since the last report?
* Minor bug fixes.
* Compatibility with MS Azure Blob for artifact persistence.
* New contents and structure improvements in project documentation.
* AutoML module and integration with Apache Spark MLib in construction.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
* Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
* At least two of the mentors are sometimes active.
### Is the PPMC managing the podling's brand / trademarks?
* yes
### Signed-off-by:
- [X] (marvin-ai) Luciano Resende
Comments: Technical discussions need to happen on the dev list.
Please ensure contributors submit their individual
contributions.
- [X] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Justin Mclean: There has been no traffic to your mailing list for the last
3 -4 months. Why is this the case? And why was it not mentioned in this
report?
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Increase activity from current contributors and community.
2. Build compatibility with all the mainstream storages for artifact
persistence.
3. Finish the new version of Toolbox.
### Are there any issues that the IPMC or ASF Board need to be aware of?
* No.
### How has the community developed since the last report?
* We implemented Marvin in a new Fintech company "Ame Digital" in Sao
Paulo - Brazil as their main MLOps tool,
and all their data department are interested in contributing. We are
currently working together to add compatibility
with MS Azure for artifact persistence.
### How has the project developed since the last report?
* New AutoML public engines added.
* Minor bug fixes.
* Compatibility with Google Cloud BigQuery for data import added.
* AutoML module with Spark MLib in construction.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-07-18
### When were the last committers or PPMC members elected?
* Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
* Our mentors are sometimes active.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [ ] (marvin-ai) Luciano Resende
Comments:
- [X] (marvin-ai) William Colen
Comments:
### IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while
simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important issues to address in the move towards graduation:
1.Move development infrastructure to Apache
2.Build Community
3.Build Releases
### Are there any issues that the IPMC or ASF Board need to be aware of?
* None
### How has the community developed since the last report?
* Participation in the local PyData event with a presentation of the
project by Rafael Novello.
* Workshop participation in University of São Paulo with a presentation
of the project by Zhang Yifei.
* Participation in the B2W Summit event with a presentation of the
project by Zhang Yifei.
### How has the project developed since the last report?
* New public engine(post-purchase service prediction) in construction
by contributors from University of São Carlos.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [x] Working towards first release
- [x] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
* Wei Chen added as new PPMC member (2019-06-07)
### Have your mentors been helpful and responsive?
* At least two of the mentors are sometimes active.
### Signed-off-by:
- [x](marvin-ai) Luciano Resende
Comments:
Removed Jim as mentor per his resignation
The report mention that there are some collaboration
with University of São Carlos, but the dev list seems
very quiet since July. Where are the communications
and technical discussions happening ?
- [ ](marvin-ai) William Colen
Comments:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
### Three most important unfinished issues to address before graduating:
1. Move development infrastructure to Apache
2. Build Community
3. Build Releases
### Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
* None
### How has the community developed since the last report?
* Brought in a new PPMC member
* Participation in the local PyData event with a presentation of the
project by Zhang Yifei.
### How has the project developed since the last report?
* Community is engaged on the development for R support.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
07-January-2019 - Wei Chen
### Have your mentors been helpful?
* The mentors are responsive when the community needs it.
### Signed-off-by:
- [X](marvin-ai) Luciano Resende
Comments:
[ ](marvin-ai) William Colen
Comments:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while
simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
Three most important issues to address in the move towards graduation:
1.Move development infrastructure to Apache
2.Build Community
3.Build Releases
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
* No.
How has the community developed since the last report?
* The project began to receive help from community members.
* The community started discussing new releases.
How has the project developed since the last report?
* New improvements in documentation and official website
* Some improvements for a new release
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
* At least two of the mentors are sometimes active.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[x] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
* N/A
Signed-off-by:
[ ](marvin-ai) Jim Jagielski
Comments:
[x](marvin-ai) Luciano Resende
Comments: What are the missing items around
`1.Move development infrastructure to Apache`
[ ](marvin-ai) William Colen
Comments:
IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
Three most important issues to address in the move towards graduation:
1.Move development infrastructure to Apache
2.Build Community
3.Build Releases
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
* No.
How has the community developed since the last report?
* The project began to receive help from community members (not PPMC
members) more actively with the development of the project site.
* The community started discussing contribution patterns in the
repository and came up with some good practices that should be followed
* A new member is being included as a contributor to the project. Only a
few details are missing for inclusion.
How has the project developed since the last report?
* A new code repository was created for the development of the project
site following the Apache template.
* Bug fixes were done in the code and in the project documentation.
* Some PoC's to a new Toolbox version was included to a new branch on the
repo.
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
* At least two of the mentors are sometimes active.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[x] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
* N/A
Signed-off-by:
[X](marvin-ai) Jim Jagielski
Comments:
[x](marvin-ai) Luciano Resende
Comments:
[X](marvin-ai) William Colen
Comments:
IPMC/Shepherd notes:
Justin Mclean: Can the PPMC please make sure that they are following the
private mailing list.
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
Three most important issues to address in the move towards graduation:
1.Move development infrastructure to Apache
2.Build Community
3.Build Releases
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
* No
How has the community developed since the last report?
* The community has already migrated most of the infrastructure to
Apache. After weeks of discussion, the community has finally come to a
consensus on the backlog for the first Apache release.
How has the project developed since the last report?
* Code infrastructure is mostly migrated, new features are being
discussed.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[x] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
* At least two of the mentors are sometimes active.
Signed-off-by:
[x](marvin-ai) Jim Jagielski
Comments: Request to submit report was sent by Luciano
[x](marvin-ai) Luciano Resende
Comments:
[ ](marvin-ai) William Colen
Comments:
IPMC/Shepherd notes:
Marvin-AI is an open-source artificial intelligence (AI) platform that helps
data scientists, prototype and productionalize complex solutions with a
scalable, low-latency, language-agnostic, and standardized architecture
while
simplifies the process of exploration and modeling.
Marvin-AI has been incubating since 2018-08-21.
Three most important issues to address in the move towards graduation:
1.Move development infrastructure to Apache
2.Build Community
3.Build Releases
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
* No.
How has the community developed since the last report?
* Slowly discussing how to move development to Apache Infrastructure
How has the project developed since the last report?
* N/A
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
* At least one of the mentors is active
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[x] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
* N/A
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Signed-off-by:
[X](marvin-ai) Jim Jagielski
Comments:
[x](marvin-ai) Luciano Resende
Comments:
[ ](marvin-ai) William Colen
Comments:
IPMC/Shepherd notes: