Community-led development "The Apache Way"
This was extracted (@ 2021-04-07 00:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
### Three most important unfinished issues to address before graduating:
1. Start preparing towards graduation
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
Apache Livy is a stable project that is used widely in conjuction with
Apache Spark.
It seems to have met its project goals and there is not much active
development going on as a result. 2020 may definitely not be the best
year for community activity and Livy certainly seems to have taken a hit
on this aspect. Seeking guidance from the IPMC/Board on what could be next
steps for the project. Its not very active but at the same time its not a
defunct/unused project.
### How has the community developed since the last report?
### How has the project developed since the last report?
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-07
### When were the last committers or PPMC members elected?
2019-01-22
### Have your mentors been helpful and responsive?
No reply
### Is the PPMC managing the podling's brand / trademarks?
No Reply
### Signed-off-by:
- [X] (livy) Bikas Saha
Comments:
- [X] (livy) Luciano Resende
Comments:
- [ ] (livy) Jean-Baptiste Onofre
Comments:
### IPMC/Shepherd notes:
Justin Mclean: As long as there is an active PPMC with at last 3 PPMC
members providing oversight the project should be fine. Is anything else
needed to graduate the project? Have you looked at the ASF maturity
model? I am concerned that users questions are going unanswered on the
dev list.
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
### Three most important unfinished issues to address before graduating:
1. Start preparing towards graduation
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Moderate activity on mailing lists and code as well
### How has the project developed since the last report?
Currently the community is working on HA
feature and support for Spark on Kubernetes.
Spark 3.0 support was added recently and a new release
will be started once it has been more thought tested
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-07
### When were the last committers or PPMC members elected?
2019-01-22
### Have your mentors been helpful and responsive?
Yes
### Is the PPMC managing the podling's brand / trademarks?
Yes
### Signed-off-by:
- [ ] (livy) Bikas Saha
Comments:
- [ ] (livy) Brock Noland
Comments:
- [X] (livy) Luciano Resende
Comments:
- [ ] (livy) Jean-Baptiste Onofre
Comments: Still planning to contribute what I proposed on the mailing
list while ago. I think we are pretty close to graduation. Maybe worth
to start a discussion.
### IPMC/Shepherd notes:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
### Three most important unfinished issues to address before graduating:
1. Start preparing towards graduation
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Moderate activity on mailing lists and code as well
### How has the project developed since the last report?
0.7.0 was released. Currently the community is working on HA
feature and support for Spark on Kubernetes.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-07
### When were the last committers or PPMC members elected?
2019-01-22
### Have your mentors been helpful and responsive?
Yes
### Is the PPMC managing the podling's brand / trademarks?
Yes
### Signed-off-by:
- [X] (livy) Bikas Saha
Comments:
- [ ] (livy) Brock Noland
Comments:
- [X] (livy) Luciano Resende
Comments:
- [X] (livy) Jean-Baptiste Onofre
Comments: Still planning to contribute what I proposed on the mailing
list while ago. I think we are pretty close to graduation. Maybe worth
to start a discussion.
### IPMC/Shepherd notes:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
### Three most important unfinished issues to address before graduating:
1. Grow the community to get more reviews and content.
However, at this point, the community might want to consider that it
is a stable project that has met its initial functional goals. With
multiple public releases under its belt, it might be worth discussing a
time to graduate. A substantial increase in community activity in terms of
code contribution and related community growth might occur after a new set
of functionality/scope is identified for the project. But to date, the
existing community and code are following the Apache way.
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Moderate activity on mailing lists and code
### How has the project developed since the last report?
Livy thrift JDBC part is GA now. Currently the community is working on HA
feature. And 0.7.0 release is ongoing.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [x] Community building
- [x] Nearing graduation
- [ ] Other:
### Date of last release:
2019-04-01
### When were the last committers or PPMC members elected?
2019-01-22
### Have your mentors been helpful and responsive?
Yes
### Is the PPMC managing the podling's brand / trademarks?
Yes
### Signed-off-by:
- [ ] (livy) Bikas Saha
Comments:
- [ ] (livy) Brock Noland
Comments:
- [X] (livy) Luciano Resende
Comments:
- [X] (livy) Jean-Baptiste Onofre
Comments: Still planning to contribute what I proposed on the mailing list while ago
### IPMC/Shepherd notes:
Livy is a service for managing long running Apache Spark contexts in your
cluster.
It exposes both a REST interface and a JDBC server. With Livy, new
applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
### Three most important unfinished issues to address before graduating:
1. Grow the community to get more reviews and content. However, at this
point, the community might want to consider that it is a stable project
that has met its initial functional goals. With multiple public releases
under its belt, it might be worth discussing a time to graduate. A
substantial increase in community activity in terms of code contribution
and related community growth might occur after a new set of
functionality/scope is identified for the project. But to date, the
existing community and code are following the Apache way.
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Moderate activity on mailing lists and code
### How has the project developed since the last report?
Working on feature development and bug fix, planning to have a 0.7.0
release this year.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-04-01
### When were the last committers or PPMC members elected?
2019-01-22
### Have your mentors been helpful and responsive?
Yes.
### Signed-off-by:
- [X] (livy) Bikas Saha
Comments: Worthwhile to consider a discussion on graduation.
- [ ] (livy) Brock Noland
Comments:
- [X] (livy) Luciano Resende
Comments:
- [X] (livy) Jean-Baptiste Onofre
Comments: Maybe it's time to concretely move forward on graduation.
### IPMC/Shepherd notes:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
### Three most important unfinished issues to address before graduating:
1. Grow the community to get more reviews and content
2. Improve the code quality and expand its scope
3. Get more content
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
There're not so many activities since the last report. But we do saw some
new contributors were start working on this project.
### How has the project developed since the last report?
Working on feature development and bug fix, planning to hive a 0.7.0
release this year.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2019-04-01
### When were the last committers or PPMC members elected?
2019-01-22
### Have your mentors been helpful and responsive?
Yes.
Are things falling through the cracks? If so, please list any
open issues that need to be addressed.
### Signed-off-by:
- [ ] (livy) Bikas Saha
Comments:
- [ ] (livy) Brock Noland
Comments:
- [x] (livy) Luciano Resende
Comments:
- [ ] (livy) Jean-Baptiste Onofre
Comments:
### IPMC/Shepherd notes:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
The user email list has kept a consistent flow of discussion around the project.
How has the project developed since the last report?
Version 0.6 was released
How would you assess the podling's maturity?
Mailing lists and project development follow the Apache way.
The user community is active but lately the rate of change in the project
code is lower.
This may not be a cause for concern since it might indicate relative
maturity in achieving the desired functionality of the project.
[ ] Initial setup
[ ] Working towards first release
[x] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2019-04-02
When were the last committers or PPMC members elected?
2019-01-22
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Our mentors are regularly quick to respond on the dev list when addressed.
Signed-off-by:
[x](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[x](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofre
Comments:
IPMC/Shepherd notes:
Justin Mclean: Asked the podling to provide more detail.
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that requires fine grained interaction with
many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
1. Grow the community to have more activities.
2. Grow more contributors and committers.
3. Regular release.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
Activity has waned a little bit since the last report. Most of new
activity has been to stabilize a new feature (Hive-compatible Thrift
server). Committer activity remains a bit low.
How has the project developed since the last report?
Mainly small bug fixes and stabilization of new code.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2018-02-06
When were the last committers or PPMC members elected?
2017-09-18
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
We have not asked much of our mentors, but some are active on the email
lists.
Signed-off-by:
[ ](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[x](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofre
Comments:
IPMC/Shepherd notes:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
1. Grow the community to have more activities.
2. Grow more contributors and committers.
3. Regular release.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
Activity on the dev and user mailing lists as well as the rate of reported
JIRA issues has stayed steady. There has been an uptick of development
activity around adding a new feature to the project (a Hive-compatible
Thrift server implementation).
How has the project developed since the last report?
A new feature (Hive-compatible Thrift server) is being implemented, and
some code to support legacy releases of Java, Scala and Spark have been
removed.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2018-02-06
When were the last committers or PPMC members elected?
2017-09-18
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
We have not asked much of our mentors, but they are active on the email
lists.
Signed-off-by:
[ ](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[x](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofre
Comments:
IPMC/Shepherd notes:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
1. Grow the community to have more activities.
2. Grow more contributors and committers.
3. Regular release.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
Activity on the dev and user mailing lists as well as the rate of reported
JIRA issues has stayed steady.
How has the project developed since the last report?
Two security issues are fixed and support version is upgraded to Spark 2.3.1.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2018-02-06
When were the last committers or PPMC members elected?
2017-09-18
Signed-off-by:
[ ](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[ ](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofre
Comments:
IPMC/Shepherd notes:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
1. Grow the community and continue to involve more users and contributors
2. Grow more committers to maintain the project
3. Solidify our release cadence
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
N/A
How has the community developed since the last report?
Activity on the dev and user mailing lists as well as the rate of reported
JIRA issues has stayed steady.
How has the project developed since the last report?
The master branch has been updated to support Spark 2.3 in our next release.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2018-02-05
When were the last committers or PPMC members elected?
2017-09-18
Signed-off-by:
[ ](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[x](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofre
Comments:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
1. Grow the community and continue to involve more users and contributors
2. Grow more committers to maintain the project
3. Solidify our release cadence
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
N/A
How has the community developed since the last report?
Activity on the dev mailing list increased.
How has the project developed since the last report?
We released Livy 0.5.0-incubating with features including:
- Code autocompletion
- Spark SQL support
- Sharing variables across jobs
- Multi-line output for statements
- Using multiple languages in a single session
- Building with Scala 2.11
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2018-02-05
When were the last committers or PPMC members elected?
2017-09-18
Signed-off-by:
[X](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[X](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofre
Comments:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
1. Grow the community to involve more users and contributors.
2. Grow more committers to maintain the project.
3.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
N/A
How has the community developed since the last report?
One new committer was elected, more users appeared in mailing list
How has the project developed since the last report?
Several new features including auto completion, get session by name were proposed and under review.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2017-09-01
When were the last committers or PPMC members elected?
2017-09-18
Signed-off-by:
[x](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[ ](livy) Luciano Resende
Comments:
[ ](livy) Jean-Baptiste Onofre
Comments:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
1. Grow more committers to maintain the community
2. Expand the community, be more open to the newcomers
3. Have a regular release cadence
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
N/A
How has the community developed since the last report?
We are seeing nascent activity on the new ASF mailing lists for users.
How has the project developed since the last report?
We released the first Apache release of Livy, and migrated all the assets including JIRA, website to ASF.
One big feature about support shared session across languages was merged.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2017-09-01
When were the last committers or PPMC members elected?
N/A
Signed-off-by:
[X](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[ ](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofré
Comments:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
N/A
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
N/A
How has the community developed since the last report?
The community is working on moving the project to Apache.
How has the project developed since the last report?
The community made a big progress moving the project to Apache (https://issues.cloudera.org/projects/LIVY/issues/LIVY-373).
Two new features (Livy Web UI and improve ACL) has merged.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[X] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
N/A
When were the last committers or PPMC members elected?
N/A
Signed-off-by:
[ ](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[x](livy) Luciano Resende
Comments:
[ ](livy) Jean-Baptiste Onofre
Comments:
Livy is web service that exposes a REST interface for managing long running
Apache Spark contexts in your cluster. With Livy, new applications can be
built on top of Apache Spark that require fine grained interaction with many
Spark contexts.
Livy has been incubating since 2017-06-05.
Three most important issues to address in the move towards graduation:
N/A
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
N/A
How has the community developed since the last report?
The community is working on moving the project to Apache.
How has the project developed since the last report?
N/A
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
N/A
When were the last committers or PPMC members elected?
N/A
Signed-off-by:
[ ](livy) Bikas Saha
Comments:
[ ](livy) Brock Noland
Comments:
[ ](livy) Luciano Resende
Comments:
[X](livy) Jean-Baptiste Onofre
Comments: