This was extracted (@ 2024-11-19 16:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. More frequent code contributions
2. A steady release process
3. Growing the ecosystem: more committers, more use cases
### Are there any issues that the IPMC or ASF Board need to be aware of?
Very low project activity. Started discussion on Crail podling retirement
on dev mailing list.
### How has the community developed since the last report?
No new committer or known new use cases.
### How has the project developed since the last report?
We are aware of a proprietary elasticity extension of Crail. We do not
expect anymore the creator of that code might contribute it to the
project.
No other development since last release.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2021-05-03
### When were the last committers or PPMC members elected?
2021-05-16
### Have your mentors been helpful and responsive?
Our mentors are helpful and always responsive.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments: Started retirement vote on dev@crail
- [ ] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. More frequent code contributions
2. A steady release process
3. Growing the ecosystem: more committers, more use cases
### Are there any issues that the IPMC or ASF Board need to be aware of?
Visible project activities are very low. No new release since
one year.
### How has the community developed since the last report?
No new committer or known new use cases. We are aware of a proprietary
elasticity extension of Crail, but that code was not (yet?)
officially contributed or reviewed.
### How has the project developed since the last report?
Not much development visible. We started discussion on dev-list
regarding project future, including considering retiring the Crail Podling.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
The project stagnates since mid last year.
### Date of last release:
2021-05-03
### When were the last committers or PPMC members elected?
2021-05-16
### Have your mentors been helpful and responsive?
Our mentors are helpful and always responsive.
### Is the PPMC managing the podling's brand / trademarks?
Yes.
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments: Glad to see a discussion about Crail's future,
even though it's a tough conversation to have. I'll try
to keep up the momentum so that we get to consensus in the
next few weeks.
- [X] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1.More frequent/steady code contributions
2.New release
3.More committers
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
No new committer since last report
### How has the project developed since the last report?
Some pending issues were closed.
The latest elasticity extensions we are aware of are not yet presented
as a PR, unfortunately.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2021-05-03
### When were the last committers or PPMC members elected?
2021-05-16
### Have your mentors been helpful and responsive?
Mentors are helpful and always responsive.
### Is the PPMC managing the podling's brand / trademarks?
The PPMC took steps to get one non compliant use of the 'Crail'
name on a web page corrected.
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments: Activity is very low. Crail is discussing ways to
increase activity.
- [ ] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1.More frequent/steady code contributions
2.New release
3.More committers
### Are there any issues that the IPMC or ASF Board need to be aware of?
None.
### How has the community developed since the last report?
A student from ETH Zurich became committer. He contributed base
elasticity
support.
### How has the project developed since the last report?
A Master thesis project at ETH just finished, which extends elasticity
support to dynamic data node addition and removal without data loss. We
expect PR's out of this activity within the next weeks.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2021-05-03
### When were the last committers or PPMC members elected?
2021-05-16
### Have your mentors been helpful and responsive?
Mentors are helpful and always responsive.
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not managing the podling's brand / trademarks.
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments: Project activity is slow. Noting the "PPMC is not managing
the podling's brand / trademarks." comment above, I'll start a
conversation on private@ about trademarks.
- [ ] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Grow developers community
2. Establish convincing Crail use cases
3. More steady release cycles
### Are there any issues that the IPMC or ASF Board need to be aware of?
none
### How has the community developed since the last report?
Elastic resource provisioning further evolved by contributions from
Malte Brodmann.
### How has the project developed since the last report?
Current focus is on adding further resource elasticity to establish
Crail as a high performance ephemeral data store for cloud services.
We plan for a next release if elasticity support has stabilized.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-14
### When were the last committers or PPMC members elected?
December 4th, 2018. Expecting successful vote on new committer this week.
### Have your mentors been helpful and responsive?
Yes, our mentors have been supportive and responsive.
### Is the PPMC managing the podling's brand / trademarks?
There are no known cases of a 3rd party podling name/brand incorrect use.
Podling name search has been completed - see
https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-138
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments: Activity is slow. Key contributors are still present.
There is some development activity.
- [ ] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Drew Farris (shepherd): One mentor active on the mailing lists. Making
progress toward growing the community and producing a new release.
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Grow developers community
2. Establish convincing Crail use cases
3. More steady release cycles
### Are there any issues that the IPMC or ASF Board need to be aware of?
No answer.
### How has the community developed since the last report?
PR's implementing storage resource elasticity support were offered by
a new contributor, discussed on the dev mailing list, improved and finally
merged into the code base.
### How has the project developed since the last report?
The projects code base evolved towards the integration of storage resource
elasticity support. The project will soon reflect these improvements in
a new release.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-14
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful and responsive?
Yes, our mentors have been supportive and responsive.
### Is the PPMC managing the podling's brand / trademarks?
There are no known cases of a 3rd party podling name/brand incorrect use.
Podling name search has been completed - see
https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-138
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments:
- [ ] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance
critical data in distributed data processing jobs at
very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Grow developers community
2. Convincing use cases
3. Steady release cycles
### Are there any issues that the IPMC or ASF Board need to be aware of?
No reply.
### How has the community developed since the last report?
We got one new contributors. We are looking forward to see
him applying as a committer.
### How has the project developed since the last report?
A new contributor was working in the field of adding elasticity.
Elastic scaling is a needed pre-requisite to use Apache Crail as
an efficient ephemeral data store for serverless frameworks.
We expect pull requests for code integration in the coming weeks.
With added elasticity, a new release would be due.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-14
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful and responsive?
Yes, our mentors have been supportive and responsive.
### Is the PPMC managing the podling's brand / trademarks?
There are no known cases of a 3rd party podling name/brand incorrect use.
Podling name search has been completed - see
https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-138
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments: Activity is very low. Crail are trying to find ways to
stimulate activity by bringing in a new contributor.
- [X] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments:
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Grow developers community
2. Establish convincing Crail use cases
3. More steady release cycle
### Are there any issues that the IPMC or ASF Board need to be aware of?
### How has the community developed since the last report?
A developer recently joined the community, volunteering for the
implementation of the elastic scaling of the data store.
### How has the project developed since the last report?
The project failed to resume from a period of
inactivity which started this spring. With implementing
elastic scaling, we hope to see increasing activity.
Elastic scaling is a needed pre-requisite to use Apache Crail
as an efficient ephemeral data store for serverless frameworks.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-14
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful and responsive?
Yes, our mentors have been supportive and responsive.
### Is the PPMC managing the podling's brand / trademarks?
There are no known cases of a 3rd party podling name/brand incorrect use.
Podling name search has been completed - see
https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-138
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments:
- [X] (crail) Luciano Resende
Comments: It has been a while since new PPMC members were added,
please keep an open mind for new contributors.
- [X] (crail) Felix Cheung
Comments: community has been quiet, glad to see a plan that could
generate some interests
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Grow developers community
2. Grow Crail use base
3. More steady release cycle
### Are there any issues that the IPMC or ASF Board need to be aware of?
no.
### How has the community developed since the last report?
We see increasing traffic on the dev mailing list from
Crail users. A recent proposal from Adrian to add elastic
scaling got positive feedback from other committers.
### How has the project developed since the last report?
Crail went through a phase of limited visible activities on
the code base. It is critical the Crail developers
community resumes to be more active to keep the project
making decent progress. Using Crail as an ephemeral data
store for serverless computing emerges as a very suitable
use case. Pushing this forward, aiming at inclusion
in a next release is of common interest among the
committers.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-14
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful and responsive?
Our mentors have been supportive and responsive.
### Is the PPMC managing the podling's brand / trademarks?
No Answer.
### Signed-off-by:
- [X] (crail) Julian Hyde
Comments: The up-tick in dev activity is encouraging.
- [X] (crail) Luciano Resende
Comments:
- [X] (crail) Felix Cheung
Comments: This seems like a good plan to get more interests and grow
the community.
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Community building: Increase on number of active contributors and
users.
2. Establish new use cases in the community
### Are there any issues that the IPMC or ASF Board need to be aware of?
With Patrick currently unavailable for the project, we lost our main
contributor. We need help from new active contributors to drive things
forward.
### How has the community developed since the last report?
Interest from the community in native C++ client for Crail integration
with
ML frameworks such as TensorFlow.
New users from academia.
### How has the project developed since the last report?
- Release 1.2 is out.
- Working towards releasing new elasticity extensions of Crail.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2020-01-14
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful and responsive?
Our mentors are very helpful.
### Is the PPMC managing the podling's brand / trademarks?
Yes, others are using the podling's name correctly (e.g. Samsung
Research,
Stanford University)
### Signed-off-by:
- [x] (crail) Julian Hyde
Comments: Glad to hear about the new release.
Sorry to hear of Patrick's departure.
- [x] (crail) Luciano Resende
Comments: We should make sure all development, including prototypes,
happen at Apache repositories. New repos can be created
when necessary.
- [x] (crail) Felix Cheung
Comments: Steady progress, would be great to get more community growth
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Community building: Increase on number of contributors and users.
2. Establish new use cases in the community
3. Make release cycles more steady
### Are there any issues that the IPMC or ASF Board need to be aware of?
No issues.
### How has the community developed since the last report?
We released a new blog reporting "YCSB Benchmark with Crail
on DRAM, Flash and Optane over RDMA and NVMe-over-Fabrics"
Samsung Research uses the data store for showcasing KV disk
performance.
Stanford University used the data sore within their serverless
'Pocket' project.
### How has the project developed since the last report?
- Significant improvements to TCP/DRAM tier stability
- Added resource elasticity to better fit serverless deployment
model. According to current storage capacity needs, data nodes
can be dynamically added and removed.
- A new release 1.2 with above features is ongoing.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [x] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2018-11-26
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful and responsive?
Our mentors are very helpful.
### Is the PPMC managing the podling's brand / trademarks?
Yes, others are using the podling's name correctly
(e.g. Samsung Research, Stanford University)
### Signed-off-by:
- [x] (crail) Julian Hyde
Comments: Crail seems to be slowing down. Only about 5 emails per
month on the dev list, no significant code contributions for six
months, no new committers or PPMC members added for a year. A new
release is welcome, especially if it spurs community activity.
I am worried that Crail will never acquire sufficient momentum to
graduate.
- [x] (crail) Luciano Resende
Comments:
- [x] (crail) Felix Cheung
Comments: I share concerns with Julian
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Community building: Increase on number of contributors and users.
2. Further increase project visibility by establishing a convincing use
cases of Crail.
3. Make Crail better consumable / cooperate with other projects on Crail
integration.
### Are there any issues that the IPMC or ASF Board need to be aware of?
none
### How has the community developed since the last report?
- We presented an Apache Crail based, unified ephemeral data storage
architecture at USENIX ATC'19 in July.
- The USENIX ATC paper, lightening talk, and talk are online.
### How has the project developed since the last report?
- Incorporated pull requests to fix several resource management issues.
- Working towards new release.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [x] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2018-11-26
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful and responsive?
Our mentors are very helpful.
### Signed-off-by:
- [x] (crail) Julian Hyde
Comments: Activity is slow but steady. A paper & talk at a major
conference should help build community. It's also about time for a
release;
I will make a suggestion on the dev list.
- [x] (crail) Luciano Resende
Comments:
- [x] (crail) Felix Cheung
Comments: Agreed with report. Let's try to get more traffic on dev
list also.
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
### Three most important unfinished issues to address before graduating:
1. Community building: Increase on number of contributors
and users.
2. Further increase project visibility by establishing a
convincing use cases of Crail.
3. Make Crail better consumable / cooperate with other projects on
Crail integration.
### Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
### How has the community developed since the last report?
* Apache Crail was presented at 2019 Strata data conference
in San Francisco. The presentation is online available.
* We added one new blog posts to the projects Apache home page.
It covers deployment options for tiered storage disaggregation.
* A paper on an Apache Crail based, unified ehpemeral data
storage architecture got conditionally accepted at the
USENIX ATC'19 Conference in July.
* The @ApacheCrail twitter account has now 164 followers. We use
it to regularly tweet the availability of new blog posts,
code releases etc.
### How has the project developed since the last report?
* New CrailConfiguration API to allow setting Crail configuration
dynamically instead of loading it from a file.
* NVMf tier: It is now possible to set Client host NQN to support
restricted access on target side. If host NQN is not specified,
a random UUID is still generated.
* Started design of fault tolerance/robustness extensions
to Crail namenode implementation.
* Started integration of Crail as an ephemeral data store for
serverless frameworks. Publicly discussed integration options
at a presentation on 2019 OpenFabrics workshop.
* Continued native C++ implementation of Crail tailored to
Machine Learning framework integration.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [x] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
Nov-26-2018
### When were the last committers or PPMC members elected?
December 4th, 2018
### Have your mentors been helpful?
Our mentors are very helpful.
### Signed-off-by:
- [x](crail) Felix Cheung
Comments:
- [x] (crail) Julian Hyde
Comments: Dev list is pretty quiet; a few commits per month, not much
discussion.
So, activity level is a concern. However, the project members seem
to be doing
all they can as regards outreach (conference, twitter).
- [x] (crail) Luciano Resende
Comments:
### IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1. Community building: Increase on number of contributors
and users.
2. Further increase project visibility
3. Make Crail better consumable / cooperate with other projects on
Crail integration.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
How has the community developed since the last report?
* The OSDI'18 paper on Elastic Ephemeral Storage for Serverless
Analytics (based on Apache Crail) increased projects visibility
noticeable.
* We added two blog posts to the projects Apache home page. One
blog covers the performance of the Crail Python API, another
efficient shuffle data dis-aggregation via Crail.
* The @ApacheCrail twitter account has 155 followers. We use it to
regularly tweet the availability of new blog posts, code releases etc.
How has the project developed since the last report?
* Bug fixes for current release.
* Started evaluation of options for adding fault tolerance/robustness
to Crail service.
* Started native C++ implementation of Crail tailored to Machine Learning
framework integration (such as TensorFlow, PyTorch, etc.)
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[x] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
Nov-26-2018
When were the last committers or PPMC members elected?
December 4th, 2018
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
* Our mentors are very helpful. We are very happy we got Felix Cheung
offering help as a third mentor.
Signed-off-by:
[x](crail) Felix Cheung
Comments: Good work on external community; would love to see more
traffic on dev@
[x](crail) Julian Hyde
Comments: I enjoyed the blog post. Crail seem to be doing the right
things to attract community, hoping that we see new contributors
soon.
[x](crail) Luciano Resende
Comments:
IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical
data in distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1. Community building: attract additional contributors from different
companies/affiliations
2. Further increase visibility / PR
3. Develop further fields of applicability of Crail, such as
efficient serverless computing
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
How has the community developed since the last report?
* Our twitter account "@ApacheCrail" now has 125 followers
* We have only 6 active contributors, here we hope
to improve.
How has the project developed since the last report?
* Second release is out, including binary release
* Bug fixes for second release.
* Better documentation using readthedoc
* Constant activities on bug fixes, quality improvements
at https://github.com/apache/incubator-crail
* The binary code release as part of the second release
sparked discussion on the general@incubator list,
clarifying the issues on how to handle those releases.
How would you assess the podling's maturity?
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
12/05/2018
When were the last committers or PPMC members elected?
2017-11-01 (entering incubation)
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
* 2 of our mentors are very helpful and responsive. We had to remove
the third mentor Raphael Bircher due to inactivity.
Signed-off-by:
[x](crail) Julian Hyde
Comments: With two releases completed successfully, community
building is the main task for this project to get to
graduation. Welcome to Felix as a new mentor!
[x](crail) Luciano Resende
Comments:
[x](crail) Felix Cheung
Comments: (signing up as mentor)
IPMC/Shepherd notes:
--------------------
DLab
DLab is a platform for creating self-service, exploratory data science
environments in the cloud using best-of-breed data science tools.
DLab has been incubating since 2018-08-20.
Three most important issues to address in the move towards graduation:
1. Execute the SGA between EPAM and the ASF so code can be imported.
2. Move bug tracking system including project backlog to Apache issue
tracking system – in progress
3. Work toward an initial Apache release – in progress, first release
planned for EOY
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
Nothing at this point of time.
How has the community developed since the last report?
We are not at the stage of building community so far, but we hosted two
workshops recently and hope to have ˜2 potentials contributors from it.
Also we hosted two conferences and hope to have some contributors from it.
How has the project developed since the last report?
Initial committers have submitted their Apache ICLA, subscribed to all
mailing lists and created
Jira accounts. Functionality added:
· Added support of Java libraries installation
· Added support of Spark configuration from Web UI
· Implemented support for deployment into two VPC’s for AWS version
· Added support for DLab to not use public IP’s for MS Azure
· Redesign of DLab Web UI for roles management – in progress
· Update version of Zeppelin/Spark/EMR – in progress
· Scheduler in idle time – in progress
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[X] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
This is going to be our first release. Target date EOY.
When were the last committers or PPMC members elected?
We are still operating with the set of initial committers.
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Mentors are very helpful and try to resolve any issues immediately.
Open issues:
· None of contributors have access to create JIRA SCRUM/Kanban
boards (we have migrated the tickets, but can’t formaly create
a release/sprint)
Signed-off-by:
[X](dlab) P. Taylor Goetz
Comments:
[ ](dlab) Henry Saputra
Comments:
[ ](dlab) Konstantin I Boudnik
Comments:
IPMC/Shepherd notes:
Justin Mclean: Report was submitted past due date, mentors hadn't been
paying attention but should be now, however still missing sign-offs.
Crail is a storage platform for sharing performance critical
data in distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1. Community building: attract additional contributors from different
companies/affiliations + Crail deployments
2. Increase visibility / PR
3. Harden the code and improve stability and usability
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
* None
How has the community developed since the last report?
* A twitter account "@ApacheCrail" was recently created
How has the project developed since the last report?
* Container support made available
* Improved failure handling (more meaningful error messages)
* Improved documentation
* Working towards second release
* Constant activities on bug fixes, quality improvements and
additional features at https://github.com/apache/incubator-crail
How would you assess the podling's maturity?
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
5/28/2018
When were the last committers or PPMC members elected?
2017-11-01 (entering incubation)
Signed-off-by:
[x](crail) Julian Hyde
Comments: The project is healthy and making good progress. As noted,
community building is the main challenge now. The technology is
in good shape, so I believe people will start adopting.
I am very pleased that they have created a twitter account; it should
allow them to build community daily.
[x](crail) Luciano Resende
Comments:
[ ](crail) Raphael Bircher
Comments:
IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical
data in distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1. Community building: Additional contributors from different
companies/affiliations
2. Increase visibility / PR
3. Harden the code and improve stability and usability
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
* None
How has the community developed since the last report?
* To advertise the project, we present(ed) the Crail project at:
* OpenFabrics 2018 Workshop
(Crail non-volatile memory integration, presented in April)
* Spark and AI 2018 Summit
(Serverless computing with Crail, presented June 5)
* DataWorks 2018 Summit in June (Crail, to be presented June 21)
How has the project developed since the last report?
* First source code release (Apache-Crail 1.0-incubating) done
(+4, -0 binding votes) and available
* Designed/implemented new generic NVMeF storage tier which makes
code base independent of SPDK/DPDK environment
* Constant activities on bug fixes, quality improvements and
additional features at https://github.com/apache/incubator-crail
How would you assess the podling's maturity?
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
5/28/2018
When were the last committers or PPMC members elected?
2017-11-01 (entering incubation)
Signed-off-by:
[x] (crail) Julian Hyde
Comments:
Having made the (always difficult) first release, the project
is in good shape. They are starting to generate some publicity
by speaking at conferences. I am encouraging them to create a
twitter account (so that they can interact with the wider
community more frequently) and to start thinking of a second
release (to ensure that the release process is reproducible).
[x] (crail) Luciano Resende
Comments:
[] (crail) Raphael Bircher
Comments:
IPMC/Shepherd notes:
lresende: I removed the check from 'working towards first release' as the
first release was just completed
Crail is a storage platform for sharing performance critical
data in distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1 Community building
2. Improve project visibility
3. Create a first release
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
* None
How has the community developed since the last report?
* We got one new active committer.
After moving the code base under apache/incubator-crail,
we are re-gaining frequency on downloads and followers
* To advertise the project, we are preparing for the
SF Spark Summit presentation on Crail.
We got a presentation on Crail's non-volatile data
management accepted at OpenFabrics workshop in April.
How has the project developed since the last report?
* Podling name search done and approved by Legal.
* Applied fixes resolving two major bugs within Crail code.
* New project front end website.
How would you assess the podling's maturity?
[X] Initial setup
[X] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
N/A
When were the last committers or PPMC members elected?
2017-11-01 (entering incubation)
Signed-off-by:
[x] (crail) Julian Hyde
Comments: Good progress on the "admin" aspects of incubation,
and dev list is showing good activity.
[ ] (crail) Luciano Resende
Comments:
[ ] (crail) Raphael Bircher
Comments:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1. Community building
2. Improve project visibility
3. Create the first release
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
* No issues require attention at this time.
How has the community developed since the last report?
* We are trying to advertise Crail to attract more people
to contribute and/or use it. In that respect, we got a
presentation at this years SF Spark Summit accepted, where
we will talk about Crail deployment in the Spark context.
How has the project developed since the last report?
* Code transfer to apache.org complete
* Project website up, working on improvements and compliance
* Working on adapting Crail build process to new (Apache)
environment.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[x] Initial setup
[x] Working towards first release
[x] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
* N/A
When were the last committers or PPMC members elected?
* 2017-11-01 (entering incubation)
Signed-off-by:
[x](crail) Julian Hyde
Comments:
Well done getting the web site up and the source code into
ASF git. It feels like the project is really up and running.
Next steps are a release and podling name search.
[x](crail) Luciano Resende
Comments:
[ ](crail) Raphael Bircher
Comments:
Crail is a storage platform for sharing performance critical data in
distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1. Finish project setup 2 Community building 3. Create a first release
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
None
How has the community developed since the last report?
* Got contacted by a few individuals and companies trying Crail for their
internal use. Not much more activities since last month, presumably due to
holidays.
How has the project developed since the last report?
* Working on project website
* Working on Crail code renaming for code landing at Apache
* Incubator status page updates
* Apache ICLA signed by almost all contributors (7 of 9)
* Submitted abstract on Crail project for 2018 DataWorks Summit in Berlin
How would you assess the podling's maturity?
[X] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release: N/A
When were the last committers or PPMC members elected? 2017-11-01 (entering
incubation)
Signed-off-by:
[x](crail) Julian Hyde
Comments: It took a while to get ICLAs signed and
accounts created (thanks Luciano for your help) but the project is getting
through the red tape and real work is starting to surface on the dev list
and in JIRA.
[x](crail) Luciano Resende
Comments:
[ ](crail) Raphael Bircher
Comments:
IPMC/Shepherd notes:
Crail is a storage platform for sharing performance critical
data in distributed data processing jobs at very high speed.
Crail has been incubating since 2017-11-01.
Three most important issues to address in the move towards graduation:
1. Finish project setup
2. Community building
3. Create a first release
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
None.
How has the community developed since the last report?
N/A
How has the project developed since the last report?
* This is the first report.
* Apache ICLA signed by all contributors from IBM Zurich Research.
* Software Grant and Corporate Contributor License Agreement
signed by IBM ZUrich Research representative.
* Infrastructure setup underway (missing JIRA due to
infrastructure issues)
* Available Crail code to be transferred soon.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
N/A
When were the last committers or PPMC members elected?
2017-11-01 (entering incubation)
Signed-off-by:
[X] (crail) Julian Hyde
Comments:
Project is still boot-strapping. No activity on dev
list yet (except for preparation of this report).
[ ] (crail) Luciano Resende
Comments:
[ ] (crail) Raphael Bircher
Comments: