This was extracted (@ 2025-03-19 23:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
StormCrawler remains a rather mature and stable project, continuing to
serve its niche effectively. While there isn’t much new to report in terms
of major developments, we did have a contributor show up recently and
provide some pull requests, which is always a positive sign.
It’s worth noting that, even in the age of AI, the number of people
conducting their own large-scale web crawls remains relatively low. Many
opt to leverage datasets like Common Crawl rather than setting up and
maintaining their own crawling infrastructure. This makes community
contributions even more valuable, as StormCrawler continues to be a
reliable solution for those who do require custom crawling capabilities.
### How has the project developed since the last report?
A new release of StormCrawler was made.
However, one area of concern is the level of engagement among the initial
committers. Out of the five original committers, only three have been
actively contributing, while the remaining two have shown little to no
involvement since the project's incubation. While it's not uncommon to see
fluctuations in contributor activity due to shifting priorities and time
constraints, this does highlight the need to expand the committer base.
Therefore, we are happy that we could add an additional committer and PPMC
member since incubation.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2024-12-03
### When were the last committers or PPMC members elected?
2024-09-21
### Have your mentors been helpful and responsive?
Nothing of note.
### Is the PPMC managing the podling's brand / trademarks?
The name was approved by VP, Brand after consulting the Apache Storm
project.
### Signed-off-by:
- [X] (stormcrawler) Dave Fisher
Comments: The podling knows that community growth is required.
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [X] (stormcrawler) Ayush Saxena
Comments:
- [X] (stormcrawler) PJ Fanning
Comments:
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No
### How has the community developed since the last report?
Nothing new to report. One contributor showed up and provided some PRs,
which is a good sign.
### How has the project developed since the last report?
A first release was made.
A slight source of concern is that 3 out of the initial 5 committers have
so far shown no or very little involvement in the project since its
incubation, which makes it even more urgent to increase the committer
base.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2024-05-16
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing of note.
### Is the PPMC managing the podling's brand / trademarks?
No progress yet.
### Signed-off-by:
- [ ] (stormcrawler) Dave Fisher
Comments:
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [X] (stormcrawler) Ayush Saxena
Comments: Working towards building community
- [X] (stormcrawler) PJ Fanning
Comments: Release made but may need more work on community building.
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
Nothing yet.
### How has the community developed since the last report?
We got some involvement (issues, simple PRs) from outside the usual
suspects. We need to increase our outreach to attract more users /
developers to foster a healthy community development.
### How has the project developed since the last report?
We have published our first release (3.0). We are currently working on
adding the feedback received for 3.0.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2024-05-16
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing to note.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [ ] (stormcrawler) Dave Fisher
Comments:
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [ ] (stormcrawler) Ayush Saxena
Comments:
- [ ] (stormcrawler) PJ Fanning
Comments:
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2. Work towards a first release
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
Nothing yet.
### How has the community developed since the last report?
We got some involvement (issues, simple doc PRs) from outside the usual
suspects.
We need to increase our outreach to attract more users / developers to
foster a healthy community development.
### How has the project developed since the last report?
Project is currently discussing to start a vote on a first release (3.0)
containing the breaking changes from joining as a poddling.
Website, build environment, etc. is set up.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
No release yet.
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing to note.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [X] (stormcrawler) Dave Fisher
Comments: Good start to incubation
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [X] (stormcrawler) Ayush Saxena
Comments: The community is actively working towards their first ASF
release
- [X] (stormcrawler) PJ Fanning
Comments: Good progress setting up the podling and first release under
discussion
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Set up Git Repos and Builds
2. Community building
3. Work towards a new release
### Are there any issues that the IPMC or ASF Board need to be aware of?
Nothing yet.
### How has the community developed since the last report?
First Report.
### How has the project developed since the last report?
N/A
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
None.
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing to note.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [ ] (stormcrawler) Dave Fisher
Comments:
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [ ] (stormcrawler) Ayush Saxena
Comments:
- [X] (stormcrawler) PJ Fanning
Comments:
### IPMC/Shepherd notes:
The project is finished the setup. It's using wiki to hold the project
information.