This was extracted (@ 2025-05-25 22:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
There are no remaining issues. After list discussions with our mentors, we
have
confirmed that it would be the right time for graduation.0
### Are there any issues that the IPMC or ASF Board need to be aware of?
None.
### How has the community developed since the last report?
StormCrawler remains well-established, with a steady user base over the
past decade.
While the number of committers and contributors remains small, the
project's activity level
is comparable to some established TLPs.
Seasoned committers with experience across various ASF projects continue
to contribute, ensuring the project's stability and sustainability.
Although community growth has been minimal (but did happen), there has been
some progress.
Additionally, the rise of generative AI has shifted focus toward
production-ready, turnkey solutions,
reducing the incentive for many users to contribute directly to
StormCrawler. Instead, they often
prefer to adopt mature, off-the-shelf software like StormCrawler rather
than actively participating in development.
This industry trend may explain the limited influx of new contributors
despite the project's ongoing relevance.
### How has the project developed since the last report?
The project has seen steady progress with various bug fixes and dependency
updates.
Additionally, there have been some external contributions to the
documentation,
indicating ongoing interest and engagement from the community.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [ ] Community building
- [X] Nearing graduation
- [ ] Other:
The project is well-established, has maintained steady activity, and has
experienced contributors
who are familiar with ASF processes. While community growth has been
modest,
the project's engagement level and stability suggest it is ready for
graduation.
The presence of seasoned committers and ongoing development efforts further
support this assessment.
### Date of last release:
2025-03-24
### When were the last committers or PPMC members elected?
2024-09-21
### Have your mentors been helpful and responsive?
Yes, our mentors have been supportive, providing guidance throughout the
process.
They have been available for discussions, particularly regarding the
project's readiness for graduation,
and have helped ensure we are on the right track.
Their experience and insights have been valuable in navigating ASF
Incubator processes.
### Is the PPMC managing the podling's brand / trademarks?
Yes. The name was approved by VP Trademarks.
### Signed-off-by:
- [ ] (stormcrawler) Dave Fisher
Comments:
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [X] (stormcrawler) Ayush Saxena
Comments: Successfully managed multiple releases during incubation and
now preparing for graduation.
- [X] (stormcrawler) PJ Fanning
Comments: Discussing Graduation
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
StormCrawler remains a rather mature and stable project, continuing to
serve its niche effectively. While there isn’t much new to report in terms
of major developments, we did have a contributor show up recently and
provide some pull requests, which is always a positive sign.
It’s worth noting that, even in the age of AI, the number of people
conducting their own large-scale web crawls remains relatively low. Many
opt to leverage datasets like Common Crawl rather than setting up and
maintaining their own crawling infrastructure. This makes community
contributions even more valuable, as StormCrawler continues to be a
reliable solution for those who do require custom crawling capabilities.
### How has the project developed since the last report?
A new release of StormCrawler was made.
However, one area of concern is the level of engagement among the initial
committers. Out of the five original committers, only three have been
actively contributing, while the remaining two have shown little to no
involvement since the project's incubation. While it's not uncommon to see
fluctuations in contributor activity due to shifting priorities and time
constraints, this does highlight the need to expand the committer base.
Therefore, we are happy that we could add an additional committer and PPMC
member since incubation.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2024-12-03
### When were the last committers or PPMC members elected?
2024-09-21
### Have your mentors been helpful and responsive?
Nothing of note.
### Is the PPMC managing the podling's brand / trademarks?
The name was approved by VP, Brand after consulting the Apache Storm
project.
### Signed-off-by:
- [X] (stormcrawler) Dave Fisher
Comments: The podling knows that community growth is required.
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [X] (stormcrawler) Ayush Saxena
Comments:
- [X] (stormcrawler) PJ Fanning
Comments:
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
No
### How has the community developed since the last report?
Nothing new to report. One contributor showed up and provided some PRs,
which is a good sign.
### How has the project developed since the last report?
A first release was made.
A slight source of concern is that 3 out of the initial 5 committers have
so far shown no or very little involvement in the project since its
incubation, which makes it even more urgent to increase the committer
base.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [ ] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2024-05-16
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing of note.
### Is the PPMC managing the podling's brand / trademarks?
No progress yet.
### Signed-off-by:
- [ ] (stormcrawler) Dave Fisher
Comments:
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [X] (stormcrawler) Ayush Saxena
Comments: Working towards building community
- [X] (stormcrawler) PJ Fanning
Comments: Release made but may need more work on community building.
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
Nothing yet.
### How has the community developed since the last report?
We got some involvement (issues, simple PRs) from outside the usual
suspects. We need to increase our outreach to attract more users /
developers to foster a healthy community development.
### How has the project developed since the last report?
We have published our first release (3.0). We are currently working on
adding the feedback received for 3.0.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
2024-05-16
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing to note.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [ ] (stormcrawler) Dave Fisher
Comments:
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [ ] (stormcrawler) Ayush Saxena
Comments:
- [ ] (stormcrawler) PJ Fanning
Comments:
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Community building
2. Work towards a first release
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
Nothing yet.
### How has the community developed since the last report?
We got some involvement (issues, simple doc PRs) from outside the usual
suspects.
We need to increase our outreach to attract more users / developers to
foster a healthy community development.
### How has the project developed since the last report?
Project is currently discussing to start a vote on a first release (3.0)
containing the breaking changes from joining as a poddling.
Website, build environment, etc. is set up.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
No release yet.
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing to note.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [X] (stormcrawler) Dave Fisher
Comments: Good start to incubation
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [X] (stormcrawler) Ayush Saxena
Comments: The community is actively working towards their first ASF
release
- [X] (stormcrawler) PJ Fanning
Comments: Good progress setting up the podling and first release under
discussion
### IPMC/Shepherd notes:
StormCrawler is a collection of resources for building low-latency,
customisable and scalable web crawlers on Apache Storm.
StormCrawler has been incubating since 2024-03-19.
### Three most important unfinished issues to address before graduating:
1. Set up Git Repos and Builds
2. Community building
3. Work towards a new release
### Are there any issues that the IPMC or ASF Board need to be aware of?
Nothing yet.
### How has the community developed since the last report?
First Report.
### How has the project developed since the last report?
N/A
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
None.
### When were the last committers or PPMC members elected?
No new committers yet.
### Have your mentors been helpful and responsive?
Nothing to note.
### Is the PPMC managing the podling's brand / trademarks?
No answer.
### Signed-off-by:
- [ ] (stormcrawler) Dave Fisher
Comments:
- [ ] (stormcrawler) Lewis John McGibbney
Comments:
- [ ] (stormcrawler) Ayush Saxena
Comments:
- [X] (stormcrawler) PJ Fanning
Comments:
### IPMC/Shepherd notes:
The project is finished the setup. It's using wiki to hold the project
information.