This was extracted (@ 2023-02-28 12:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
## Description:
The mission of Lucene is the creation and maintenance of software related to
Search engine library
## Issues:
There are no issues requiring board attention.
## Membership Data:
Apache Lucene was founded 2005-01-19 (18 years ago)
There are currently 97 committers and 63 PMC members in this project.
The Committer-to-PMC ratio is roughly 7:4.
Community changes, past quarter:
- No new PMC members. Last addition was Greg Miller on 2022-06-07.
- Luca Cavanna was added as committer on 2022-10-05
## Project Activity:
Recent releases:
9.4.2 was released on 2022-11-21.
pylucene-9.4.1 was released on 2022-11-07.
9.4.1 was released on 2022-10-24.
9.4.0 was released on 2022-09-30.
9.3.0 was released on 2022-07-29.
Release notes can be found at
https://cwiki.apache.org/confluence/display/LUCENE/Release+Notes+9.4
It includes new features
- Opt-in use of Java 19 foreign memory access ("project Panama")
- Filtering facets using a query
- Unified abstraction of XY and lat/long
- Control over index-sort optimizations
- Multi-dimensional faceting (facet on a region)
- Query timeout support
- Support HNSW over 8-bit vectors
As well as other optimzations.
## Community Health:
A healthy traffic for the dev@ mailing list. The number of code contributors
went back up, and GitHub activity is steady, following the same pace
(https://home.apache.org/~mikemccand/lucenebench/github_pr_counts.html)
## Description: The mission of Lucene is the creation and maintenance of software related to Search engine library ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Lucene was founded 2005-01-19 (18 years ago) There are currently 96 committers and 63 PMC members in this project. The Committer-to-PMC ratio is roughly 4:3. Community changes, past quarter: - No new PMC members. Last addition was Greg Miller on 2022-06-07. - Vigya Sharma was added as committer on 2022-07-27 ## Project Activity: Recent releases: 9.4.0 is being prepared. 9.3.0 was released on 2022-07-29. 8.11.2 was released on 2022-06-17. 9.2.0 was released on 2022-05-24. The Lucene project decided to move the issue tracking system from Jira to GitHub. This should simplify the creation of issues and patches, and should also increase the engagement with new contributors. This has been a huge work to map and migrate all issues. There were a bunch of tricky problems to solve, but it's finally complete thanks to an amazing work. Lucene build servers have been updated to run tests with the latest JDK 19. The two latest releases contain numerous features and optimizations. As usual release notes can be found at https://cwiki.apache.org/confluence/display/LUCENE/Release+Notes+9.3 Here is an extract: - Merge on full flush enabled by default, giving perf boost to NRT indexes. - New features for facets: getAllChildren, facetsets for high dimensions, and query filtering. - More control over index-sort optimizations. - Dynamic pruning of queries sorted by a string field, for massive speedup. - Two-clause disjunctions queries optimized for a 40%-75% speedup. - BooleanQuery count quickened. - KnnVectorQuery filter cache improved, KnnVector fields stored with 8 bits to save storage. ## Community Health: We continue to see a healthy increasing trend in the traffic of the dev@ mailing list. The number of code contributors decreases compared to the previous quarter, probably due to the summer season. GitHub activity is steady, following the same pace (https://home.apache.org/~mikemccand/lucenebench/github_pr_counts.html).
## Description: The mission of Lucene is the creation and maintenance of software related to Search engine library ## Issues: There are no issues requiring the board's attention. ## Membership Data: Apache Lucene was founded 2005-01-19 (17 years ago) There are currently 95 committers and 63 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - Greg Miller was added as PMC member on 2022-06-07 - Chris Hegarty was added as committer on 2022-05-27 - Lu Xugang was added as committer on 2022-05-27 ## Project Activity: Recent releases: * 9.2.0 was released on 2022-05-24. * pylucene-9.1.0 was released on 2022-04-27. * 9.1.0 was released on 2022-03-22. * 9.0.0 was released on 2021-12-07. With the 9.2.0 release, there are many incremental improvements, the project continues to evolve its code, improving performance and adding features. ## Community Health: We see again a healthy trend +123% in the traffic of the dev@ mailing list, as well as +69% in the number of code contributors. GitHub activity is also increasing slightly (https://home.apache.org/~mikemccand/lucenebench/github_pr_counts.html). We are discussing the use of GitHub issues instead of Apache JIRA, as a way of simplifying and increasing engagement with new contributors.
## Description: The mission of Lucene is the creation and maintenance of software related to Search engine library ## Issues: There are no issues requiring the board's attention. ## Membership Data: Apache Lucene was founded 2005-01-19 (17 years ago) There are currently 93 committers and 62 PMC members in this project. The Committer-to-PMC ratio is 3:2. Community changes, past quarter: - No new PMC members. Last addition was Julie Tibshirani on 2021-11-30. - Guo Feng was added as committer on 2022-01-24 - Patrick Zhai was added as committer on 2021-12-18 ## Project Activity: Recent releases: * 9.1.0 is being prepared, * 9.0.0 was released on 2021-12-07, * 8.11.0 was released on 2021-11-16. * 8.10.1 was released on 2021-10-18. JDK 17 minimum version required for Lucene main branch, i.e. Lucene 10. ### About the next Lucene 9.1.0 * Java logging JUL for Lucene Core and Luke. * Improved query parser, Spanish stemming, Unicode 12.1 support. * Performance improvements on various queries. * Knn vector query filtering, hierarchical Hnsw graph. * Improvements on numeric values index, intersection and navigation. * Multiple performance gains for BitSet, Sort, Facet counting. ## Community Health: We see a healthy significant increase in the traffic of the dev@ mailing list. There is still an issue with the board reporter tool for the GitHub activity counting (https://issues.apache.org/jira/browse/COMDEV-425 opened in 09/2021). So we rely on the tracking of the open/closed GitHib PRs on our nightly benchmarks: https://home.apache.org/~mikemccand/lucenebench/github_pr_counts.html. It shows a constant and healthy pace. In addition, there were many new features and improvements added since the major 9.0 release, confirming an ongoing important activity.
WHEREAS, the Board of Directors heretofore appointed Michael Sokolov (sokolov) to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Michael Sokolov from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Bruno Roustant (broustant) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Michael Sokolov is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Bruno Roustant be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7B, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
## Description: The mission of Lucene is the creation and maintenance of software related to Search engine library ## Issues: There are no issues requiring the board's attention. ## Membership Data: Apache Lucene was founded 2005-01-18 (17 years ago) There are currently 91 committers and 61 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - One new PMC member, Julie Tibshirani, was added on 2021-11-30 - Michael Gibney was added as committer on 2021-10-06 ## Project Activity: Recent releases: * 9.0.0 was released on 2021-12-07, * 8.11.0 was released on 2021-11-16. * 8.10.1 was released on 2021-10-18. * 8.10.0 was released on 2021-09-27. Lucene 9.0 is our first major release in over two years, and the first release since Solr was separated into its own top-level project. ### About the 9.0 release * The 9.0 release will require JDK 11. * The build system has been completely rewritten and modernized for this release. * 9.0 adheres to a more stringent backwards compatibility policy than prior releases, and will be able to read indexes created using 7.x and 8.x. * This marks the end of the 8.x series of feature releases. ### Highlights of new features and optimizations * Support for indexing and searching high-dimensionality numeric vectors * Improvements to language-specific text analysis including three new languages as well as improved stemming, normalization and suggester for several others * Improvements to indexing, sorting and faceting speed for important use cases. * Please see the [Release Notes](https://cwiki.apache.org/confluence/display/LUCENE/Release+Notes+9.0) for more information ## Community Health: We see a healthy trend in metrics indicating volume of participation. There is a slight drop-off (-7%) in number of code contributors, which is most likely due to random variation, but we will want to keep an eye on that to see if it persists since it could indicate a loss of diversity,
## Description: The mission of Lucene is the creation and maintenance of software related to the java Search engine library. ## Issues: There are no issues requiring board attention in this cycle, except this small one: In our last (June) report, we made a mistake: we failed to wrap private email archive links inside a <private/> section (sorry!). From what we can tell, the board noted that, and also corrected it for us (thank you!). Yet it looks like that report was still not published and is still pending board approval? Is there something more we should do? ## Membership Data: Apache Lucene was founded 2005-01-18 (17 years ago). There are currently 90 committers and 62 PMC members in this project. The committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - Mayya Sharipova was added to the PMC on 2021-06-27 - No new committers. Last addition was Greg Miller on 2021-05-28. ## Project Activity: Development continues passionately. We released 8.9.0 on Jun 16, and PyLucene 8.9.0 shortly thereafter. We are about to release 8.10 (release branch is cut), the next Lucene/Solr feature-branch release and possibly the last of the 8.x series. This is our first non-floating-point-compliant release in a long time. We are also close to our next major release, 9.0. This will be the first release without Solr, and includes major changes like switching from ant to gradle for our build, first-class approximate nearest neighbor (KNN) search, and swapping the byte order for shorts, ints and longs written to the index from big-endian (popular thanks to Sun SPARCstations long ago) to little-endian (popular now thanks to x86 and ARM architectures). 9.0 will require JDK 11 at a minimum (up from JDK 8 for Lucene 8.x). ## Community Health: The user and development community remains healthy post-split. The board reporter tool shows sizable drops across many development metrics (issues opened/closed, PRs opened/closed, contributor count, etc.), but we suspect the tool might be mis-configured (maybe not pointing to the lucene repository?) and will work with COMDEV to sort it out (we opened https://issues.apache.org/jira/browse/COMDEV-425 for this). Our nightly benchmarks also track the number of open and closed GitHub PRs against the lucene repository and shows roughly linear progress on pushing PRs and containing the open PR count: https://home.apache.org/~mikemccand/lucenebench/github_pr_counts.html
## Description: The mission of Lucene is the creation and maintenance of software related to the Search engine library ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Lucene was founded 2005-01-18 (16 years ago) There are currently 90 committers and 61 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Bruno Roustant on 2021-02-28. - Peter Gromov was added as committer on 2021-04-01 - Greg Miller was added as committer on 2021-05-28 - Zach Chen was added as committer on 2021-04-19 ## Project Activity: Two minor versions of Lucene were released in this reporting period: 8.8.1, and most recently, 8.8.2 released 2012-04-12. PyLucene 8.8.1 was released on 2012-04-08. A more major feature release, 8.9.0, is currently being corrdinated with Solr PMC and will likely be released before the upcoming board meeting, but will be included in the next report since we don't want to jinx it! We are planning the 9.0 release as well, which will be the first separate release of Lucene, without Solr, since Solr originally joined. ## Community Health: We saw significant drops in activity on Lucene-specific mailing lists, in JIRA, and in GitHub PRs. This was expected since this is the first reporting period completely after Solr split to a new TLP. It's hard to say if there is any underlying change in activity related to Lucene; we will need to take a closer look in the next quarter to see if any trends develop. Activity on java-user (our main public-facing list) increased substantially, which seems healthy, so we don't see any reason for concern.
## Description: The mission of Lucene is the creation and maintenance of software related to Search engine library ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Lucene was founded 2005-01-18 (16 years ago) There are currently 87 committers and 60 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - One new PMC member was added: Bruno Roustant on 2021-03-01. - No new committers. Last addition was Julie Tibshirani on 2020-11-18. - Erick Erickson announced his intention to retire, but remains a committer on the PMC - There were two vote discussions for new committers. In both cases, the votes were deferred. We also had one vote discussion for a new PMC member that was deferred. ## Project Activity: Last year the project voted to spin off Apache Solr as its own top-level project. Recently, the work to do so has begun in earnest. The top-level project itself has been created. We decided by majority vote to induct all current Lucene committers and PMC members with the same status in the newly-formed project. Jan Høydahl was elected Solr PMC chair. There will be no change to the Lucene PMC or committers list. Work to split the code repositories, release processes, and websites has also begun (see the Solr report for more details). At the same time, the community has begun to focus on the next major release, which will be 9.0. That release will be Lucene-only; Solr will follow its own release cadence. The remaining 8.x releases will remain more tightly coordinated due to the need to maintain backwards-compatibility guarantees. This quarter's activity statistics continue to reflect work on both core Lucene and Solr. Work on Solr is desribed in the report on that newly-separate top-level project. Highlights from Lucene's 8.8.0 release include: enhanced synonym filter with flags, improvements to geospatial queries, configurable DocValue compression, and an implementation of CJK character width normalization as a CharFilter. We do anticipate a substantial drop in Lucene's activity metrics (JIRAs, commits) in the next quarter as Solr activity migrates to its own project. ### Releases The most recent release was 8.8.1, released on 2021-02-22. * 8.8.0 was released on 2021-02-12 * 8.7.0 was released on 2020-11-03. * 8.6.3 was released on 2020-10-07. * 8.6.2 was released on 2020-09-01 ## Community Health: We continue to see healthy participation both from the community of committers as well as from outside contributors. Some statistics show a decrease in the past quarter; I expect this can be attributed to seasonal fluctuation. We do plan to sunset the general@lucene.apache.org mailing list since it sees very low traffic. PyLucene release notices that were going there will now be folded in with the dev@ list.
@Sharan: follow up with PMC mediation
WHEREAS, the Board of Directors heretofore appointed Anshum Gupta (anshum) to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Anshum Gupta from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Michael Sokolov (sokolov) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Anshum Gupta is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Michael Sokolov be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7A, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache Lucene was founded 2005-01-18 (16 years ago) There are currently 87 committers and 60 PMC members in this project. The Committer-to-PMC ratio is roughly 8:5. Community changes, past quarter: - Houston Putman was added to the PMC on 2020-11-30 - Julie Tibshirani was added as committer on 2020-11-18 ## Project Activity: The community is continuing to work on reducing the tech debt in the project, as mentioned in the previous board reports. Several committers are actively working on a much improved 9.0 release. We released Apache Lucene and Solr 8.6.3 and 8.7.0 since the last report. With 8.6.3, Solr released a bug fix to stop adding duplicate response headers to internally proxied requests. This release also contained fix for a regression introduced in Solr 8.6.0 that affected HTTP multipart POST requests. The Solr 8.6.3 release also announced CVE-2020-13957. Lucene 8.7.0 released various improvements including better compression of stored fields and faster sorting by field. This release also significantly improves indexing speed in certain cases. Solr 8.7.0 introduced various features and improvements including the circuit breaker infrastructure along with JVM and CPU based breakers that improve uptime by rejecting incoming search requests based on JVM heap and CPU usage. As part of restructuring of the codebase, the community intends to move towards the model of having multiple repositories with different release cadence. This will allow the community to offer official modules with different release cadence. A code contribution from Bloomberg for the Solr Operator is currently being worked on as SOLR-14994. The grant was accepted after a discussion both, within the PMC as well as the wider community. This would allow Solr users to converge on the operating process when running Solr on Kubernetes. ## Community Health: Our developer as well as user lists had reduced activity the past quarter. Our user list had an avg. decrease of ~35% while our developer list dropped by 26%. This could be most likely due to the current pandemic as well as due to the holiday season. Despite a significant drop in the number of commits, which was most likely due to the heavy commits on a feature branch reducing, we had a 21% increase in code contributors the past quarter and the Github PR activity stayed almost steady. We are also waiting for the 9.0 release that uses Gradle to move forward with the creation of Apache Solr TLP, the vote for which passed a few quarters ago.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: The community is currently working on reducing the tech debt that Solr currently carries, as mentioned in the previous board reports. Several committers are actively working on a much improved 9.0 release. ## Membership Data: Apache Lucene was founded 2005-01-18 (16 years ago) There are currently 86 committers and 59 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - Atri Sharma was added to the PMC on 2020-08-19 - Gus Heck was added to the PMC on 2020-08-02 - Mike Drob was added to the PMC on 2020-07-23 - Munendra S N was added to the PMC on 2020-08-02 - Namgyu Kim was added to the PMC on 2020-08-02 - Michael Sokolov was added to the PMC on 2020-07-02 - Ilan Ginzburg was added as committer on 2020-06-18 - Mayya Sharipova was added as a committer on 2020-06-08 - Tomoko Uchida was marked as Emeritus PMC member but continues as a committer - Doron Cohen was marked as Emeritus PMC member ## Project Activity: As informed in previous reports, the Lucene PMC is currently working on graduating Solr as its own TLP based on a vote earlier this year. This effort will move faster after some planned build reorganization is completed. We released Apache Lucene and Solr 8.6.0, 8.6.1, and 8.6.2 since the last report. Lucene 8.6.0 introduced a feature to optionally reduce the number of small segments in the index, increasing search performance. It also fixed resource leaks and various other optimizations. Solr 8.6.0 improved the search performance in cases where exact count isn’t required. This version also released a major redesign of the Solr documentation. Solr 8.6.1 was a bug fix release that fixed a performance issue introduced by the default auto-scaling policy introduced in 8.6.0 release. Lucene 8.6.2 fixed a memory leak in the IndexWriter that was introduced in 8.6.0. Solr 8.6.2 introduced a bug fix allowing the admin screen to work with older ZooKeeper versions. The community has removed Ant support for building the project from master and transitioned to gradle. A new Logo for Apache Lucene was selected by voting[1]. The old logo will be retired soon. A code contribution from The Library of Congress for the Advanced Query Parser is currently being worked on as SIP-9[2]. ## Community Health: Our JIRA issue activity and code contributions are also very strong. 365 issues were opened and 383 issues closed in JIRA past quarter (25% increase). There were 2578 commits in the past quarter (187% increase) due to some heavy committing on a feature branch to pay off technical debt. There has been an overall deterioration in the community health with an increase in the incidents involving loud language and impolite behavior. The community needs to return to a more friendly and inviting style of community discussions and resolution of disagreements as we have in the past. A committer meeting was organized in this last quarter as a substitute for in-person meetings that used to happen at conferences. The meeting was attended by many committers, and there are plans to organize subsequent meetings at a regular interval. ## Links [1]https://lists.apache.org/thread.html/r295d9c4c7a847e277d538b704876773c7cd1a7c55a05639ff6b7988f%40%3Cdev.lucene.apache.org%3E [2] https://cwiki.apache.org/confluence/display/SOLR/SIP-9+Advanced+Query+Parser
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: The community is currently working on reducing the tech debt that Solr currently carries, as mentioned in the previous board report. Several committers are actively working on a much improved 9.0 release. ## Membership Data: Apache Lucene was founded 2005-01-18 (15 years ago) There are currently 85 committers and 54 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Nhat Nguyen on 2020-03-02. - Alessandro Benedetti was added as committer on 2020-03-18 - David Eric Pugh was added as committer on 2020-04-05 - Mayya Sharipova was added as committer on 2020-06-08 ## Project Activity The Apache Lucene PMC after a vote on the public list has decided to promote Apache Solr to its own TLP. This vote[1] happened after a reasonable amount of discussion[2] on the private list. The Lucene PMC would require the help of the board in the creation of this project as there are differing opinions around bootstrapping the PMC of the new Apache Solr project. The Lucene PMC plans to send a resolution proposal after finalizing on the PMC list for the Apache Solr project. We released Apache Lucene and Solr 8.5.0, 8.5.1 and 8.5.2 since the last report. Solr 8.5.0 introduced the ability for Solr to run with a Security manager enabled. Lucene 8.5.0 release introduced more spatial search features and improvements in addition to various performance optimizations. An 8.5.1 release was done to fix a bug in Lucene that could cause index corruption with docValues update. Lucene and Solr 8.5.2 were released to fix a memory usage regression from a bug that affected Fuzzy queries. We also released Apache Lucene and Solr 7.7.3 since the last report. Solr 7.7.3 release back ported a fix for performance regression from a previous release. Lucene release back ported the bug fix for index corruption during docValues update. ## Community Health: Our Jira issue activity and code contributions are also very strong. Though the numbers overall were lower, most likely due to the COVID pandemic, 322 issues were opened and 216 closed in JIRA in the past quarter. ## Links [1] https://lists.apache.org/thread.html/raab13cabe321d12b6cda7dc6e529176f51ece31d30f00997dd36570a%40%3Cdev.lucene.apache.org%3E [2] https://lists.apache.org/thread.html/rfae2440264f6f874e91545b2030c98e7b7e3854ddf090f7747d338df%40%3Cdev.lucene.apache.org%3E
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: The community is currently working on reducing the tech debt that Solr currently carries, as mentioned in the previous board report. Several committers are actively working on a much improved 9.0 release. The PMC feels that the situation is now under control. ## Membership Data: Apache Lucene was founded 2005-01-18 (15 years ago) There are currently 82 committers and 54 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - Nhat Nguyen was added to the PMC on 2020-03-02 - No new committers. Last addition was Bruno Roustant on 2019-11-22. ## Project Activity:We released Lucene and Solr 8.4.0 and 8.4.1 since the last report. With 8.4.0, we added numerous optimizations in Lucene. LatLonShape now supports the "CONTAINS" relation, which enables to find all indexed shapes that contain the query shape. Solr added a new package management system and improved security out of the box. Solr 8.4.0 release also announced CVE-2019-17558. An 8.4.1 release was done to fix SSL support in Solr along with security improvements in the newly added package manager. Overseer serialization was also fixed to support rolling upgrades. We are still working to change our entire build system from Ant to Gradle. A lot has already been ported, and this task is very close to completion. The Lucene and Solr websites were revamped and ported from SVN to Git and published as HTTPS only. ## Community Health: Community health is very strong. Our two main user lists, java-user and solr-user, continue to be widely used. Our Jira issue activity and code contributions are also very strong. 450 issues were opened and 315 closed in JIRA in the past quarter. Our GitHub activity has also been on an upward trend and more contributors are using GitHub PRs as compared to patches now. A Lucene/Solr track has been reintroduced to ApacheCon NA 2020. We are actively asking possible speakers to submit talks and hope to see a good lineup of talks by users and developers.
WHEREAS, the Board of Directors heretofore appointed Cassandra Targett (ctargett) to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Cassandra Targett from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Anshum Gupta (anshum) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Cassandra Targett is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Anshum Gupta be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7C, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core - PyLucene is a Python extension for accessing Lucene ## Issues: During this quarter, one member of the PMC publicly called out the significant tech debt Solr specifically is carrying with regard to features collectively called "SolrCloud" (Solr's distributed mode) as a way of spurring us to action (https://s.apache.org/66ri1). The PMC realizes that the state of SolrCloud efficiency, reliability, and code is something that needs to be improved drastically to better suit the needs of ever-increasing scale of deployments and workloads that Solr is being used for. Towards that, we recognize the challenges, and have solutions that we're aggressively working towards. The PMC feels we have this situation under control, and now need to follow through with improvements in this area. ## Membership Data: Apache Lucene was founded 2005-01-18 (15 years ago) There are currently 82 committers and 53 PMC members in this project. The Committer-to-PMC ratio is roughly 3:2. Community changes, past quarter: - No new PMC members. Last addition was Kevin Risden on 2019-06-25. - Atri Sharma was added as committer on 2019-09-18 - Bruno Roustant was added as committer on 2019-11-22 - Houston Putman was added as committer on 2019-11-13 ## Project Activity: We released Lucene and Solr 8.3 and 8.3.1 since the last report. With 8.3, we expanded our Spanish language support in Lucene, as well as added new PostingsFormats and several optimizations and enhancements. Solr added support for two-dimensional collection aliases and improvements to caching and math streaming expression support. An 8.3.1 release was made for Solr to provide an emergency fix for a corruption issue and lock our integration with Velocity from being able to load external resources except when explicitly allowed by the system administrator. We are just beginning the release process for Lucene and Solr 8.4 and hope to have that completed before the end of 2019. PyLucene is actively voting on a 8.3.0 release. We are still working to change our build system from Ant to Gradle. We are making progress on that front, and hope it will be complete before the next board update. We are also working on migrating our project website from being built with the CMS (via SVN) to being built with Pelican (via Git). We are making a couple of changes to how we work together: * We're discussing how to semi-require code reviews by defining project guidelines. We invite a board member to help/advice how to navigate this balance. * We're discussing use of a new "Solr Improvement Process" inspired from those of other projects, e.g. Kafka Improvement Process (KIP). * We started a quarterly virtual committer meeting by video conference. ## Community Health: Due to the changes we made right before the last report to the board to move Jira and Jenkins notifications to their own lists, activity in our devs@lucene list declined dramatically (-82%). I think I speak for all of us, however, in saying that it is much easier to follow conversations now. The main Lucene user list (java-user@lucene) saw a 50% decline in traffic, while the main Solr user list (solr-user@lucene) saw a 19% increase. I'm not sure there is anything to worry about in regard to the Lucene list decline, but we will continue to monitor it. Code contributions remain quite strong: we had 1560 commits (-18%) from 86 contributors (+10%_ and a 19% increase (197) in GitHub pull requests compared to last quarter.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core - PyLucene is a Python extension for accessing Lucene ## Issues: There are no issues requiring board attention at this time. ## Membership Data: Apache Lucene was founded 2005-01-18 (15 years ago) There are currently 79 committers and 53 PMC members in this project. The Committer-to-PMC ratio is roughly 5:4. Community changes, past quarter: - Kevin Risden was added to the PMC on 2019-06-25 - Munendra S N was added as committer on 2019-06-19 - One committer nomination vote is in progress. ## Project Activity: We have released Lucene and Solr 8.2 since the last report. PyLucene 8.1.1 was released on September 11th, 2019. With 8.2, we added Estonian language support in Lucene and Solr. Lucene added a monitor subproject (formerly known as Luwak, donated to the project) which allows monitoring an input stream of documents for matches to a stored query. Solr also added OpenTracing support for distributed trace performance monitoring. On the project maintenance front, we have several changes. First, we migrated two MoinMoin wikis to Confluence, and are discussing what to do with the old content (which may be outdated) in the new environment. We also introduced two new mailing lists to take some traffic from our main development list, discussed in more detail below. We are working to change our entire build system, currently based on Ant, to use Gradle, which we hope to complete soon. This is a herculean effort, but is making progress. Two CVEs were announced last period and the project is actively responding to incoming vulnerability reports. ## Community Health: Community health is very strong. Our two main user lists, java-user and solr-user, continue to be widely used. Due to the very high volume in our main developer-focused list (8920 mails last quarter), we have instituted two new lists: issues@lucene.a.o for Jira, Github, and Gitbox notifications and builds@lucene.a.o for Jenkins build notifications. We hope this will allow developer conversations to not get lost in the flood of automated notifications. Our Jira issue activity and code contributions are also very strong. 305 issues were created and 224 were closed, decreases of 14% and 21% respectively. The project had 1646 commits (+5%) from 76 contributors (+20%) in the last quarter.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core - PyLucene is a Python extension for accessing Lucene ## Issues: - There are no new issues requiring board attention at this time. ## Activity: We have released Lucene and Solr 6.6.6, 7.7.2, 8.0, 8.1.0, and 8.1.1 since the last report. PyLucene has also had a release, 7.7.1. 6.6.6 was released so users who need to remain on 6.x for the time being have a way to get CVE/critical bug fixes which were released in later versions. 7.7.2 was released to backport to 7.x a few important bug fixes that were discovered with Solr performance. These same fixes were released in Solr 8.1. With 8.1.0, we integrated Luke, a popular GUI for Lucene index inspection andh had been maintained as an external add-on, as a core feature of Lucene. Another key Lucene enhancement was the addition of a query inspection API. Solr added support for JWT authentication, collection aliases based on arbitrary field values, and the ability to rename and reindex collections. 8.1.1 was released to fix a bad bug with querying collection aliases which was discovered right after the release of 8.1.0. Another severe bug in 8.x was discovered after release of 8.1.1, this one with Basic Authentication support in Solr, and a volunteer release manager has initiated the release process for 8.1.2. We have decided to make Java 11 a minimum Java version for our next major release (Lucene 9), and have changed our master Git branch accordingly. ## PMC Changes - Currently 52 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Ignacio Vera on Mar 03 2019 ## Committer base changes: - Currently 78 committers. - New commmitters: - Namgyu Kim was added as a committer on Jun 03 2019 - Michael Sokolov was added as a committer on May 13 2019 - Tomoko Uchida was added as a committer on Apr 09 2019 - A vote is currently in progress for another new committer. ## Releases - PyLucene 7.7.1 was released on Mar 17 2019 - 6.6.6 was released on Apr 04 2019 - 7.7.2 was released on Jun 03 2019 - 8.0 was released on Mar 13 2019 - 8.1 was released on May 15 2019 - 8.1.1 was released on May 27 2019
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time. ## Activity: We are actively voting to release Lucene and Solr 8.0. PyLucene 7.7.1 is also being voted on for release. Since our last report, we released Lucene and Solr 7.6, 7.7 and 7.7.1, and PyLucene 7.6.0. 7.7 was released as the final minor release of the 7.x line, in preparation for releasing 8.0. Lucene 7.7 had some speed improvements for merging segments with points and support for Unicode 9.0, while Solr 7.7 added a login screen for the Admin UI (when auth is configured) and the ability to configure a whitelist for distributed queries. 7.7.1 was a patch release to fix two bugs in Solr deemed critical: one that impacted 7.6 and 7.7 and another that impacted 7.7 only. No changes were made in the 7.7.1 release for Lucene. ## PMC changes: - Jason Gerlowski added on February 20, 2019 - Ignacio Vera added on March 3, 2019 - We invited another committer to join the PMC, but he declined our invitation for personal reasons. - Currently 52 PMC members. ## Committer base changes: - No new Committers since last report - Currently 75 committers. ## Releases: - Lucene/Solr 7.6.0 was released December 14, 2018 - Lucene/Solr 7.7.0 was released February 11, 2019 - Lucene/Solr 7.7.1 was released February 28, 2019 - PyLucene 7.6.0 was released on January 11, 2019
WHEREAS, the Board of Directors heretofore appointed Adrien Grand (jpountz) to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Adrien Grand from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Cassandra Targett (ctargett) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Adrien Grand is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Cassandra Targett be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7G, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time. ## Activity: We are in the process of releasing Lucene and Solr 7.6. Lucene 7.6 most notably features better indexing of shapes via a KD tree that we effectively use as a R-tree. Solr 7.6 is making first steps to discourage users from using FieldCache to sort or compute facets and contains a number of incremental improvements to the Stream Evaluator framework. The release has been a bit frustrating due to the fact that our process requires that tests pass for the artifacts to be built, yet Solr has a number of tests that are flaky that forced the release manager to first disable these tests, and then also attempt to build a new release multiple times until tests pass. Release management is already challenging on its own so this is something that needs fixing. There have been efforts recently to improve stability of tests, but this was only merged to the master and 7.x branches. So hopefully this issue that we have had with 7.6 won't occur again when we want to release 7.7. There are also discussions to release 8.0 in the near future. We wanted to release 7.6 first but we now expect a branch to be cut any day and master to move from 8.0 to 9.0. Uwe Schindler, our "Generics and sophisticated Backwards Compatibility Policeman", now has access to the OpenJDK bug tracker. We expect it to be helpful in order to more quickly iterate with JDK developers in the future when we report bugs. ## PMC changes: - No new PMC members - Last addition was Cao Mạnh Đạt on on April 2nd 2018 - Currently 49 PMC members. ## Committer base changes: - Gus Heck was added as a committer on October 30th 2018 - Tim Allison was added as a committer on November 2nd 2018 - Currently 75 committers. ## Releases: - Lucene/Solr 7.5.0 was released on September 24th. - PyLucene 7.5.0 was released October 19th. - There are ongoing discussions to release 7.6.0 and 8.0.0.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Activity: The upcoming Lucene 7.5 will include: - Support for indexing and searching geo-shapes as 6D points which represent tessellated triangles rather than terms in an inverted index. We expect this new approach to perform better. [1] - Better reclamation of deletes through merges. We previously allowed indices to contain about 50% deleted documents, and potentially much more on indices that have been force-merged. Forced merges do not create huge segments anymore[2] and deletes are now more aggressively reclaimed[3], allowing up to about 33% deleted documents per index. The upcoming Solr 7.5 will include: - Support for co-locating replicas of multiple collections on the same nodes.[4] - Inclusion of the new "Nori" korean analyzer in the default distribution. [5] - More stream evaluators, in particular around outlier detection. [6] - There is an ongoing discussion to release Lucene/Solr 8.0 later this year. [7] - Both user and dev mailing-lists are very active. - Discussions are generally flowing in a good shape. - We produced 2 releases since the last report. - We are updating our release process to conform with Apache requirements. [8] [1] https://issues.apache.org/jira/browse/LUCENE-8396 [2] https://issues.apache.org/jira/browse/LUCENE-7976 [3] https://issues.apache.org/jira/browse/LUCENE-8263 [4] https://issues.apache.org/jira/browse/SOLR-11990 [5] https://issues.apache.org/jira/browse/SOLR-12665 [6] https://issues.apache.org/jira/browse/SOLR-12660 [7] https://lists.apache.org/thread.html/19fd6e0 7b75fc2f75758c30962d955450c14b5583690c4a8e703d879@%3Cdev.lucene.apache.org%3E [8] https://issues.apache.org/jira/browse/LUCENE-8493 ## PMC changes: - No new PMC members - Last addition was Cao Mạnh Đạt on on April 2nd 2018 - Currently 49 PMC members. ## Committer base changes: - Nhat Nguyen was added as a committer on June 18th 2018 - Currently 73 committers. ## Releases: - Lucene/Solr 7.4.0 was released on June 27th. - pylucene 7.4 was released on September 4th. - There are ongoing discussions to release 7.5.0 and 8.0.0.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time. ## Activity: The upcoming Lucene 7.4 will include: - support for soft deletes[1], which allows to keep deleted documents around for an arbitrarily long time. - a new FeatureField[2] which makes it easy and efficient to incorporate static relevance signals into the score (think pagerank for instance). There are ongoing discussions to support dynamic signals[3] as well such as recency or geo distance. - a new ConditionalTokenFilter[4] which allows to put conditions in analysis chains. - a Korean analyzer[5] which performs much better than other alternatives that we are aware of. The upcoming Solr 7.4 will include: - more stream evaluators, in particular one for Fourier transform[6] and another one to compute geo distances. - support for child roll-ups[8]. - an upgrade to log4j 2[9], log4j 1 being end-of-life. - We implemented a new process to bad-apple tests that fail too regularly in order to get builds back to green so that the volume of failures is easier to process by humans. At the same time, we added reporting of disabled tests to make sure they do not get forgotten. - Both user and dev mailing-lists are very active. - Discussions are generally flowing in a good shape. - We produced 3 releases since the last report. [1] https://issues.apache.org/jira/browse/LUCENE-8200 [2] https://issues.apache.org/jira/browse/LUCENE-8197 [3] https://issues.apache.org/jira/browse/LUCENE-8340 [4] https://issues.apache.org/jira/browse/LUCENE-8273 [5] https://issues.apache.org/jira/browse/LUCENE-8231 [6] https://issues.apache.org/jira/browse/SOLR-12266 [7] https://issues.apache.org/jira/browse/SOLR-12273 [8] https://issues.apache.org/jira/browse/SOLR-8998 [9] https://issues.apache.org/jira/browse/SOLR-7887 ## PMC changes: - Cao Mạnh Đạt was added to the PMC on April 2nd. - Currently 49 PMC members. ## Committer base changes: - No new committers. - Last committer we added was Jason Gerlowski on February 8th 2018. - We had one failed vote, and there is one ongoing vote. - Currently 72 committers. ## Releases: - Lucene/Solr 6.6.4 was released on May 18th. - Lucene/Solr 7.3.0 was released on April 4th. - Lucene/Solr 7.3.1 was released on May 15th. - There is an ongoing discussion to release 7.4.0.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time. ## Activity: - The 7.x branch is very active and receives many bug fixes and incremental improvements like soft deletes (Lucene), more stream evaluators and improvements to the existing learning-to-rank support (Solr) or OpenNLP integration (both). - The master branch (future 8.0) mostly diverges from 7.x by improvements to scoring and to the execution of top-k queries sorted by score. - Both user and dev mailing-lists are very active. - Discussions are generally flowing in a good shape. - We produced 3 releases since the last report. - We had a discussion around test failures which were getting ignored[1], which resulted in a deeper analysis of test failures in order to try to finally fix those failures[2]. - We receive vulnerability reports on a regular basis, but for one of them we requested a CVE more than 1 year ago and haven't been able to fix it yet[3][4]. We made it a priority and will try to more quickly act on vulnerability reports in the future. - We agreed to ask for reviews more systematically in order to improve code quality[5], but without requiring reviews for code to be committed, trusting everybody's judgment to figure out when a change absolutely requires review. - In order to keep Java 8 as a minimum version requirement while taking advantage of Java 9's new APIs like Arrays.mismatch, we now package a multi-release JAR.[6] [1] https://lists.apache.org/thread.html/b783a9d7c22f518b07355e8e4f2c6f56020a7c32f36a58a86d51a3b7@%3Cdev.lucene.apache.org%3E [2] https://issues.apache.org/jira/browse/SOLR-12028 [3] https://lists.apache.org/thread.html/aaea8fb9cf1730a9a601d668e70b3dc9716ef9eb16e1a56cc86998a0@%3Cprivate.lucene.apache.org%3E [4] https://issues.apache.org/jira/browse/SOLR-9755 [4] https://lists.apache.org/thread.html/04b0b550cec79508cc80914a56676105355f58d7d676db1359336284@%3Cdev.lucene.apache.org%3E [5] https://issues.apache.org/jira/browse/LUCENE-7966 ## PMC changes: - Jim Ferenczi was added to the PMC on December 20th. - Dennis Gove was added to the PMC on December 23th. - Karl Wright was added to the PMC on December 28th. - Currently 48 PMC members. ## Committer base changes: - Ahmet Arslan was made a committer on December 17th. - Ignacio Vera was made a committer on January 11th. - Jason Gerlowski was made a committer on February 8th. - Currently 72 committers. ## Releases: - Lucene/Solr 6.6.3 was released on March 7th. - Lucene/Solr 7.2.0 was released on December 21st. - Lucene/Solr 7.2.1 was released on January 15th. - There is an ongoing discussion to release 7.3.0.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time. ## Activity: - The 7.x branch is very active and receives many bug fixes and incremental improvements like finer-grained control of flushing (Lucene) or more stream evaluators (Solr). - The master branch (future 8.0) is starting to diverge from 7.x in order to support efficient dynamic pruning of top hits. - Both user and dev mailing-lists are very active. - Discussions are generally flowing in a good shape. - We produced 4 releases since the last report, including some security-focused releases (see below). - A 0-day exploit was reported on a public mailing-list on October 12th[1]. We provided the community with mitigation steps[2], folded a fix into 7.1.0 which was in the process of being released and did two additional security-focused releases: 5.5.5 and 6.6.2. - A new conference called "Haystack", focused on search relevance, was announced[3] and will take place in April 2018. Its description mentions Solr and Elasticsearch, another Lucene-based search engine. [1] https://lists.apache.org/thread.html/89ff9ba 534edc950d06a21178792b7e856b934b81183b729014e537d@%3Cdev.lucene.apache.org%3E [2] https://lucene.apache.org/solr/news.html#12-october-2017-please-secure-your-apache-sol r-servers-since-a-zero-day-exploit-has-been-reported-on-a-public-mailing-list [3] http: //mailchi.mp/e609fba68dc6/announcing-haystack-the-search-relevance-conference ## PMC changes: - Noble Paul was added to the PMC on November 19th. - Ishan Chattopadhyaya was added to the PMC on December 8th. - There are three ongoing votes to add new PMC members. - Currently 45 PMC members. ## Committer base changes: - Hrishikesh Gadre was made a committer on September 27th. - There is one ongoing vote to add a new committer. - Currently 69 committers. ## Releases: - Lucene/Solr 5.5.5 was released on October 24th. - Lucene/Solr 6.6.2 was released on October 18th. - Lucene/Solr 7.0.1 was released on October 6th. - Lucene/Solr 7.1.0 was released on October 17th. - There is an ongoing discussion to release 7.2.0.
WHEREAS, the Board of Directors heretofore appointed Tommaso Teofili (tommaso) to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Tommaso Teofili from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Adrien Grand (jpountz) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Tommaso Teofili is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Adrien Grand be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7F, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time ## Activity: - The community has worked a lot on both Lucene and Solr, with daily commits, towards Lucene and Solr 7 releases - We are still working on resolving a security vulnerability and a new one got reported and fix is being addressed - Discussions are generally flowing in a good shape - Meetups / conferences around Lucene / Solr: - LueneSolrRevolution on September 12-15, 2017 Las Vegas, NV - Lucene for Information Access and Retrieval Research (LIARR) Workshop on August 11th at SIGIR 2017 conference in Tokio, Japan ## PMC changes: - No new PMC members in the last 3 months, but a vote to add a new one is ongoing. - Currently 43 PMC members ## Committer base changes: - No new committers in the last 3 months. - Currently 68 committers and 43 PMC members. ## Releases: - The vote on the release of Apache Lucene and Solr 7.0.0 has passed, so the release should go out shortly
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time ## Activity: - The community is actively working on both Lucene and Solr, with daily commits, towards Lucene and Solr 7 releases - We pushed out 5 releases since last report - Discussions are generally flowing in a good shape - Meetups / conferences around Lucene / Solr: - Berlin Buzzwords (12-14 June 2017): not Lucene/Solr related but lots of Lucene / Solr related talks were presented ## PMC changes: - Christian Moen was added to the PMC on Thu May 18 2017 - Shawn Heisey was added to the PMC on Thu May 18 2017 - Currently 43 PMC members ## Committer base changes: - Mike Drob was added as a committer on Thu May 04 2017 - Currently 68 committers and 43 PMC members. ## Releases: - Apache Lucene 6.6.0 released on 6 June 2017 - Apache Solr 6.6.0 released on 6 June 2017 - Apache Lucene 6.5.1 released on 27 April 2017 - Apache Solr 6.5.1 released on 27 April 2017 - pylucene 6.5.0 released on Thu Apr 06 2017
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time ## Activity: - The community is actively working on both Lucene and Solr, with daily commits, towards 6.5.0 (and 7) releases - We pushed out 4 releases since last report - We solved one a reported security vulnerability - We are discussing how to more easily monitor private Jira issues (to handle security problems) - Discussions are generally flowing in a good shape - Meetups / conferences around Lucene / Solr: - Elasticon 2017, March 7-9th, 2017 ## PMC changes: - Currently 41 PMC members. - Christine Poerschke was added to the PMC on Jan 2nd, 2017 - Mikhail Khludnev was added to the PMC on Jan 2nd, 2017 ## Committer base changes: - Currently 64 committers. - Cao Mạnh Đạt was added as a committer on Jan 9th, 2017 - Jim Ferenczi was added as a committer on Dec 31st, 2016 - Toke Eskildsen was added as a committer on Feb 14th, 2017 ## Releases: - Lucene 6.4.0 released on Jan 23rd, 2017 - Solr 6.4.0 released on Jan 23rd, 2017 - Lucene 6.4.1 released on Feb 6th, 2017 - Solr 6.4.1 released on Feb 6th, 2017 - PyLucene 6.4.1 release on Feb 14th, 2017. - Lucene 5.5.4 released on Feb 17th, 2017 - Solr 5.5.4 released on Feb 17th, 2017 - Lucene 6.4.2 released on Mar 7th, 2017 - Solr 6.4.2 released on Mar 7th, 2017
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Issues: - There are no new issues requiring board attention at this time ## Activity: - The community is actively working on both Lucene and Solr, with daily commits, towards 6.4.0 (and 7) releases - We pushed out a few releases since last report (see below) - We got reported three security vulnerabilities which we are (slowly) addressing - We included a large contribution which required inspecting legal concerns (Solr Learn to Rank) - A huge Jira maintenance effort has been put in place by some committers in order to close lots of old issues - Discussions are generally flowing in a good shape, except one email thread (subj: "Future of FieldCache in Solr") that got a bit too hot but luckily it didn't "diverge" - A number of meetups / conferences on Lucene / Solr took place around the world: - Lucene4IR in Glasgow, Sept 8-9th - London Lucene Hackday, Oct 7th - NYC Apache Lucene Solr Meetup Oct 10th - Lucene/Solr Revolution in Boston, October 11-14th ## PMC changes: - Currently 39 PMC members. - Varun Thacker was added to the PMC on Mon Dec 12 2016 ## Committer base changes: - Currently 64 committers. - Ishan Chattopadhyaya was added as a committer on Tue Nov 29 2016 ## Releases: - Lucene 6.2.1 released on Sep 20, 2016 - Solr 6.2.1 released on Sep 20, 2016 - Lucene 6.3.0 released on Nov 8th, 2016 - Solr 6.3.0 released on Nov 8th, 2016 - Solr RefereGuide 6.3.0 released on Nov 16th, 2016
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Activity: - The community is very active ## Issues: - There are no new issues requiring board attention at this time ## PMC/Committership changes: - Currently 63 committers and 38 PMC members in the project - Added 1 new committer: - Alexandre Rafalovitch was added as a committer on Sat Aug 06 2016 - Added no new PMC members ## Releases: - Lucene 6.2.0 released on Aug 24, 2016 - Solr 6.2.0 released on Aug 24, 2016 - Lucene 5.5.2 released on Jun 24, 2016 - Solr 5.5.2 released on Jun 24, 2016 - Lucene 5.5.3 released on Sep 9th, 2016 - Solr 5.5.3 released on Sep 9th, 2016 - Solr Reference Guide 6.2.0 released on Sep 13th, 2016 - Lucene/Solr 6.2.1 release under vote - PyLucene 6.2.0 release under vote
WHEREAS, the Board of Directors heretofore appointed Mike McCandless (mikemccand) to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Mike McCandless from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Tommaso Teofili (tommaso) as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Mike McCandless is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Tommaso Teofili be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Thread: https://s.apache.org/X3vi Special Order 7A, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
## Description: - Lucene Core is a search-engine toolkit - Solr is a search server built on top of Lucene Core ## Activity: - The community is very active - We have submitted a resolution to change the PMC Chair from Mike McCandless to Tommaso Teofili ## Issues: - There are no new issues requiring board attention at this time ## PMC/Committership changes: - Currently 62 committers and 38 PMC members in the project - Added 3 new committers: - Kevin Risden was added as a committer on Tue Mar 15 2016 - Karl Wright was added as a committer on Mon Apr 04 2016 - Scott Blum was added as a committer on Wed Apr 20 2016 - Added no new PMC members ## Releases: - 6.0.0 was released on April 8, 2016 - 5.5.1 was released on May 5, 2016 - 6.0.1 was released on May 28, 2016 - 6.1.0 release will get started (release branch) around June 8 ## Mailing list activity: - Mailing lists remain active and healthy ## JIRA activity: - Jira activity remains active and healthy
## Description:
- Lucene Core is a search-engine toolkit
- Solr is a search server built on top of Lucene Core
## Activity:
- The community is very active
## Issues:
- To follow up on the Subversion to GIT cutover from the last
report: after a long tail of many small issues, it has gone
smoothly, thanks to heavy efforts on Dawid Weiss' part to preserve
our elaborate source control history. We did our first release
(5.5.0) based on GIT and that also seems to have gone well.
- There are no new issues requiring board attention at this time
## PMC/Committership changes:
- Currently 59 committers and 38 PMC members in the project
- Added no new committers
- Added 1 new PMC member:
Cassandra Targett on Mon Dec 21 2015
## Releases:
- 5.4.0 was released on December 14, 2015
- 5.3.2 was released on January 23
- 5.5.0 was released on February 22, our first release based on GIT
- 6.0.0 will release shortly: we have a branch, and are aggressively
fixing nasty bugs that early adopter testing is uncovering
## Mailing list activity:
- dev@lucene.apache.org:
- 839 subscribers (down -6 in the last 3 months):
- 11966 emails sent to list (8214 in previous quarter)
- c-commits@lucene.apache.org:
- 18 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- c-dev@lucene.apache.org:
- 73 subscribers (down -7 in the last 3 months):
- 0 emails sent to list (2 in previous quarter)
- general@lucene.apache.org:
- 1006 subscribers (up 15 in the last 3 months):
- 40 emails sent to list (28 in previous quarter)
- java-commits@lucene.apache.org:
- 96 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- java-user@lucene.apache.org:
- 1099 subscribers (down -3 in the last 3 months):
- 243 emails sent to list (323 in previous quarter)
- pylucene-commits@lucene.apache.org:
- 10 subscribers (up 0 in the last 3 months):
- 1 emails sent to list (1 in previous quarter)
- pylucene-dev@lucene.apache.org:
- 126 subscribers (up 2 in the last 3 months):
- 2 emails sent to list (23 in previous quarter)
- ruby-dev@lucene.apache.org:
- 62 subscribers (down -7 in the last 3 months):
- 0 emails sent to list (2 in previous quarter)
- solr-commits@lucene.apache.org:
- 96 subscribers (up 1 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- solr-user@lucene.apache.org:
- 3520 subscribers (up 4 in the last 3 months):
- 3174 emails sent to list (2959 in previous quarter)
## JIRA activity:
- 587 JIRA tickets created in the last 3 months
- 453 JIRA tickets closed/resolved in the last 3 months
## Description:
- Lucene Core is a search-engine toolkit
- Solr is a search server built on top of Lucene Core
## Activity:
- The community is very active
## Issues:
- I don't think this requires board attention now, really just FYI:
The infra team notified us via private (PMC) email on 11/30:
https://mail-search.apache.org/members/private-arch/lucene-private/201511.mbox/%3cCAKprHVZ1cXNBm0z+1CtPOfJ0QeQDh=kENNETdy-iP0jKpcgZ=g@mail.gmail.com%3e
saying that our svn to git mirror is too costly to continue running
(breaking other projects' mirrors) and that in 30 days it will be
turned off. We've been discussing options publicly:
http://mail-archives.apache.org/mod_mbox/lucene-dev/201512.mbox/%3cCAL8PwkbFVT83ZbCZm0y-x-MDeTH6HYC_xYEjRev9fzzk5YXYmQ@mail.gmail.com%3e
but at this point nothing promising is emerging ... I suspect the
most likely outcome is we must cut over to git as our source
control, if we are able to preserve the full svn source history,
likely minus heavy JARs that we used to check in (the git mirror
currently fails to). We are thankful to the infra team for keeping
our mirror running this long!
## PMC/Committership changes:
- Currently 59 committers and 37 PMC members in the project
- Added two new committers:
Nick Knize on October 20
Dennis Gove on November 6
- Added three new PMC members:
Joel Bernstein on October 31
Tomas Fernandez Lobbe on October 31
Areek Zillur on October 31
## Releases:
- 5.3.1 was released on September 24
- 5.4.0 is releasing now
## Mailing list activity:
- dev@lucene.apache.org:
- 841 subscribers (up 19 in the last 3 months):
- 9051 emails sent to list (10554 in previous quarter)
- c-commits@lucene.apache.org:
- 17 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- ruby-dev@lucene.apache.org:
- 68 subscribers (up 0 in the last 3 months):
- 2 emails sent to list (0 in previous quarter)
- general@lucene.apache.org:
- 989 subscribers (up 17 in the last 3 months):
- 28 emails sent to list (47 in previous quarter)
- solr-commits@lucene.apache.org:
- 94 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- java-user@lucene.apache.org:
- 1098 subscribers (down -5 in the last 3 months):
- 341 emails sent to list (292 in previous quarter)
- solr-user@lucene.apache.org:
- 3516 subscribers (up 15 in the last 3 months):
- 3184 emails sent to list (3123 in previous quarter)
- java-commits@lucene.apache.org:
- 95 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- pylucene-commits@lucene.apache.org:
- 9 subscribers (up 0 in the last 3 months):
- 1 emails sent to list (0 in previous quarter)
- pylucene-dev@lucene.apache.org:
- 123 subscribers (down -1 in the last 3 months):
- 23 emails sent to list (8 in previous quarter)
- c-dev@lucene.apache.org:
- 79 subscribers (up 0 in the last 3 months):
- 2 emails sent to list (0 in previous quarter)
## JIRA activity:
- 502 JIRA tickets created in the last 3 months
- 366 JIRA tickets closed/resolved in the last 3 months
## Description:
- Lucene Core is a search-engine toolkit
- Solr is a search server built on top of Lucene Core
## Activity:
- The community is very active
## Issues:
- There are no issues requiring board attention at this time
## PMC/Committership changes:
- Currently 57 committers and 35 PMC members in the project
- Added three new committers:
Dh Upayavira on June 22
Mikhail Khludnev on July 20
Christine Poerschke on July 27
- Added no new PMC members
## Releases:
- 5.2.1 was released on June 14
- 5.3.0 was released on August 24
## Mailing list activity:
- dev@lucene.apache.org:
- 822 subscribers (up 9 in the last 3 months):
- 10742 emails sent to list (10046 in previous cycle)
- commits@lucene.apache.org:
- 213 subscribers (unchanged)
- 7876 emails sent to list (8310 in previous cycle)
- c-commits@lucene.apache.org:
- 17 subscribers (unchanged)
- 0 emails sent to list (0 in previous cycle)
- ruby-dev@lucene.apache.org:
- 68 subscribers (unchanged)
- 0 emails sent to list (0 in previous cycle)
- general@lucene.apache.org:
- 971 subscribers (up 17 in the last 3 months)
- 50 emails sent to list (31 in previous cycle)
- solr-commits@lucene.apache.org:
- 94 subscribers (down 1 in the last 3 months)
- 0 emails sent to list (0 in previous cycle)
- java-user@lucene.apache.org:
- 1103 subscribers (up 10 in the last 3 months)
- 301 emails sent to list (307 in previous cycle)
- solr-user@lucene.apache.org:
- 3501 subscribers (up 43 in the last 3 months)
- 3203 emails sent to list (3176 in previous cycle)
- java-commits@lucene.apache.org:
- 95 subscribers (unchanged)
- 0 emails sent to list (0 in previous cycle)
- pylucene-commits@lucene.apache.org:
- 9 subscribers (unchanged)
- 0 emails sent to list (6 in previous cycle)
- pylucene-dev@lucene.apache.org:
- 124 subscribers (up 3 in the last 3 months)
- 8 emails sent to list (23 in previous cycle)
- c-dev@lucene.apache.org:
- 79 subscribers (unchanged)
- 0 emails sent to list (0 in previous cycle)
## JIRA activity:
- 631 JIRA tickets created in the last 3 months
- 460 JIRA tickets closed/resolved in the last 3 months
WHEREAS, the Board of Directors heretofore appointed Mark Miller to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Mark Miller from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Michael McCandless as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Mark Miller is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Michael McCandless be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7B, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
## Description:
- Lucene Core is a search-engine toolkit.
- Solr is a search server built on top of Lucene Core.
## Activity:
- The community is very active as can be seen via the below stats.
- We have submitted a resolution to change the PMC Chair from Mark Miller
to Michael McCandless.
## Issues:
- There are no issues requiring board attention at this time.
## PMC/Committership changes:
- Currently 54 committers and 35 PMC members in the project.
- Timothy Potter was added to the PMC on Tue May 26 2015
- Last committer addition was Ramkumar Aiyengar at Sat Feb 28 2015
## Releases:
- 5.1 was released on Tue Apr 14 2015
- 5.2 was released on Sun June 7 2015
- 5.2.1 is in process.
## Mailing list activity:
- dev@lucene.apache.org:
- 816 subscribers (up 13 in the last 3 months):
- 10140 emails sent to list (10528 in previous quarter)
- c-commits@lucene.apache.org:
- 17 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- ruby-dev@lucene.apache.org:
- 68 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- general@lucene.apache.org:
- 943 subscribers (down -5 in the last 3 months):
- 40 emails sent to list (21 in previous quarter)
- solr-commits@lucene.apache.org:
- 95 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- java-user@lucene.apache.org:
- 1094 subscribers (down -8 in the last 3 months):
- 287 emails sent to list (513 in previous quarter)
- solr-user@lucene.apache.org:
- 3463 subscribers (up 30 in the last 3 months):
- 3217 emails sent to list (2952 in previous quarter)
- java-commits@lucene.apache.org:
- 95 subscribers (down -1 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- pylucene-commits@lucene.apache.org:
- 9 subscribers (up 0 in the last 3 months):
- 6 emails sent to list (2 in previous quarter)
- pylucene-dev@lucene.apache.org:
- 121 subscribers (up 1 in the last 3 months):
- 22 emails sent to list (24 in previous quarter)
- c-dev@lucene.apache.org:
- 79 subscribers (up 0 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
## JIRA activity:
- 616 JIRA tickets created in the last 3 months
- 445 JIRA tickets closed/resolved in the last 3 months
- Lucene Core is a search-engine toolkit.
- Solr is a search server built on top of Lucene Core.
## Activity:
- The community is very active as can be seen via the below stats.
## Issues:
- There are no issues requiring board attention at this time.
## PMC/Committership changes:
- Currently 54 committers and 34 PMC members in the project.
- New PMC members:
- Anshum Gupta was added to the PMC on Wed Mar 04 2015
- Ryan Ernst was added to the PMC on Tue Dec 23 2014
- New commmitters:
- Varun Thacker was added as a committer on Thu Feb 26 2015
- Ramkumar Aiyengar was added as a committer on Sat Feb 28 2015
## Releases:
- 5.0 was released on Fri Feb 20 2015
- 4.10.3 was released on Mon Dec 29 2014
## Mailing list activity:
- dev@lucene.apache.org:
- 801 subscribers (up 6 in the last 3 months):
- 10576 emails sent to list (8648 in previous quarter)
- c-commits@lucene.apache.org:
- 17 subscribers (down -1 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- ruby-dev@lucene.apache.org:
- 68 subscribers (down -1 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- general@lucene.apache.org:
- 946 subscribers (up 21 in the last 3 months):
- 21 emails sent to list (82 in previous quarter)
- solr-commits@lucene.apache.org:
- 95 subscribers (down -1 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- java-user@lucene.apache.org:
- 1103 subscribers (down -17 in the last 3 months):
- 521 emails sent to list (439 in previous quarter)
- solr-user@lucene.apache.org:
- 3433 subscribers (up 20 in the last 3 months):
- 2955 emails sent to list (2716 in previous quarter)
- java-commits@lucene.apache.org:
- 96 subscribers (down -1 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
- pylucene-commits@lucene.apache.org:
- 9 subscribers (down -1 in the last 3 months):
- 4 emails sent to list (14 in previous quarter)
- pylucene-dev@lucene.apache.org:
- 120 subscribers (up 4 in the last 3 months):
- 27 emails sent to list (60 in previous quarter)
- c-dev@lucene.apache.org:
- 79 subscribers (down -1 in the last 3 months):
- 0 emails sent to list (0 in previous quarter)
## JIRA activity:
- 666 JIRA tickets created in the last 3 months
- 475 JIRA tickets closed/resolved in the last 3 months
PyLucene
--------
PyLucene is a Python integration of Lucene Java. Development is almost
entirely an automated port, so this project will never require a lot of
developers. The user community is active.
No releases were made last quarter.
The Apache Lucene project develops open-source search software. TLP --- We added one new committer in the last quarter: Gregory Chanan Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made two releases of both Lucene Core and Solr: - 4.10.1 on 29 Sept 2014 - 4.10.2 on 31 Oct 2014 We have also started the process for a 4.10.3 release. The community is very active. Security: There was one security issue reported: - An XXS vulnerability was reported against Apache Solr (CVE-2014-3628). An attacker could inject javascript that is executed via the admin ui because stored queries are not escaped / sanitized. This will be addressed in the upcoming 4.10.3 release that is currently being voted on. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. In the last quarter we made one release of PyLucene: - 4.10.1-1 on 6 Oct 2014
The Apache Lucene project develops open-source search software. TLP --- We added one new committer in the last quarter: Tomás Fernández Löbbe George Aroush went emeritus from the PMC. We have closed down the OpenRelevance sub project. The project is dead, mailing lists are currently removed. We have preserved the Wiki. Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made two releases of both Lucene Core and Solr: - 4.9.0 on 25 June 2014 - 4.10.0 on 3 Sept 2014 The corresponding Apache Solr Reference Guide was released as PDF version, generated from the Confluence Wiki: - 4.9 on 30 June 2014 - 4.10 on 7 Sept 2014 The community is very active. Security: There were two security issues reported: - An XXE vulnerability was reported against Apache Solr (CVE-2014-3529). The issue was caused by the bundled Apache POI library. Apache POI fixed the issue and released bugfix packages. An advisory was posted on the Solr web page about how to update the bundled libraries in existing deployments. The recent release of Apache Solr 4.10.0 is no longer vulnerable. - External search web pages, referenced by the Lucene/Solr site, were vulnerable to an XSS attack. Both providers, LucidWorks and Sematext, were contacted and they fixed the problem. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. In the last quarter we made one release of PyLucene: - 4.9.0-0 on 17 July 2014
WHEREAS, the Board of Directors heretofore appointed Uwe Schindler to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Uwe Schindler from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Mark R. Miller as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Uwe Schindler is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Mark R. Miller be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7A, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
The Apache Lucene project develops open-source search software. TLP --- We added one new PMC member in the last quarter: Alan Woodward. We added one new committer in the last quarter: Timothy Potter. Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made four releases of both Lucene Core and Solr: - 4.7.1 on 2 April 2014 - 4.7.2 on 15 April 2014 - 4.8.0 on 28 April 2014 - 4.8.1 on 20 May 2014 The corresponding Apache Solr Reference Guide was released as PDF version, generated from the Confluence Wiki: - 4.8 on 2 May 2014 The community is very active. Security: There was one security incident reported to the Lucene PMC through security@apache.org on 15 April 2014 against Apache Solr. This incident was resolved because it was not possible to reproduce with the release it was reported against (Solr 4.7.0). The reporter was testing against Solr 4.4.0 and the issue was already fixed in Solr 4.5.0. Open Relevance Project ---------------------- The Open Relevance Project was a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. There were no releases since the project start in 2009, the user mailing list had the last message in Oct 2012, and the last developer mailing list post was in Jul 2013. The Apache Lucene PMC decided in a vote that the sub-project will be discontinued: http://s.apache.org/ETP The mailing lists will be closed, and the website will get a notice about the archiving of the project. The other sub-project-specific infrastructure will be integrated (where applicable, like CWIKI) into the TLP's resources. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. In the last quarter we made two releases of PyLucene: - 4.7.2-1 on 28 April 2014 - 4.8.0-1 on 3 May 2014
The Apache Lucene project develops open-source search software. TLP --- No new PMC members were added in the last quarter. The most recent PMC member addition happened in April 2013. We added three new committers in the last quarter: Areek Zillur, Benson Margulies, Anshum Gupta. We ack'ed two mentor requests for Google Summer of Code 2014. The following committers will be available to mentor GSoC students: Michael McCandless, David Smiley Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made three releases of both Lucene Core and Solr: - 4.6.1 on 28 January 2014 - 4.7.0 on 26 February 2014 The corresponding Apache Solr Reference Guides were released as PDF versions, generated from the Confluence Wiki: - 4.7 on 4 March 2014 The community is very active. Open Relevance Project ---------------------- The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. In the last quarter we made one release of PyLucene: - 4.6.1-1 on 14 February 2014
The Apache Lucene project develops open-source search software. TLP --- No new PMC members were added in the last quarter. The most recent PMC member addition happened in April 2013. We added two new committers in the last quarter: Joel Bernstein, Ryan Ernst. Wolfgang Hoschek rejoined the committer team after longer abstinence, leaving the emeritus status. Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made three releases of both Lucene Core and Solr: - 4.5.0 on 5 October 2013 - 4.5.1 on 24 October 2013 - 4.6.0 on 24 November 2013 The corresponding Apache Solr Reference Guides were released as PDF versions, generated from the Confluence Wiki: - 4.5 on 5 October 2013 - 4.6 on 2 December 2013 The community is very active. The Lucene PMC was contacted by the Oracle Quality Assurance team to help with testing EA builds of OpenJDK 8 with Lucene/Solr. Three members of the PMC had phone conferences with Oracle's QA team, discussing about working together in discovering bugs before releasing Java 8, to prevent serious data corruption issues, like happened with Java 7GA in July 2011 and Java 7u40 in September 2013. Security: There were 3 CVEs created by the Redhat security team against version 3.6.2 of Apache Solr: - CVE-2013-6397 - CVE-2013-6407 - CVE-2013-6408 Those issues were only fixed and released in Solr 4.1 and 4.6, because no new 3.x release was planned (EOL of 3.x). The committers helped to backport the fixes (see SOLR-5520). The PMC has not yet decided if there will be a maintenance release of Apache Lucene/Solr 3.6.3 containing these fixes. Open Relevance Project ---------------------- The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. In the last quarter we made one release of PyLucene: - 4.5.1-1 on 5 November 2013
The Apache Lucene project develops open-source search software. TLP --- No new PMC members were added in the last quarter. The most recent PMC member addition happened in April 2013. We added one new committer in the last quarter: Cassandra Targett. Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made one release of both Lucene Core and Solr: - 4.4.0 on 23 July 2013 In addition, for the first time, we released the PDF version of the Apache Solr Reference Guide, which is developed in the Lucene Confluence Wiki. The reference guide's content was donated by LucidWorks Inc. and incorporated into Lucene's Confluence Wiki on 3 June 2013. The first PDF release (corresponding to the 4.4.0 Lucene/Solr release) was made on 29 July 2013 and is available through the ASF mirrors. The community is very active. Open Relevance Project ---------------------- The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. In the last quarter we made one release of PyLucene: - 4.4.0-1 on 23 August 2013.
WHEREAS, the Board of Directors heretofore appointed Steven A Rowe to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Steven A Rowe from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Uwe Schindler as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Steven A Rowe is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Uwe Schindler be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7C, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
The Apache Lucene project develops open-source search software. TLP --- We have submitted a resolution to change the PMC Chair from Steven A. Rowe to Uwe Schindler. We added three new PMC members in the last quarter: David Smiley, Adrien Grand, and Shalin Shekhar Mangar. We added two new committers in the last quarter: Shawn Heisey and Han Jiang. Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made two releases of both Lucene Core and Solr: - 4.2.1 on 02 April 2013 - 4.3.0 on 04 May 2013 The community is very active. Open Relevance Project ---------------------- The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. PyLucene 4.3.0-1 was released on 14 May 2013.
The Apache Lucene project develops open-source search software. TLP --- We added two new PMC members in the last quarter: James Dyer and Stefan Matheis. No new committers were added in the last quarter. The most recent committer addition happened in October 2012. Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit. Solr is a search server built on top of Lucene Core. In the last quarter we made two releases of both Lucene Core and Solr: - 4.1 on 22 January 2013 - 4.2 on 11 March 2013 The community is very active. Open Relevance Project ---------------------- The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. PyLucene 3.6.2 was released on 04 January 2013.
TLP --- Trademarks/branding: We believe the project is now in compliance with the Apache project branding requirements. Lucene Core and Solr -------------------- Lucene Core is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. In the last quarter, we released Lucene Core and Solr 4.0 final. We have added one new committer in the last quarter: Alan Woodward. We have added one new PMC member in the last quarter: Sami Siren. Open Relevance Project ---------------------- The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. There were no PyLucene releases in the last quarter.
TLP --- Trademarks: We have not made progress on trademarks since the last board report, but do intend to finish the necessary pieces. * Project Naming And Descriptions : We believe this is complete, but are still reviewing. * Website Navigation Links : navbar links included, link to www.apache.org included. Likely complete, but under review. * Trademark Attributions : attribution for all ASF marks included in footers, etc. The main TLP site is converted, subproject sites have not. * Logos and Graphics : include TM, use consistent product logo on your site In progress. Some have been converted to have TM, some not. We don't seem to have ready volunteers on the graphical front, so it is slower than we'd like * Project Metadata : DOAP file checked in and up to date Done LUCENE JAVA/Solr ---------------- Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. In the last quarter, we have released Lucene and Solr 3.6.1, as well as two preview releases for 4.0: 4.0-ALPHA and 4.0-BETA. We hope to release 4.0-final soon. We have added one new committer: Greg Bowyer. Open Relevance Project ---------------------- The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene -------- PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. PyLucene 3.6.1 was released on August 24th.
WHEREAS, the Board of Directors heretofore appointed Simon Willnauer to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Simon Willnauer from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Steven A Rowe as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Simon Willnauer is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Steven A Rowe be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special Order 7E, Change the Apache Lucene Project Chair, was approved by Unanimous Vote of the directors present.
TLP
We have submitted a resolution to change the PMC Chair from Simon Willnauer
to Steven Rowe.
We have added a new PMC member:
* Erick Erickson
Trademarks:
We have not made progress on trademarks since the last board report, but
do intend to finish the necessary pieces.
* Project Naming And Descriptions :
We believe this is complete, but are still reviewing.
* Website Navigation Links : navbar links included, link to
www.apache.org included.
Likely complete, but under review.
* Trademark Attributions : attribution for all ASF marks included in
footers, etc.
The main TLP site is converted, subproject sites have not.
* Logos and Graphics : include TM, use consistent product logo on your
site In progress. Some have been converted to have TM, some not.
We don't seem to have ready volunteers on the graphical front,
so it is slower than we'd like
* Project Metadata : DOAP file checked in and up to date
Done
LUCENE JAVA/Solr
Lucene Java is a search-engine toolkit and Solr is a search server
built on top of Lucene. The community is very active. The community
has recently switched to the Apache CMS including several improvements
that increased the number of package downloads significantly.
We recently released Lucene and Solr 3.6.
The community has created the first Lucene 4.0-ALPHA release candidate
and is working towards stable API for the next major version release.
Additionally, we have added one new committer:
* Adrien Grand
Open Relevance Project
The Open Relevance Project is a project aimed at providing Lucene
and others tools for judging the quality of search and machine
learning approaches. The community is not very active, but
we don't expect it to be very high volume either as it is a niche
area.
PyLucene
PyLucene is a Python integration of Lucene Java. Development is
almost entirely an automated port, so this project will never
require a lot of developers. The user community is active.
TLP We have added several new PMC members: * Martijn van Groningen * Dawid Weiss * Jan Jøydahl Trademarks: We have not made progress on trademarks since the last board report, but do intend to finish the necessary pieces. * Project Naming And Descriptions : We believe this is complete, but are still reviewing. * Website Navigation Links : navbar links included, link to www.apache.org included. Likely complete, but under review. * Trademark Attributions : attribution for all ASF marks included in footers, etc. The main TLP site is converted, subproject sites have not. * Logos and Graphics : include TM, use consistent product logo on your site In progress. Some have been converted to have TM, some not. We don't seem to have ready volunteers on the graphical front, so it is slower than we'd like * Project Metadata : DOAP file checkedin and up to date Done LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. The community has recently switched to the Apache CMS including several improvement that increased the number of package downloads significantly. The community is working towards a Lucene & Solr 3.6 release and plans to branch trunk in preparation for a Lucene 4.0 Alpha release. Additionally, we have added several new committers: * David Smiley * Christian Moen * Sami Siren * James Dyer * Stefan Matheis * Tommaso Teofili Open Relevance Project The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active.
Trademarks: We have not made progress on trademarks since the last board report, but do intend to finish the necessary pieces. * Project Naming And Descriptions : We believe this is complete, but are still reviewing. * Website Navigation Links : navbar links included, link to www.apache.org included. Likely complete, but under review. * Trademark Attributions : attribution for all ASF marks included in footers, etc. The main TLP site is converted, subproject sites have not. * Logos and Graphics : include TM, use consistent product logo on your site In progress. Some have been converted to have TM, some not. We don't seem to have ready volunteers on the graphical front, so it is slower than we'd like * Project Metadata : DOAP file checked in and up to date Done * Once we finish migrating to the new CMS based Website trademarks need to be re-evaluated. LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. The community has made significant progress on cutting over to the Apache CMS. The community has recently released Lucene & Solr 3.5. Open Relevance Project The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The community is active and is working towards a PyLucene 3.5 release. PyLucene 3.4.0 was released on September 19th. PyLucene 3.5.0 should be released shortly, the release vote is pending.
Trademarks: We have not made progress on trademarks since the last board report, but do intend to finish the necessary pieces. * Project Naming And Descriptions : We believe this is complete, but are still reviewing. * Website Navigation Links : navbar links included, link to www.apache.org included. Likely complete, but under review. * Trademark Attributions : attribution for all ASF marks included in footers, etc. The main TLP site is converted, subproject sites have not. * Logos and Graphics : include TM, use consistent product logo on your site In progress. Some have been converted to have TM, some not. We don't seem to have ready volunteers on the graphical front, so it is slower than we'd like * Project Metadata : DOAP file checked in and up to date Done LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. The community has made significant progress on cutting over to the Apache CMS. The community has recently released Lucene & Solr 3.3. The community is actively working on releasing Lucene & Solr 3.4. Open Relevance Project The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. PyLucene 3.3-3 was released on July 23rd.
WHEREAS, the Board of Directors heretofore appointed Grant Ingersoll
to the office of Vice President, Apache Lucene, and
WHEREAS, the Board of Directors is in receipt of the
resignation of Grant Ingersoll from the office of Vice President,
Apache Lucene, and
WHEREAS, the Project Management Committee of the Apache
Lucene project has chosen by vote to recommend Simon Willnauer
as the successor to the post;
NOW, THEREFORE, BE IT RESOLVED, that Grant Ingersoll is relieved
and discharged from the duties and responsibilities of the office
of Vice President, Apache Lucene, and
BE IT FURTHER RESOLVED, that Simon Willnauer be and
hereby is appointed to the office of Vice President, Apache Lucene, to
serve in accordance with and subject to the direction of the
Board of Directors and the Bylaws of the Foundation until
death, resignation, retirement, removal or disqualification, or
until a successor is appointed.
Resolution 7B was approved unanimously by roll call vote.
=== Lucene Status Report: June 2011 === TLP We have submitted a resolution to change the chair from Grant Ingersoll to Simon Willnauer. Trademarks: We have not made progress on trademarks since the last board report, but do intend to finish the necessary pieces. * Project Naming And Descriptions : We believe this is complete, but are still reviewing. * Website Navigation Links : navbar links included, link to www.apache.org included Likely complete, but under review. * Trademark Attributions : attribution for all ASF marks included in footers, etc. The main TLP site is converted, subproject sites have not. * Logos and Graphics : include TM, use consistent product logo on your site In progress. Some have been converted to have TM, some not. We don't seem to have ready volunteers on the graphical front, so it is slower than we'd like * Project Metadata : DOAP file checkedin and up to date Done LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. The community just released 3.2.0. Martijn van Groningen, Chris Male, Andi Vajda and Erick Erickson were added as committers. Open Relevance Project The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. PyLucene PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. A vote for release candidate 1 for version 3.2.0, based on Lucene Java's recent 3.2.0 release, is currently open.
Background: Lucene has been asked by the Board to report on the state of the community vis-a-vis the problems around the recent commit/revert incident (https://issues.apache.org/jira/browse/SOLR-2272 and the related Lucene issue as well as several other mail threads) The primary root of these problems arose from a disagreement about how best to move forward with the two products the Lucene PMC ships: Apache Lucene and Apache Solr. A majority of the PMC/committership is in favor of a more modular approach to Solr which essentially means refactoring code that has lived in Solr for a long time into modules that can be more easily consumed at the Java API level (as opposed to the Solr REST API level.) Others have resisted these changes, sometimes for technical reasons and sometimes for what appear to be business/political reasons. Still others have a view that they should be taken on a case by case basis. These people are not against the refactoring, but don't think is absolutely necessary that it must be done in order to make other contributions to that particular code base. After long debate, we seem to have arrived at a consensus that those who wish to do the refactoring should go ahead with it, but it shouldn't require others to stop working in the areas that are of refactoring interest. For the record, the business/political reasoning has been clearly repudiated by the rest of the PMC. Other concerns have arisen about the use of IRC such that we have started to use a logging client for IRC. We have also reminded everyone to keep all decisions on list and to allow proposed decisions to "bake" before committing, at least when it comes to major issues/changes. Some in the community have also raised concerns about Lucid Imagination's role in development. While Lucid does employ a good number (but nowhere near the majority) of committers [1], (and which is almost completely balanced by IBM's presence) the general consensus seems to be that it is not a concern. Furthermore, during the recent debates, it is quite clear that Lucid employees are free to have independent viewpoints on what to do. Naturally, given a number of committers in one company, it warrants the PMC keeping a watchful eye on it. Likewise, however, it should also be clear that every PMC/committer involved in Lucene (with the exception of Andi Vajda) is paid to work on Lucene/Solr and they all have financial interests and are often in competition for the same clients. All should recognize that this doesn't necessarily make for problems, but can do so if people let it. Beyond this, we have put forth a few other things that we can do to help keep the community moving forward in a positive way. These are itemized below: 1. Obviously, with projects as big and widely used as Lucene and Solr, it is hard to sometimes keep up with all the contributions that come in. Thus, we need to find a way to automate (similar to Hadoop's patch checker) the basics of patch checking like having unit tests, formatting, etc. such that contributors can get feedback sooner and so that committers know that a patch is ready for review, thereby making it easier to accept contributions and, hopefully, encourage newcomers. We also need to more consistently promote contributors to committers and committers to the PMC. As with most of the ASF, our current approach is dependent on remembering to make a nomination and we should look for better ways to identify candidates (such a reporting mechanism would likely benefit all the ASF, actually.) 2. We have added three new PMC Members: Doron Cohen, Shai Erera, Steve Rowe 3. The Board should expect a resolution to change the PMC Chair for the June Board Meeting. We also plan on changing the chair on a yearly basis. 4. Thanks to Greg's intervention, we all have been reminded as to proper etiquette when it comes to commits/reverts such that the main symptom of this disagreement should not happen again. 5. To some extent, we feel this has been overblown and many of us have come to the conclusion that the simplest way to move forward is to get back to writing code and improving Lucene and Solr and getting releases out. This is not intended to paper over the concerns, but to note that the whole point of the project is to deliver open source search software via the ASF guidelines. To that end, we are working on releasing 3.2 of Lucene and Solr as well as continuing development on 4.0. [1] Current PMC Members/Committers and their employers * means PMC Bill Au (billa@...) -- CBS Interactive * Michael Busch (buschmi@...) -- Twitter * Doron Cohen (doronc@...) -- IBM * Shai Erera (shaie@...) -- IBM * Otis Gospodnetic (otis@...) -- Sematext * Erik Hatcher (ehatcher@...) -- Lucid * Chris Hostetter (hossman@...) -- Lucid * Grant Ingersoll (gsingers@...) -- Lucid * Mike McCandless (mikemccand@...) -- IBM * Ryan McKinley (ryan@...) -- Voyager GIS (Lucid advisor) * Mark Miller (markrmiller@...) -- Lucid * Robert Muir (rmuir@...) -- Lucid (recent) Noble Paul (noble@...) -- AOL * Steven Rowe (sarowe@...) -- Syracuse Univ. * Uwe Schindler (uschindler@...) -- SD Data Solutions Shalin Shekhar Mangar (shalin@...) -- AOL * Yonik Seeley (yonik@...) -- Lucid * Koji Sekiguchi (koji@...) -- Rondhuit Dawid Weiss (dweiss@...) -- CarrotSearch Stanislaw Osinski -- CarrotSearch * Simon Willnauer (simonw@...) -- JTeam/Independent Chris Male (chrism@...) -- JTeam Andi Vajda (vajda@...) -- Google * Scott Ganyo -- Actor * Mark Harwood -- Detica Adriano Crestani -- IBM
TLP Trademarks: We have not made progress on trademarks since the last board report, but do intend to finish the necessary pieces. * Project Naming And Descriptions : We believe this is complete, but are still reviewing. * Website Navigation Links : navbar links included, link to www.apache.org included Likely complete, but under review. * Trademark Attributions : attribution for all ASF marks included in footers, etc. The main TLP site is converted, subproject sites have not. * Logos and Graphics : include TM, use consistent product logo on your site In progress. Some have been converted to have TM, some not. We don't seem to have ready volunteers on the graphical front, so it is slower than we'd like * Project Metadata : DOAP file checked in and up to date Done Issues: Lucene.Net has been moved to Incubator with a new set of committers and new oversight with the goal of becoming a TLP. LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. The community is very close to a 3.1 release of both Lucene and Solr. Dawid Weiss and Stanislaw Osinski were added as committers Open Relevance Project The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. Having said that, we have discussed if it might be better served as simply being a part of Lucene/Solr. PyLucene PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. The project will release 3.1 once the Java version is released.
=== Lucene Status Report: Dec 2010 === TLP Simon Willnauer and Koji Sekiguchi were added to the PMC. This brings our total to 17 PMC members from 12 different companies, spanning the globe. The flagship Lucene/Solr has 26 total committers from 20 different companies, again spanning the globe. Trademarks: * Project Naming And Descriptions : We believe this is complete, but are still reviewing. * Website Navigation Links : navbar links included, link to www.apache.org included. Likely complete, but under review. * Trademark Attributions : attribution for all ASF marks included in footers, etc. The main TLP site is converted, subproject sites have not. * Logos and Graphics : include TM, use consistent product logo on your site In progress. Some have been converted to have TM, some not. We don't seem to have ready volunteers on the graphical front, so it is slower than we'd like * Project Metadata : DOAP file checkedin and up to date Done Also, we are beginning the migration to the new ASF CMS, so may push some of this work to that process. Issues: The Lucene.NET subproject community has been stagnating for some time now and the PMC has stepped in and asked the community to respond to growing concerns about the viability of the community. See http://s.apache.org/lucenenet for the first thread in a very long discussion. At some point, we expect Lucene.NET will either apply to be a TLP (after going back through the Incubator, possibly) or apply for the Attic (it is clear that the current PMC is not the appropriate place for it despite the common name since most of us are not .NET users) and fork off somewhere else under a different name. We do not believe there is any Board action required at this point, but there likely will be in the not too distant future once the community has decided on their future direction. We do not hold out much hope for this community since the committers did not even respond to repeated requests to file it's portion of this report. LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. The community has just released Lucene 2.9.4 and 3.0.3 and is actively working on future releases. Steven Rowe and Adriano Crestani were added as committers this quarter. LUCENE.NET Lucene.NET is a .NET based port of Lucene Java. Open Relevance Project The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either as it is a niche area. Having said that, we have discussed if it might be better served as simply being a part of Lucene/Solr. PyLucene PyLucene is a Python integration of Lucene Java. Development is almost entirely an automated port, so this project will never require a lot of developers. The user community is active. The PyLucene 2.9.4 and 3.0.3 releases that reflect the just-occurred Lucene java releases are ready.
=== Lucene Status Report: Sept, 2010 === TLP The Lucy project has been moved to Incubator where it intends to become a TLP. LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community is very active. The community is working towards 2.9.4, 3.0.3, 3.1 and 4.0 releases. LUCENE.NET Lucene.NET is a .NET based port of Lucene Java. Development appears to have stagnated and the PMC is beginning to look into issues here. Open Relevance Project The Open Relevance Project is a project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either. The community has started some discussion around what goals the project should have. PyLucene PyLucene is a Python integration of Lucene Java. Development is active. PyLucene 3.0.2-1 and 2.9.3-1 were released on July 3rd, 2010. As a development milestone, experimental Python 3.1.2 ports of PyLucene and JCC were completed July 12th, 2010.
=== Lucene Status Report: June, 2010 === TLP Due to the spin off of Nutch, Tika and Mahout, several PMC members have been removed. See the board@ archive for a full list. Doug Cutting and Mike Klaas are also now emeritus. LUCENE JAVA/Solr Lucene Java is a search-engine toolkit and Solr is a search server built on top of Lucene. The community has been actively working on merging the Solr and Lucene resources. Both projects now have a common codebase and modularization is in progress. The community is working towards a 2.9.3 and 3.0.2 release. Added Simon Willnauer as a committer LUCY Lucy is a loose C port of Lucene targeted at dynamic language bindings. Development is active, with the highlight of this quarter being the completion of Lucy's schema infrastructure. LUCENE.NET Lucene.NET is a .NET based port of Lucene Java. Development and the community are active. Open Relevance Project The Open Relevance Project is a new project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The community is not very active, but we don't expect it to be very high volume either. Some discussions are under way to build a relevance corpus. PyLucene PyLucene is a Python integration of Lucene Java. Development is active. PyLucene 3.0.2-1 and 2.9.3-1 are ready for release as soon as Lucene Java 3.0.2 and 2.9.3 ship.
The board notes the contention and feels that the project acted appropriately in removing individuals from the PMC.
Special Report to Board on Lucene's "Umbrella" Status
The Lucene Project has, for a long time, organized itself into several
related sub projects focused on common tasks related to searching. As of
our last board report (March 2010) the sub-projects were:
* Lucene-Java: Our "flagship" Java search library
* Nutch: A server application for crawling/indexing/search the web
* Solr: A server application for indexing/searching structured data
* Tika: A content extraction framework/library
* Mahout: A machine learning framework/library
* Open Relevance Project (ORP): A new initiative aimed at producing tools
& tests for improving relevance for search engines and machine learning
* Several "Ports" of Lucene-Java: Lucene.Net, PyLucene, Lucy
(These are all translations, mostly automated, of the Lucene Java API)
The board's chief concerns regarding umbrella projects, as communicated to
the Lucene PMC by Greg, seem to focus on three main issues...
1) Can every PMC member "commit" to all of these sub-projects?
2) Is the PMC generally aware of everything going on in these sub-projects?
3) Is the PMC representing these sub-proejcts adequately to the board?
The answers to these questions, in short, are:
1) Yes, and no. From the Lucene website
(quotage)
PMC members have karma for the all Lucene code, but
as a general rule avoid making changes to sub-projects
unless they have explicitly been made a committer of
that sub-project by a vote of the PMC.
(end quotage)
2) As a whole: Yes. Some PMC members are not directly involved in some
sub-projects, but every sub-project has multiple voices on the PMC.
3) We believe so, but if the board feels like more details about the state
of each sub-project needs to be included in each report, we will be
happy to elaborate more in future reports.
In this regard, we don't feel that there is any significant cause for
concern regarding the umbrella nature of the project. To quote Greg:
"we're all good. no changes are necessary."
However, based on various discussions in the community (and in some cases
spurred on by the Board's concerns), the Lucene PMC is pursuing some
changes moving forward.
The PMC has put up two resolutions for this Board meeting to spin out
Mahout and Tika, both of which have solid communities that are independent
of Lucene and search. The PMC has also consolidated development between
Solr and Lucene such that there is now a single committer base (there was
already very high overlap of code and committers) and dev mailing list
across those two projects. We intend to still release both Lucene and
Solr artifacts and to keep separate user question mailing lists for the
foreseeable future. Finally, we have put up a resolution for Nutch to be
a TLP. While it is search related, it also has a significant component
related to crawling. Nutch also has a solid, independent community from
Lucene, including a diverse set of committers.
This leaves the following sub projects: the Ports and Open Relevance.
In regards to the Ports, these fill a niche within the Lucene community
and are generally small, have almost complete technical overlap (releases
usually follow shortly after Lucene Java releases) but not necessarily a
lot of committer overlap due to them being ports to other programming
languages. Because they are nearly automated ports, there isn't a lot of
contributions to them, but there are decent sized communities of users for
each port. Branding wise, they make sense being a part of the Lucene TLP.
Thus, the PMC doesn't feel a need to spin these out, even though they
don't share SVN, etc. with Lucene core. That being said, we are still
evaluating the situation.
The Open Relevance sub project is small community effort to facilitate
discussions on relevance in Lucene. It is nice to have it's own branding,
but is made up of existing Lucene committers, so it best fits where it
is. If, at some point, we start to see traction and interest from other
search engines and other projects (Mahout, UIMA), it may make sense
=== Lucene Status Report: March, 2010 === TLP The TLP is considering some restructuring of subprojects per Board suggestions in December. Solr and Lucene are merging committers (there is already quite a bit of overlap) and development efforts, but maintaining separate user lists and artifacts. Mahout and Tika have both begun discussions on becoming TLPs and all signs are positive for such a move, but there is no board resolution to consider yet. The TLP has elected to sponsor incubation of the Lucene Connectors Framework. The project is now underway in the incubator. We expect this project will become a TLP as well. Added Mark Miller as a PMC Member. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and we have released 2.9.2 and 3.0.1. Added Chris Male as a committer. SOLR Solr is a full text search server. Development and the community is active. Community is working toward a 1.5 release. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Bug fixes and other improvements have been flying by, with many of the issues being addressed by new Nutch committer Julien Nioche. Work has been performed to integrate Tika parsing into Nutch (in addition to the existing work to integrate Tika's mime detection functionality). Community is working towards a 1.1 release. Added Julien Nioche as a committer. LUCY Lucy is a loose C port of Lucene targeted at dynamic language bindings. Basic thread support for the object system was completed. The community decided to transition from C89 to a dialect defined by the intersection of C99 and C++. LUCENE.NET Lucene.NET is a .NET based port of Lucene Java. Development and the community are active. Community is working towards a 2.9.2 release. Added Michael Garski as a committer MAHOUT Apache Mahout is working towards building a suite of scalable machine learning libraries for text and data mining. Development is active and we are working towards a 0.3 release. The Mahout community has begun discussing becoming a TLP and will likely request such a move after the 0.3 release is final. Added Drew Farris as a committer. Added Benson Margulies as a committer. Open Relevance Project The Open Relevance Project is a new project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. We added support for a third test collection: the TREC9 filtering corpus, added documentation, and improved use with Lucene's benchmarking package. PyLucene PyLucene is a Python integration of Lucene Java. Development is active. PyLucene 3.0.1-1 and 2.9.2-1 were released this quarter. TIKA Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Progress has been steady, with 2 remaining issues in JIRA ready for a 0.7 release, which should happen likely within the next month or so.
Board suggests: discuss, allow people enough time to participate, then vote. And there is a general offer to all projects to request a Director to participate as an impartial advisor in controversial discussions.
TLP -The PMC added George Aroush and Chris Mattmann to the PMC -The PMC added Open Relevance committer Robert Muir -The PMC added Mahout committer Jake Mannix -The PMC added Tika committer Ken Krugler LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and we released both 2.9 and 3.0 this quarter SOLR Solr is a full text search server using Lucene Java. Development and the community is active. Solr released version 1.4 this quarter. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. There has been a recent flurry of work on discussing Nutch's future post ApacheCon, spearheaded by Andrzej Bialecki and others. In addition, there is ongoing work on reducing code duplication (tighter integration of the Tika parsing framework and mime type detection, better Solr integration) and using a more flexible storage system (e.g. HBase). Many issues are being fixed in preparation for a 1.1 release early next quarter. LUCY Lucy is a loose C port of Lucene targeted at dynamic language bindings. Development this quarter has focused on abstraction of the IO subsystem and portability to various compiler platforms. LUCENE.NET Lucene.NET is a .NET based port of Lucene Java. Development and the community are active. Lucene.NET graduated from the incubator and is now a full-fledged Lucene sub-project. Mahout Apache Mahout is working towards building a suite of scalable machine learning libraries for text and data mining. Development is active and version 0.2 was released this quarter. Open Relevance Project The Open Relevance Project is a new project aimed at providing Lucene and others tools for judging the quality of search and machine learning approaches. The project added Robert Muir as a committer this quarter and development is getting under way. Recent work has added support for Indonesian "Tempo" and Persian "Hamshahri" collection to execute relevance judgements with lucene-benchmark. PyLucene PyLucene is a Python integration of Lucene Java. Development is active. Closely tracking the Lucene Java releases, we released PyLucene 2.9.0, PyLucene 2.9.1 and PyLucene 3.0.0 this quarter. A major addition was made to JCC, the code generator making PyLucene possible: the support for Java generics now in use by Lucene Java 3.0. TIKA Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Tika released version 0.5 this quarter. There have been recent development efforts to speed up Tika's mime detector, as well as efforts to provide a self-contained OGSI-based Tika bundle. There is a strong desire to release these post 0.5 improvements, so we are planning to release Tika 0.6 in the next few weeks.
Board would like to avoid umbrella projects, and Lucene (and Hadoop) both appear to be heading down this path. Doug's concern is that some of the subprojects may have enough (quantity) committers, but may not have enough diversity (e.g., all of the committers may be from one company). Encouraging either common committers across subprojects or for subprojects be spun out would bring issues to the forefront. Doug suggests that people with concerns be brought to the PMC.
Jim notes that Lucene is aware of the issue, and encourages them to split out subprojects. Meanwhile, the board will monitor. Greg will like a special report on the one question: what that status of each subprojects with respect to diversity and splitting out as a TLP? Greg to pursue.
=== Lucene Status Report: Sept, 2009 === TLP -The PMC added Mahout committers David Hall, Deneche Abdelhakim, Robin Anil -The PMC added Lucene Java committer Robert Muir LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and we are in the final stages of releasing Lucene 2.9. SOLR Solr is a full text search server. Development and the community is active. Solr is in the final push towards the release of 1.4. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Development of 1.0 line has stalled as a major redesign has been under discussion to address various shortcomings of the current platform, and avoid duplication of effort with other Apache projects. Two milestone prototypes (OSGI-based and HBase-based) have been created, which will be further examined and probably merged to form the new architecture. LUCY Lucy is a loose C port of Lucene targeted at dynamic language bindings. The pace of development has picked up this year, and a significant milestone was achieved with the completion of the core object model. We are working aggressively towards alpha release. LUCENE.NET (incubating) Lucene.NET is a .NET based port of Lucene Java. Development and the community are active. Incubating project needs to look towards graduation soon. MAHOUT Apache Mahout is working towards building a suite of scalable machine learning libraries for text and data mining. Development is active and we are working towards a 0.2 release. PyLucene PyLucene is a Python integration of Lucene Java. Development is active. Since it is a port of Lucene Java, a release would be expected after Lucene 2.9 is released TIKA Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Tika 0.4 was released in July. Development continues at the steady pace of a few commits per week. User list activity seems to be increasing.
=== Lucene Status Report: March, 2009 === TLP -The PMC voted to create a new subproject named the Open Relevance Project designed to collect and distribute collections, queries and relevance judgments for search (and other) testing. -The PMC added Mahout committers Sean Owen and Ted Dunning. -The PMC added PyLucene committer Andi Vajda. -The PMC added Nutch committer Dennis Kubes. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and we are working towards the release of 2.9. Lucene added Uwe Schindler as a core committer. SOLR Solr is a full text search server. Development and the community is active. Solr is working towards the release of 1.4. Solr added Mark Miller and Noble Paul as committers. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Nutch 1.0 was released on March 28, 2009. Development is active, though slow. A major redesign and re-targeting of the project is planned and under discussion. LUCY Lucy is a C-based port of Lucene Java. Discussion has picked up on the Lucy dev mailing list and signs are positive, but we are still monitoring the project for viability. LUCENE.NET (incubating) Lucene.NET is a .NET based port of Lucene Java. Development and the community are active. Incubating project needs to look towards graduation soon. MAHOUT Apache Mahout is working towards building a suite of scalable machine learning libraries for text and data mining. Mahout released its first public release, version 0.1, on April 7, 2009. Mahout marked Ozgur Yilmazel, Erik Hatcher and Niranjan Balasubramanian as emeritus committers. PyLucene PyLucene is a Python integration of Lucene Java. Development is active. PyLucene 2.4.1 was first released on April 03, 2009. A refresher release, PyLucene 2.4.1-2, was released on May 23, 2009. TIKA Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Tika 0.3 was released in March, and we are planning to release version 0.4 soon. Tika development continues at a steady pace with no major roadblocks in sight. A Solr-based search feature built and hosted by Lucid Imagination was added to the Tika web site.
=== Lucene Status Report: March, 2009 === TLP Jukka Zitting was added to the PMC. The PMC also accepted a software grant to add PyLucene, a Python based port of Lucene into the Lucene family. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and we are working towards the release of 2.9. 2.4.1 was released on March 9, 2009. SOLR Solr is a full text search server. Development and the community is active. Solr is working towards the release of 1.4 NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Nutch is in the process of releasing version 1.0 LUCY After some public debate on the (lack) of progress on the project, we will be keeping a close eye on it over the next six months. People have expressed an interest in seeing it continue and some progress has been made to that end. LUCENE.NET (incubating) The .NET community is picking up some steam and has begun looking into graduation from the incubator. MAHOUT Apache Mahout is working towards building a suite of scalable machine learning libraries for text and data mining. Some progress has been made on adding more clustering algorithms as well as perceptron and winnow. We are working on the processes for a 0.1 release and expect to do that release soon. PyLucene PyLucene was donated by the Open Source Applications Foundation. Andi Vajda and Mike McCandless are the initial committers on the project. PyLucene is working towards it's first release as an Apache hosted project. TIKA Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. The first candidate for the 0.3 release is already in place and the release should be pushed out in March. Metadata handling and metadata frameworks like XMP have been a source of much discussion, but so far no clear consensus on has been reached on whether or how the metadata features in Tika should be extended. A wiki was created for Tika.
=== Lucene Status Report: December, 2008 === TLP The TLP has added Lucene Java committer Michael Busch to the PMC. CRYPTOGRAPHY Nutch uses PDFBox and thus has a dependency on BouncyCastle. https://issues.apache.org/jira/browse/NUTCH-621 is now closed. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and we are working towards the release of 2.9. Uwe Schindler has been added as a contrib committer. SOLR Solr is a full text search server. Development and the community is active. Solr 1.3 was released on September 15, 2008. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Development activity (measured by number of commits) has been low, mainly bug fixes and minor enhancements. There are however some nice new exciting features, currently under discussion attached to Jira. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Some small, incremental progress has been made this quarter. LUCENE.NET (incubating) Lucene.Net continues to thrive with the addition of two new committers, Doug Sale and Digy. The project is still working through making some official releases and getting organized but the community is vibrant. TIKA Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Tika has graduated from the Incubator and is now a Lucene subproject. On December 9th, 2008, Tika 0.2 was released under the Lucene PMC. MAHOUT Apache Mahout is a new subproject of the Lucene PMC with the goal of building a suite of scalable machine learning libraries for text and data mining. We know have Map-Reduce implementations of several clustering algorithms, 2 classification algorithms based on bayesian statistics and support for scaling fitness functions in genetic algorithms. We are working on bug fixes and documentation to get ready for a 0.1 release.
We discussed the number of subprojects and the community cohesion across same. We did not see a problem at this time.
=== Lucene Status Report: 17th of September, 2008 === TLP The TLP has accepted a software grant to bring geographic search capabilities to Lucene and Solr. CRYPTOGRAPHY Nutch uses PDFBox and thus has a dependency on BouncyCastle. https://issues.apache.org/jira/browse/NUTCH-621 has been opened and is in process. Steps 1 through 3 have been completed and the Nutch team is completing step 4. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and we are nearing the release of 2.4. SOLR Solr is a full text search server. Development and the community is active. Shalin Shekhar Mangar was added as a committer. Solr 1.3 will be released in the next few days. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Development activity (measured by number of commits) has been low, mainly bug fixes and minor enhancements. There are however some nice new exciting features, currently under discussion attached to Jira. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. No progress has been made this quarter, but we have been in contact with the committers and they are still interested in the project and plan to be more active in the near future. LUCENE.NET (incubating) No change since last report. There is some brewing of bringing in a couple of new committers, but no official action on that yet. This project does seem to have a small community of users, with the occasional tricky question posted to the e-mail list. It's a fairly straightforward port, so several that have needed help with it have asked general questions in the java-user@lucene community. TIKA (incubating) Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Tika is discussing graduating from the incubator. MAHOUT Apache Mahout is a new subproject of the Lucene PMC with the goal of building a suite of scalable machine learning libraries for text and data mining. We know have Map-Reduce implementations of several clustering algorithms, 2 classification algorithms based on bayesian statistics and support for scaling fitness functions in genetic algorithms. We had 2 successful GSOC students participate over the summer. We are nearing our first, 0.1, release.
=== Lucene Status Report: 25th of June, 2008 === TLP The TLP has added two new PMC members: Mike Klaas and Ryan McKinley. The PMC also voted to mark Christoph Goller as emeritus due to lack of participation for over 1 year and failure to respond to inquiries. CRYPTOGRAPHY Nutch uses PDFBox and thus has a dependency on BouncyCastle. https://issues.apache.org/jira/browse/NUTCH-621 has been opened and is actively being worked on. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been active and there have been many core improvements, especially in the area of indexing performance and error recovery. Version 2.3.2 was released on 2008-05-06. SOLR Solr is a full text search server. We continue to see strong adoption and community interest. Development has been active with many new core features being added. Koji Sekiguchi was added as a committer. Solr 1.3 is expected to be released in the next quarter. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Otis Gospodnetic was added as a Nutch committer. Development of the current code base was limited, and the planned 1.0 release is moved to Q3 2008. Nutch community started discussions about a fundamental redesign of the platform for the next releases. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. No progress has been made this quarter, but there has been some recent email activity. LUCENE.NET (incubating) Michael Garski, of MySpace, has a couple of developers to bring on board. Currently there is no active committership, though their is a small community of users present on the mailing list. We're still optimistic that this project will see new life soon. TIKA (incubating) Apache Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Tika entered incubation on March 22nd, 2007. Niall Pemberton joined the project as a committer and PPMC member. Community is currently working towards 0.2 release. MAHOUT Apache Mahout is a new subproject of the Lucene PMC with the goal of building a suite of scalable machine learning libraries for text and data mining. We have received the Taste Collaborative Filtering engine into Mahout as via a software grant from Sean Owen. We have also implemented several machine learning algorithms to date. Sean Owen and Ted Dunning were added as committers.
TLP The top-level project voted to promote Hadoop to it's own TLP, hadoop.apache.org. Nigel Daley, Owen O'Malley and Tom White resigned their positions on the Lucene PMC to focus on the Hadoop PMC. The TLP also voted to create a new project, named Apache Mahout, to build scalable machine learning libraries. Doug Cutting has resigned as Chair of the Lucene PMC. Grant Ingersoll has been elected the new chair. CRYPTOGRAPHY Nutch uses PDFBox and thus has a dependency on BouncyCastle. We have not begun the process specified at http://www.apache.org/dev/crypto.html, but will do so in the near term. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been very active and there have been many core improvements, especially in the area of indexing performance and error recovery. Version 2.3.0 was released on 2008-01-24, and a minor bug fix release (2.3.1) was made on 2008-02-23. SOLR Solr is a full text search server. We continue to see strong adoption and community interest. Development has been active with many new core features being added. Grant Ingersoll was added as a committer. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Development is active. Recent work has concentrated on stability and bug-fixing in preparation for the upcoming 1.0 release, due around April. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. No progress has been made this quarter. LUCENE.NET (incubating) Lucene.Net is an port of Lucene to C# on the .NET platform. Lucene.Net struggles with committership. George Aroush has effectively stepped down, but other strong contributors have rallied and are in the process of proposing a few new committers. TIKA (incubating) Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Development has been active. MAHOUT Apache Mahout is a new subproject of the Lucene PMC with the goal of building a suite of scalable machine learning libraries for text and data mining. Initial reaction to the project has been positive, with many people expressing interest and several code contributions already made. Initial committers are Grant Ingersoll, Otis Gospodnetic, Erik Hatcher, Isabel Drost, Ozgur Yilmazel, Niranjan Balasubramanian, Karl Wettin and Dawid Weiss. Jeff Eastman was also voted in as a new committer (after the initial project creation).
WHEREAS, the Board of Directors heretofore appointed Doug Cutting to the office of Vice President, Apache Lucene, and WHEREAS, the Board of Directors is in receipt of the resignation of Doug Cutting from the office of Vice President, Apache Lucene, and WHEREAS, the Project Management Committee of the Apache Lucene project has chosen by vote to recommend Grant Ingersoll as the successor to the post; NOW, THEREFORE, BE IT RESOLVED, that Doug Cutting is relieved and discharged from the duties and responsibilities of the office of Vice President, Apache Lucene, and BE IT FURTHER RESOLVED, that Grant Ingersoll be and hereby is appointed to the office of Vice President, Apache Lucene, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed. Special order 7A, Change the Apache Lucene Project Chair, was approved by Unanimous Vote.
TLP The top-level project added one new PMC member, Michael McCandless. Lucene and it's sub-projects were well represented at ApacheCon US 2007, including highly attended trainings and sessions by project members Grant Ingersoll, Chris Hostetter, and Michael Busch and contributor Ken Krugler. The Hadoop subproject has proposed becoming a top-level project. In initial discussions there have been few objections, and we expect to put a resolution before the board in January. Hadoop's community is largely distinct from other Lucene subprojects. LUCENE JAVA Lucene Java is a search-engine toolkit. Development has been very active and there have been many core improvements, especially in the area of indexing performance. We are preparing for a feature freeze before a 2.3 release early in 2008. HADOOP Hadoop is a scalable distributed computing platform. Development has continued to be very active. Release 0.15.1 was published in November. Five new committers were added this quarter, Raghu Angadi, Hairong Kuang, Konstantin Shvachko, Runping Qi, and Chris Douglas. SOLR Solr is a full text search server. We continue to see strong adoption and community interest. Development has been active with many new core features being added. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Development has slowed somewhat this quarter, but the project is still reasonably active. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Little progress has been made this quarter. LUCENE.NET (incubating) Lucene.Net is an port of Lucene to C# on the .NET platform. Development continues, but is still primarily a one-developer project. TIKA (incubating) Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Development has been active and one new committer was added, Keith Bennett.
Approved by General Consent.
TLP
No TLP-specific news this quarter.
LUCENE JAVA
Lucene Java is a search-engine toolkit. Development was active, and a
new release was made, version 2.2. We anticipate releasing version
2.3 this quarter.
NUTCH
Nutch is a web-search engine: crawler, indexer and search runtime. A
steady stream of bug fixes and improvements have been committed into
svn since the last report.
HADOOP
Hadoop is a scalable distributed computing platform. After extensive
testing and bugfixing, release 0.14.1 was released in early September.
Five new committers were added this quarter, Michael Stack, Arun
Murthy, Devaraj Das, Enis Soztutar, and Christophe Taton.
SOLR
Solr is a full text search server. Development was active and we are
in the middle of the development phase for the next release.
LUCY
Lucy will develop a shared C-based core for ports of Lucene to other
languages, such as Perl, Python and Ruby. Only minor, sporadic
progress has been made this quarter.
LUCENE.NET (incubating)
The mailing list and issue tracker have been much more active. One
contributor ("DIGY") has been solely responsible for cleaning up a lot
of unit tests. The sole committer, George, has been keeping up with
the issues.
TIKA (incubating)
Tika is a toolkit for detecting and extracting metadata and structured
text content from various documents using existing parser libraries.
Tika entered incubation on March 22nd, 2007.
Rida's Lius Lite code has been committed and Tika now has a baseline
from which to go forward. There have been some further design
discussions on Tika mailing list but the traffic there is generally
low.
Approved by General Consent.
TLP The Lucene top-level project added three new PMC members: Nigel Daley, Chris Hostetter, Owen O'Malley and Tom White. LUCENE JAVA Lucene Java is a search-engine toolkit. Development was active, and committers are preparing to release version 2.2. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Nutch 0.9 was released on 2007-04-02. Dogacan Güney accepted invitation to join project as a committer. HADOOP Hadoop is a scalable distributed computing platform. We've reduced the release rate from monthly to once every two months. After extensive testing and bugfixing, the 0.13 release was released in early June. Performance and scalability on core benchmarks has doubled. One new committer was added this quarter, Jim Kellerman. SOLR Solr is a full text search server. Development was active and a new release was made, version 1.2, the first since leaving the Incubator. Ryan McKinley was added as a new committer. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Only minor, sporadic progress has been made again this quarter. LUCENE.NET (incubating) Lucene.Net is a port of Lucene to C# on the .NET platform. It made a release through the incubator this quarter, but is still primarily a one-developer project. TIKA (incubating) Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries. Tika entered incubation on March 22nd, 2007. We saw the first piece of Tika code when Chris A. Mattmann ported the Nutch metadata framework to Tika. Rida Benjelloun is currently working on bringing Lius code into Tika but the initial commits on that front have not yet happened.
Approved by General Consent.
TLP The top-level project added one new PMC member, Grant Ingersoll. LUCENE JAVA Lucene Java is a search-engine toolkit. Development was active and a major release was made, version 2.1. Two new committers were added: Michael Busch, and Doron Cohen. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Several significant improvements and fixes have been made during the last three months, and a new release is scheduled in March. One new committer was added, Dennis Kubes. HADOOP Hadoop is a scalable distributed computing platform. Its monthly release schedule has continued. Three new committers have been added: Tom White, Nigel Daley and Dhruba Borthakur. SOLR Solr is a full text search server. Solr recently graduated from the Incubator and became an official subproject of Lucene. Development is active, with over 60 issues resolved this quarter, and a new Ruby on Rails GUI component called Solr Flare was initiated. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Only minor, sporadic progress has been made this quarter. LUCENE.NET Lucene.Net is an incubator project providing a port of Java Lucene to the .NET platform. Much of the code is converted using a code generator, with hand tweaking as needed. Recently the Lucene.Net project has been energized with a new sense of responsibility thanks to the gentle administrative reminders of where the project has gone astray. George Aroush, the primary developer on the Lucene.Net project, has been eager to work within the incubator process, and has come up to speed a lot recently in response. All signs are good of a healthier project.
Approved by General Consent.
TLP The Lucene project added one new PMC member, Sami Siren. LUCENE JAVA Lucene Java is a search-engine toolkit. Development was active, with over 60 Jira issues resolved. Several IBM employees have started contributing significantly this quarter, including one new committer, Michael McCandless. The website was ported to Forrest. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Nutch made a 0.8.1 release in September. One new committer was added, Chris Mattmann. Development was active with over 50 issues resolved. HADOOP Hadoop is a scalable distributed computing platform. Its monthly release schedule has continued. Development has been very active, with over 200 issues resolved this quarter. Support has improved for Amazon's computing services, making it easier for folks to experiment without purchasing hundreds of machines. SOLR Solr is an enterprise search server, in incubation. Development is steady, with around 20 issues resolved this quarter. Solr now has committers from a variety of institutions and should soon graduate. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Some initial steps were made this quarter. LUCENE.NET Lucene.Net is an incubator project providing a C# port of Lucene. It still has only one active developer.
Approved by General Consent.
TLP The Lucene project added one new PMC member, Yonik Seeley. LUCENE JAVA Lucene Java is a search-engine toolkit. It's development has proceeded at a healthy pace, averaging a few commits per day by a diverse set of contributors, mostly bug fixes and minor features. No releases were made this quarter. Simon Willnauer, a Google Summer of Code intern, is a new committer. NUTCH Nutch is a web-search engine: crawler, indexer and search runtime. Nutch made its 0.8 release in July. This is a major milestone, moving Nutch on top of Hadoop's distributed computing platform, and with many other improvements. HADOOP Hadoop is a scalable distributed computing platform. Its monthly release schedule has continued. Improvements in reliability, usability and scalability are steady. Use is growing too, for example Yahoo! reports use on a cluster of 600 nodes, and PowerSet reports use on Amazon's Elastic Computing Cloud (EC2) service. SOLR Solr is an enterprise search server, in incubation. Mike Klass has been added as a committer. Development is steady, averaging around one commit per day with three primary committers. LUCY Lucy will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Little progress has been made this quarter. LUCENE.NET Lucene.Net is an incubator project providing a C# port of Lucene. Jeff Rodenburg has been added as its second committer.
Jim noted that he liked the fact that they mention SOLR and suggested that maybe all TLP's should mention something in their reports about any podlings that they have in the Incubator. This, at least, means they are keeping track of them. It was noted that Google Summer of Code efforts should also be mentioned. Sam volunteered to write up an email to this effect and send to the Incubator and PMCs.
Approved by General Consent
OVERVIEW Lucene has had an active quarter, with new releases, sub-projects and committers. The top-level project added a new PMC member, Andrzej Bialecki. LUCENE JAVA The Lucene Java sub-project, our flagship, made two releases, 1.9 and 2.0. This was a major milestone. The 1.9 release revised a number of public APIs, deprecating the old APIs, and the 2.0 release removed all of the old, now-deprecated APIs. We added two new committers: Grant Ingersoll and Chris Hostetter. This project also added nightly builds. NUTCH Nutch implements a crawler-based web search engine. Development towards Nutch's 0.8 release is steady. This is a fundamental change, moving Nutch on top of Hadoop's distributed computing platform. Lots of other smaller changes are in progress and we hope to release 0.8 in the next quarter. A Nutch installation searching Apache web properties should also soon be publicly available. HADOOP Hadoop is a new sub-project developing a distributed computing platform. It's committers include Mike Cafarella, Andrzej Bialecki and Doug Cutting from Nutch, and one new committer, Owen O'Malley. Yahoo! is contributing lots of developers to this project and it is making great progress. Hadoop makes monthly releases, with patch releases one week later. So it has had a series of more than six releases in all. Yahoo! has demonstrated good scalability of Hadoop on clusters of over 600 machines. SOLR Solr is in incubation, based on software donated by CNET, developing an enterprise search server based on Lucene. It's development is active, and needs only to build a more diverse community before it is ready to exit the incubator. LUCY Lucy is a new Lucene sub-project, still in its infancy. It will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Its initial committers are David Balmain, Marvin Humphries and Doug Cutting. LUCENE.NET This is an incubator project, providing a C# port of Lucene. It has only a single committer, but hopes to soon add more. LUCENE4C This is an incubator project that does not appear to have made any progress this quarter.
Jim asked how did LUCENE.NET enter incubation with 1 committer? It was unclear at this point. Sander noted that Lucene4c is likely to get some life in it again.
Approved by General Consent
OVERVIEW Lucene has had an active quarter, with new releases, sub-projects and committers. The top-level project added a new PMC member, Andrzej Bialecki. LUCENE JAVA The Lucene Java sub-project, our flagship, made two releases, 1.9 and 2.0. This was a major milestone. The 1.9 release revised a number of public APIs, deprecating the old APIs, and the 2.0 release removed all of the old, now-deprecated APIs. We added two new committers: Grant Ingersoll and Chris Hostetter. This project also added nightly builds. NUTCH Nutch implements a crawler-based web search engine. Development towards Nutch's 0.8 release is steady. This is a fundamental change, moving Nutch on top of Hadoop's distributed computing platform. Lots of other smaller changes are in progress and we hope to release 0.8 in the next quarter. A Nutch installation searching Apache web properties should also soon be publicly available. HADOOP Hadoop is a new sub-project developing a distributed computing platform. It's committers include Mike Cafarella, Andrzej Bialecki and Doug Cutting from Nutch, and one new committer, Owen O'Malley. Yahoo! is contributing lots of developers to this project and it is making great progress. Hadoop makes monthly releases, with patch releases one week later. So it has had a series of more than six releases in all. Yahoo! has demonstrated good scalability of Hadoop on clusters of over 600 machines. SOLR Solr is in incubation, based on software donated by CNET, developing an enterprise search server based on Lucene. It's development is active, and needs only to build a more diverse community before it is ready to exit the incubator. LUCY Lucy is a new Lucene sub-project, still in its infancy. It will develop a shared C-based core for ports of Lucene to other languages, such as Perl, Python and Ruby. Its initial committers are David Balmain, Marvin Humphries and Doug Cutting. LUCENE.NET This is an incubator project, providing a C# port of Lucene. It has only a single committer, but hopes to soon add more. LUCENE4C This is an incubator project that does not appear to have made any progress this quarter.
Tabled due to time constraints.
[ Received January 19th - was for missing December report ] News from Lucene land: - New PMC member Andrzej Bialecki (already Nutch committer) voted in - We had a vote for Stefan Groschupf to become a Nutch committer, but it looks like there are some reservations about the quality of his patches, so he may not get voted in - Nutch's MapReduce branch has been merged into trunk, while branches with previous releases are getting patched as needed - Doug Cutting proposed that Nutch's components for distributed computing (MapReduce and NDFS) be decoupled from Nutch and form a new Lucene sub-project named Hadoop - Incubator received a proposal for Solr, a Lucene-based search server, originally donated by CNET, I think, and led by Yonik Seeley (Lucene committer). I believe Solr would become a Lucene sub-project upon graduation. [ Received March 15th ] This year Lucene has released versions 1.9 and a bug fix 1.9.1 of Java Lucene. Hadoop has been very active, with its split from Nutch. In incubation are Lucene4c and Lucene.NET. Lucene4c has withered with no activity recently. Lucene.NET is finally picking up and getting its act together with the incubation process. Java Lucene 2.0 is now in active development and we are expecting a release of it in the near future.
Approved by General Consent.
No report received or submitted. Stefano to contact Doug regarding status.
The latest release is still 1.4.3. We are preparing for release of version 1.9. A LOT of good contributions and patched have been submitted to JIRA and the lists are increasingly more active. We/I plan on going through as many contributions and patches in the coming weeks (October/November), reviewing and committing them, and then making a release.
Our apologies from the Lucene PMC for the lateness of this report. We've been negligent in our Board reporting duties since going to TLP. The Lucene project status is brief: The Lucene Java project has been working towards the 1.9/2.0 release, but has made no releases in this reporting period. Nutch has been very active releasing an 0.7 version with much activity on the MapReduce (mapred) branch to be merged to trunk in the near future. MapReduce is a distributed computing layer inspired by Google to enable jobs acting on enormous datasets to be divided among nodes.
Approved by General Consent.
A report was expected, but not received
No report received or submitted.
NO SUBMITTED REPORT
No submitted report.
WHEREAS, the Board of Directors deems it to be in the best
interests of the Foundation and consistent with the
Foundation's purpose to establish a Project Management
Committee charged with the creation and maintenance of
open-source software related to the Lucene and search
technologies, for distribution at no charge to the public.
NOW, THEREFORE, BE IT RESOLVED, that a Project Management
Committee (PMC), to be known as the "Apache Search Project", be
and hereby is established pursuant to Bylaws of the Foundation;
and be it further
RESOLVED, that the Apache Search Project be and hereby is
responsible for the creation and maintenance of software for
Lucene and for related software components, based on software
licensed to the Foundation; and be it further
RESOLVED, that the office of "Vice President, Apache Search" be
and hereby is created, the person holding such office to serve
at the direction of the Board of Directors as the chair of the
Apache Search Project, and to have primary responsibility for
management of the projects within the scope of responsibility
of the Apache Search Project; and be it further
RESOLVED, that the persons listed immediately below be and
hereby are appointed to serve as the initial members of the
Apache Search Project:
Doug Cutting
Otis Gospodnetic
Erik Hatcher
Daniel Naber
Christoph Goller
Mark Harwood
Scott Ganyo
NOW, THEREFORE, BE IT FURTHER RESOLVED, that Doug Cutting be
and hereby is appointed to the office of Vice President, Apache
Search, to serve in accordance with and subject to the
direction of the Board of Directors and the Bylaws of the
Foundation until death, resignation, retirement, removal or
disqualification, or until a successor is appointed; and be it
further
RESOLVED, that the initial Apache Search Project be and hereby
is tasked with the creation of a set of bylaws intended to
encourage open development and increased participation of the
Apache Search Project, in the Java language as well as others,
and be it further
RESOLVED, that the initial Apache Search Project be and hereby
is tasked with the migration and rationalization of the Jakarta
Lucene subproject, and be it further
RESOLVED, that all responsibility pertaining to the Jakarta
Lucene sub-project and encumbered upon the Jakarta Project are
hereafter discharged.
Special Order A, a Resolution to Establish Lucene as a top level
project, was passed by Unanimous Vote.