This was extracted (@ 2024-03-20 21:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
WHEREAS, the Project Management Committee of the Apache Metron project has chosen by vote to recommend moving the project to the Attic; and WHEREAS, the Board of Directors deems it no longer in the best interest of the Foundation to continue the Apache Metron project due to inactivity; NOW, THEREFORE, BE IT RESOLVED, that the Apache Metron project is hereby terminated; and be it further RESOLVED, that the Attic PMC be and hereby is tasked with oversight over the software developed by the Apache Metron Project; and be it further RESOLVED, that the office of "Vice President, Apache Metron" is hereby terminated; and be it further RESOLVED, that the Apache Metron PMC is hereby terminated. Special Order 7A, Terminate the Apache Metron Project, was approved by Unanimous Vote of the directors present.
## Description: The mission of Apache Metron is the creation and maintenance of software related to a security analytics platform for big data use cases. ## Issues: Development activity for this project has stalled and we are seeking a new VP to right the ship, but so far none has volunteered. ## Membership Data: Apache Metron was founded 2017-04-18 (3 years ago) There are currently 39 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - No new PMC members. Last addition was Justin Leet on 2017-12-03. - No new committers. Last addition was Shane Ardell on 2018-11-16. ## Project Activity: There is no current project activity to speak of. ## Community Health: Our community health metrics are bleak, but commensurate with a project which needs revitalization. I submitted my resignation in hopes of a new volunteer who could help revitalize the project. At this point, we've had a quarter of no takers, so I'm going to pose the question more broadly to the dev list to see if we can find some interest in more radically changing the project.
## Description: The mission of Apache Metron is the creation and maintenance of software related to a security analytics platform for big data use cases. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Metron was founded 2017-04-18 (3 years ago) There are currently 39 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - No new PMC members. Last addition was Justin Leet on 2017-12-03. - No new committers. Last addition was Shane Ardell on 2018-11-16. ## Project Activity: There have been no software releases since the last board report. We do not see as much interest in the normal big data conferences and meetups as we have in the past. ## Community Health: As I indicated in the last board report, we have seen a significant drop in developer interest in this project: * We have had only 3 code contributors in the past quarter * dev@metron.apache.org had a 14% decrease in traffic in the past quarter (25 emails compared to 29) * user@metron.apache.org had a 75% decrease in traffic in the past quarter (30 emails compared to 119) I believe that Metron benefited from robust corporate investment from early on. A combination of the natural ebb and flow of interest with our main corporate investment shifting has drawn away the core committers. I started a discussion shortly after the last board report which had some engagement on dev@, but the interest soon petered out again and that did not translate into PRs or dev@ discussion. The discussion brought to light that we could use some rearchitecture and simplification, but as of yet, there has been no real engagement to bring this to a reality. As such, I believe the appropriate next steps is for me to resign the Vice Presidency and to try to draw someone into the position who will spearhead a community and developer engagement initiative. I have notified private@ of this and have called for volunteers. This is a good project and many of us have contributed our blood, sweat and tears to its advancement. It deserves better engagement and better health. I urge the ASF to give us some more time to figure out a solution to our community engagement issues.
## Description: The mission of Apache Metron is the creation and maintenance of software related to a security analytics platform for big data use cases. ## Issues: We have had nearly no development activity in the last quarter. I have initiated a community discussion about possibly shuttering the project on the dev@ list. ## Membership Data: Apache Metron was founded 2017-04-18 (3 years ago) There are currently 39 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - No new PMC members. Last addition was Justin Leet on 2017-12-03. - No new committers. Last addition was Shane Ardell on 2018-11-16. ## Project Activity: As I mentioned in the previous report, I was concerned about the drop in development. This drop has continued: we have had nearly 0 development activity in the last quarter. This is a precipitous drop and we need to get to the bottom of why. I have started a discussion thread on the dev list posing the question to the community and asking whether we want to attempt to revitalize this community or shutter it. ## Community Health: To illustrate our health challenges: 4 issues opened in JIRA, past quarter (-91% decrease) 1 issue closed in JIRA, past quarter (-98% decrease) 1 commit in the past quarter (-97% decrease) 1 code contributor in the past quarter (-91% decrease) 0 PRs opened on GitHub, past quarter (-100% decrease) 3 PRs closed on GitHub, past quarter (-93% decrease)
## Description: Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. ## Issues: There are no issues requiring board attention at this time ## Membership Data: Apache Metron was founded 2017-04-18 (3 years ago) There are currently 39 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - No new PMC members. Last addition was Justin Leet on 2017-12-03. - No new committers. Last addition was Shane Ardell on 2018-11-16. ## Project Activity: The community is working towards a 0.7.2 release in the first quarter of 2020. This release is a bugfix release, so no major features are going to be included. We also released a bugfix version of our bro (a popular open source intrusion detection system) plugin in October. This plugin allows bro to write events to kafka (and consequently process them in Metron). ## Community Health: Community health is mixed. We are seeing an up-tick in user@ mailing list discussion (~50% incrase as compared to the last quarter). At the same time, we are seeing decreased activity in both the last month as well as compared to the last quarter. Specifically: * 40% drop in traffic on the dev list * Perhaps most worrying, a 43% drop in commits as compared to last quarter. I expect some of this is due to the holidays, but it's worth keeping a closer eye on. I am going to bring this up on the lists.
## Description: The mission of Apache Metron is the creation and maintenance of software related to a security analytics platform for big data use cases. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Metron was founded 2017-04-18 (2 years ago) There are currently 39 committers and 27 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - No new PMC members. Last addition was Justin Leet on 2017-12-03. - No new committers. Last addition was Shane Ardell on 2018-11-16. ## Project Activity: A very major focus in the development effort in the last quarter is the migration to Hadoop 3.x and the associated recent versions of the ecosystem projects that we depend upon (e.g. ambari, hbase). The testing and stabilization effort has taken quite some time, but it feels as though this effort puts us in a good place to near a 1.0 in the release after this. ## Community Health: It's clear from our metrics that we have we have an uptick in code contributions (16%) and some new blood in terms of code contribution, but our discussions have gone down (a drop of 64% in dev@ and 38% in user@). This is concerning from a community contribution perspective, but perhaps somewhat understandable as the lionshare of the work has been in migrating dependencies. Still, we seem to be up and down on contribution with last quarter being an uptick and this quarter being another downtick. It is something worth monitoring.
## Description:
Metron integrates a variety of open source big data technologies in order
to offer a centralized tool for security monitoring and analysis. Metron
provides capabilities for log aggregation, full packet capture indexing,
storage, advanced behavioral analytics and data enrichment, while applying
the most current threat-intelligence information to security telemetry
within a single platform.
## Issues:
There are no issues requiring board attention at this time
## Activity:
We released a point release in May, which provided stabilization as well
as infrastructure and abstractions to support other streaming engines.
Also, there was a conference (Dataworks Summit) in May which featured
two technical talks on Apache Metron.
## Health report:
The leadup to and aftermath of that conference seems to have had a
corresponding spike in dev and user list activity. This is
good as there was a cause for concern during the last board report.
## PMC changes:
- Currently 27 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Justin Leet on Mon Dec 04 2017
## Committer base changes:
- Currently 39 committers.
- No new committers added in the last 3 months
- Last committer addition was Shane Ardell at Fri Nov 16 2018
## Releases:
- 0.7.1 was released on Wed May 15 2019
## Mailing list activity:
While subscribers seem flat, the uptick in usage is heartening.
I include these raw statistics to support the points during the
Health Report section.
- dev@metron.apache.org:
- 197 subscribers (down -6 in the last 3 months):
- 239 emails sent to list (70 in previous quarter)
- user@metron.apache.org:
- 285 subscribers (down -2 in the last 3 months):
- 185 emails sent to list (147 in previous quarter)
## JIRA activity:
- 110 JIRA tickets created in the last 3 months
- 82 JIRA tickets closed/resolved in the last 3 months
## Description: Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. ## Issues: There are no issues requiring board attention at this time ## Activity: Work continues along the vein of stabilizing the product as well as creating infrastructure and abstractions to support other stream processing engines (e.g. Spark Streaming). Since this work is substantial, the next release is still pending (though in active discussions on the mailing lists). ## Health report: Dev mailing list activity continued steady since the January report, but it is still low when compared to the previous year. This coincides with a drop in commits as well (so at least activity is not happening without discussion). I believe this means that we will need more effort to garner interest in the project. I have hopes that presentations (2 that I am aware of) at Dataworks summit will boost interest. I suggest revisiting in the next board report. ## PMC changes: - Currently 27 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Justin Leet on Sun Dec 03 2017 ## Committer base changes: - Currently 39 committers. - No new committers added in the last 3 months - Last committer addition was Shane Ardell at Fri Nov 16 2018 ## Releases: - Last release was 0.7.0 on Sun Dec 16 2018 ## JIRA activity: - 103 JIRA tickets created in the last 3 months - 47 JIRA tickets closed/resolved in the last 3 months
## Description: Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. ## Issues: There are no issues requiring board attention at this time ## Activity: There was concerted effort in creating the 0.7.0 release during this period. This release contained substantially maturity of the UI components as well as efforts around decoupling some of our infrastructural components from the underlying distributed stream processing system (e.g. Storm). Additionally, we have migrated to a more stable and future-proof API from Elasticsearch. ## Health report: We continued the good habits mentioned in the previous board report around discussion of features. I have not seen evidence justifying concerns around Slack bleeding traffic from the mailing list. Also, we continue to get interesting and helpful user@ traffic showing real usage. ## PMC changes: - Currently 27 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Justin Leet on Sun Dec 03 2017 ## Committer base changes: - Currently 39 committers. - Shane Ardell was added as a committer on Fri Nov 16 2018 ## Releases: - 0.7.0 was released on Sun Dec 16 2018 ## JIRA activity: - 149 JIRA tickets created in the last 3 months - 117 JIRA tickets closed/resolved in the last 3 months
## Description:
Metron integrates a variety of open source big data technologies in order
to offer a centralized tool for security monitoring and analysis. Metron
provides capabilities for log aggregation, full packet capture indexing,
storage, advanced behavioral analytics and data enrichment, while applying
the most current threat-intelligence information to security telemetry
within a single platform.
## Issues:
There are no issues requiring board attention at this time
## Activity:
The community actively worked to get the 0.6.0 release, which included a
new UI around packet capture analysis. This expands our capability greatly.
We also are more active in our use of the ASF Slack and it's been a useful
driver to mailing list discussions. In particular, I'm very gratified to
see some procedural discussions involving how to get larger features into
the product via feature branches. We have enough experience and at a wide
enough range of good and bad experiences to start to encode good practices
in the bylaws. Ultimately, I am happy at how the community has reacted to
pain by discussing openly.
## Health report:
Mailing list activity is steady and, as I said earlier, we are using Slack
more. We are vigilant to push discussions to the mailing list when they
become more involved, so I think it's not affected mailing list engagement
as I had earlier feared.
Given the sustained growth in the last 2 quarters of the UI components, I'd
say that we should look to adding committers in that area.
## PMC changes:
- Currently 27 PMC members.
- No new PMC members added in the last 3 months
- Last PMC addition was Justin Leet on Sun Dec 03 2017
## Committer base changes:
- Currently 38 committers.
- Mohan Venkateshaiah was added as a committer on Thu Sep 13 2018
## Releases:
- 0.6.0 was released on Wed Sep 12 2018
## Mailing list activity:
As you can see from the statistics below, we're seeing
dev list usage largely flat, but significant growth
in the user related list usage (106% growth for user@)
with near flat subscriptions. I interpret that to mean
the last two releases have resulted in users who were
watching Metron to transition into users of the project.
Now, as you can see, the absolute numbers of emails is small,
so I will monitor this metric in the next quarter and see if
the growth is sustained.
- dev@metron.apache.org:
- 207 subscribers (up 4 in the last 3 months):
- 284 emails sent to list (284 in previous quarter)
- issues@metron.apache.org:
- 40 subscribers (up 4 in the last 3 months):
- 3221 emails sent to list (2632 in previous quarter)
- user@metron.apache.org:
- 275 subscribers (up 3 in the last 3 months):
- 93 emails sent to list (45 in previous quarter)
## JIRA activity:
- 152 JIRA tickets created in the last 3 months
- 157 JIRA tickets closed/resolved in the last 3 months
I'm concerned that the JIRAs created and closed are so closely
aligned. I would have hoped to see more created vs closed as
an indication of usage yielding feature/bug-fix requests. I
will also monitor this metric in the next quarter.
## Description Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. ## Issues: There are no issues requiring board attention at this time ## Activity: Dataworks Summit in San Jose was held in June and there were two Metron technical talks as well as a cybersecurity meetup held prior to the conference. One of the talks at the meetup involved a system integrator building utilities atop Metron, which was very interesting to see. There was much interest in the release done directly prior to the conference as well. ## Health report: Mailing list activity, conference submissions and ticket participation indicates that we're continuing to grow and attract real users. The investment in modernizing some of the infrastructure dependencies has met with renewed interest in users. Also, we have made some strides in UI development recently with more contributions. This will aid in user growth as Metron can be complex at times. ## PMC changes: - Currently 27 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Justin Leet on Sun Dec 03 2017 ## Committer base changes: - Currently 37 committers. - No new committers added in the last 3 months - Last committer addition was Anand Subramanian at Mon Dec 25 2017 ## Releases: - 0.5.0 was released on Thu Jun 07 2018 ## JIRA activity: - 142 JIRA tickets created in the last 3 months - 101 JIRA tickets closed/resolved in the last 3 months Note that the closed/resolved count is more than 2x the previous 3 month period. Also, the tickets created has grown (40% increase) since the last 3 month period.
## Description: Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. ## Issues: There are no issues requiring board attention at this time ## Activity: We continued with healthy activity across the mailing lists including a number of active discuss threads. There were multiple talks given about Metron in Dataworks Summit Europe in Berlin. A number of our users seem to be in Europe, so it was quite well attended. It featured introductory talks and more advanced streaming analytics features by vendors. There was also a use-case talk by a customer. Additionally, prior to the conference there was a meetup held and was very well attended. We also have multiple talks by committers scheduled at the Dataworks Summit San Jose in June. These talks will be more technical and architectural deep dives on our streaming analytics capabilities. ## Health report: Mailing list activity, conference submissions and ticket participation indicates that we're continuing to grow and attract real users. Specifically, we performed substantial performance refactoring in reaction to Metron being used in production in some larger companies. This forced us to rearchitect some components to be simpler, which is a good sign. Given this maturation and the active work to add support for new indices (i.e. Apache Solr), we are at a cusp of a next release, I feel. ## PMC changes: - Currently 27 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Justin Leet on Sun Dec 03 2017 ## Committer base changes: - Currently 37 committers. - No new committers added in the last 3 months - Last committer addition was Anand Subramanian at Mon Dec 25 2017 ## Releases: - Last release was 0.4.2 on Fri Dec 22 2017 ## JIRA activity: - 102 JIRA tickets created in the last 3 months - 46 JIRA tickets closed/resolved in the last 3 months
## Description: Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. ## Issues: There are no issues requiring board attention at this time ## Activity: - No new PMC or committers. ## Health report: Project activity is broadly the same as prior months. ## PMC changes: - Currently 27 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Justin Leet on Sun Dec 03 2017 ## Committer base changes: - Currently 37 committers. - No new committers added in the last 3 months - Last committer addition was Anand Subramanian at Mon Dec 25 2017 ## Releases: - Last release was 0.4.2 on Fri Dec 22 2017 ## JIRA activity: - 123 JIRA tickets created in the last 3 months - 71 JIRA tickets closed/resolved in the last 3 months
@Rich: follow up to get a better report for next month
## Description:
Metron integrates a variety of open source big data technologies in order to
offer a centralized tool for security monitoring and analysis. Metron
provides capabilities for log aggregation, full packet capture indexing,
storage, advanced behavioral analytics and data enrichment, while applying the
most current threat-intelligence information to security telemetry within a
single platform.
## Issues:
There are no issues requiring board attention at this time
## Activity:
- We added 3 PMC members and 2 committers
## Health report:
Project activity is broadly the same as in prior months. The new release has
been received positively.
## PMC changes:
- Currently 27 PMC members.
- New PMC members:
- Justin Leet was added to the PMC on Sun Dec 03 2017
- Michael Miklavcic was added to the PMC on Thu Nov 30 2017
- Otto Fowler was added to the PMC on Thu Nov 30 2017
## Committer base changes:
- Currently 37 committers.
- New commmitters:
- Anand Subramanian was added as a committer on Mon Dec 25 2017
- Raghu Mitra was added as a committer on Wed Oct 25 2017
## Releases:
- Last release was 0.4.1 on Thu Sep 14 2017
## JIRA activity:
- 150 JIRA tickets created in the last 3 months
- 125 JIRA tickets closed/resolved in the last 3 months
## Description: Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. ## Issues: There are no issues requiring board attention at this time ## Activity: - We released Metron 0.4.1, which is our second release since incubation. - We voted on a committer and are in the process of adding him ## Health report: Project activity is broadly the same as in prior months. The new release has been received positively and activity on the board is up. ## PMC changes: - Currently 24 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Brad Kolarov on Tue Apr 18 2017 ## Committer base changes: - Currently 35 committers. - No new committers added in the last 3 months - Last committer addition was Billie Rinaldi at Tue May 23 2017 ## Releases: - 0.4.1 was released on Thu Sep 14 2017 ## JIRA activity: - 211 JIRA tickets created in the last 3 months - 144 JIRA tickets closed/resolved in the last 3 months
## Description:
Metron integrates a variety of open source big data technologies in order
to offer a centralized tool for security monitoring and analysis. Metron
provides capabilities for log aggregation, full packet capture indexing,
storage, advanced behavioral analytics and data enrichment, while applying
the most current threat-intelligence information to security telemetry
within a single platform.
## Issues:
There are no issues requiring board attention at this time
## Activity:
- We released our first release (0.4.0) as a top level project.
## Health report:
- Project activity is broadly the same as in prior months.
## PMC changes:
- Currently 24 PMC members.
- No new PMC members added in the last 3 months
## Committer base changes:
- Currently 35 committers.
- New commmitters:
- Billie Rinaldi was added as a committer on Tue May 23 2017
- Jim Baker was added as a committer on Tue May 23 2017
- JJ Meyer was added as a committer on Tue May 23 2017
- Jon Zeolla was added as a committer on Tue May 23 2017
- Kyle Richardson was added as a committer on Tue May 23 2017
- Justin Leet was added as a committer on Tue May 23 2017
- Matthew Foley was added as a committer on Tue May 23 2017
- Chris Mattmann was added as a committer on Tue May 23 2017
- Michael Miklavcic was added as a committer on Tue May 23 2017
- Owen O'Malley was added as a committer on Tue May 23 2017
- Otto Fowler was added as a committer on Tue May 23 2017
## Releases:
- 0.4.0 was released on Wed Jul 05 2017
## Description:
Metron integrates a variety of open source big data technologies in order
to offer a centralized tool for security monitoring and analysis. Metron
provides capabilities for log aggregation, full packet capture indexing,
storage, advanced behavioral analytics and data enrichment, while applying
the most current threat-intelligence information to security telemetry
within a single platform.
## Issues:
There are no issues requiring board attention at this time
## Activity:
- We are unincubated
- We are in the middle of voting for a release, our first as an top level
- Given some performance work that happened late last month motivated
the community to hold the release for that.
## Health report:
Project activity is broadly the same as in prior months. There was
some renewed interest after graduation in user@ and it's evident that
more people are trying the product. Also, there were a number of talks
associated with Metron in Hadoop Summit San Jose this month. I think
we will see increased interest and traffic.
## PMC changes:
- Currently 24 PMC members.
- No new PMC members added in the last 3 months
- A new PMC member is being discussed presently in private@
## Committer base changes:
- Currently 35 committers.
- New commmitters:
- Billie Rinaldi was added as a committer on Tue May 23 2017
- Jim Baker was added as a committer on Tue May 23 2017
- JJ Meyer was added as a committer on Tue May 23 2017
- Jon Zeolla was added as a committer on Tue May 23 2017
- Kyle Richardson was added as a committer on Tue May 23 2017
- Justin Leet was added as a committer on Tue May 23 2017
- Matthew Foley was added as a committer on Tue May 23 2017
- Chris Mattmann was added as a committer on Tue May 23 2017
- Michael Miklavcic was added as a committer on Tue May 23 2017
- Owen O'Malley was added as a committer on Tue May 23 2017
- Otto Fowler was added as a committer on Tue May 23 2017
## Releases:
- No release data could be found [FIX!]
## Mailing list activity:
- dev@metron.apache.org:
- 181 subscribers (up 16 in the last 3 months):
- 2725 emails sent to list (2598 in previous quarter)
- issues@metron.apache.org:
- 22 subscribers (up 0 in the last 3 months):
- 2192 emails sent to list (1966 in previous quarter)
- user@metron.apache.org:
- 207 subscribers (up 20 in the last 3 months):
- 417 emails sent to list (170 in previous quarter)
## JIRA activity:
- 231 JIRA tickets created in the last 3 months
- 146 JIRA tickets closed/resolved in the last 3 months
## Description:
Metron integrates a variety of open source big data technologies in order
to offer a centralized tool for security monitoring and analysis. Metron
provides capabilities for log aggregation, full packet capture indexing,
storage, advanced behavioral analytics and data enrichment, while applying
the most current threat-intelligence information to security telemetry
within a single platform.
## Issues:
There are no issues requiring board attention at this time
## Activity:
- We graduated from the incubator at the time of last month's board
meeting
- We are moving through the unincubation checklist and have JIRAs
outstanding with INFRA to migrate some of our infrastructure over.
- We are in the middle of voting for a release, our first as an top level
project
## Health report:
Project activity is broadly the same as in prior months. There was
some renewed interest after graduation in user@ and it's evident that
more people are trying the product. I think a new release will
increase interest and traffic.
## PMC changes:
- Currently 24 PMC members.
- No new PMC members added in the last 3 months
- A new PMC member is being discussed presently in private@
## Committer base changes:
- Currently 24 committers.
- No changes (the PMC was established in the last 3 months)
## Releases:
- We are working on our first release post-graduation.
## Mailing list activity:
- dev@metron.apache.org:
- 174 subscribers (up 9 in the last 3 months):
- 3259 emails sent to list (2140 in previous quarter)
- issues@metron.apache.org:
- 22 subscribers (up 0 in the last 3 months):
- 2540 emails sent to list (1770 in previous quarter)
- user@metron.apache.org:
- 194 subscribers (up 19 in the last 3 months):
- 440 emails sent to list (34 in previous quarter)
## JIRA activity:
- 238 JIRA tickets created in the last 3 months
- 131 JIRA tickets closed/resolved in the last 3 months
WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to a security analytics platform for big data use cases. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache Metron Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache Metron Project be and hereby is responsible for the creation and maintenance of software related to: (a) A mechanism to capture, store, and normalize any type of security telemetry at extremely high rates. (b) Real time processing and application of enrichments (c) Efficient information storage (d) An interface that gives a security investigator a centralized view of data and alerts passed through the system; and be it further RESOLVED, that the office of "Vice President, Apache Metron" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache Metron Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache Metron Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache Metron Project: * Sheetal Dolas <sheetal_dolas@apache.org> * Ryan Merriman <rmerriman@apache.org> * Larry McCay <lmccay@apache.org> * P. Taylor Goetz <ptgoetz@apache.org> * Nick Allen <nickallen@apache.org> * David Lyle <lyle@apache.org> * George Vetticaden <gvetticaden@apache.org> * James Sirota <jsirota@apache.org> * Casey Stella <cestella@apache.org> * Michael Perez <mperez@apache.org> * Kiran Komaravolu <kirankom@apache.org> * Vinod Kumar Vavilapalli <vinodkv@apache.org> * Debo Dutta <ddutta@apache.org> * Discovery Gerdes <discovery@apache.org> * Oskar Zabik <smogg@apache.org> * Andrew Hartnett <dev_warlord@apache.org> * Paul Kehrer <reaperhulk@apache.org> * Sean Schulte <sirsean@apache.org> * Mark Bittmann <mbittmann@apache.org> * Dave Hirko <dbhirko@apache.org> * Brad Kolarov <bjkolly@apache.org> * Charles Porter <cporter@apache.org> * Ray Sting <rurcioli@apache.org> * Phillip Rhodes <prhodes@apache.org> NOW, THEREFORE, BE IT FURTHER RESOLVED, that Casey Stella be appointed to the office of Vice President, Apache Metron, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the initial Apache Metron PMC be and hereby is tasked with the creation of a set of bylaws intended to encourage open development and increased participation in the Apache Metron Project; and be it further RESOLVED, that the Apache Metron Project be and hereby is tasked with the migration and rationalization of the Apache Incubator Metron podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator Metron podling encumbered upon the Apache Incubator Project are hereafter discharged. Special Order 7C, Establish the Apache Metron Project, was approved by Unanimous Vote of the directors present.
Metron is a project dedicated to providing an extensible and scalable advanced
network security analytics tool. It has strong foundations in the Apache
Hadoop ecosystem.
Metron has been incubating since 2015-12-06.
Three most important issues to address in the move towards graduation:
1. All issues have been addressed.
2. Community graduation discussion and vote have been initiated and passed
3. Incubator graduation discussion and vote have been initiated and passed
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
NA
How has the community developed since the last report?
Most of the community and IPMC will transition to the Metron PMC once we
establish it. Two of our Mentors chose to stay on with the project.
How has the project developed since the last report?
We produced a 0.3.1 build
The project is in the process of graduating into a TLP
How would you assess the podling's maturity?
I think our community is very mature and we will make a great Apache TLP
project
Please feel free to add your own commentary.
[x] Initial setup
[x] Working towards first release
[x] Community building
[x] Nearing graduation
[x] Other: graduation vote passed
Date of last release:
2017-03-17
When were the last committers or PPMC members elected?
Two committers were voted in on 3/15.
Signed-off-by:
[x](metron) Billie Rinaldi
Comments:
[ ](metron) Chris Mattmann
Comments:
[ ](metron) Owen O'Malley
Comments:
[x](metron) P. Taylor Goetz
Comments:
Metron is ready to graduate and a resolution has been submitted
to the board.
[ ](metron) Vinod Kumar Vavilapalli
Comments:
Metron is a project dedicated to providing an extensible and scalable advanced
network security analytics tool. It has strong foundations in the Apache
Hadoop ecosystem.
Metron has been incubating since 2015-12-06.
Three most important issues to address in the move towards graduation:
1. Trigger a community discussion to graduate from incubation. We have
received a lot of value from the incubation process and after speaking
to our mentors and going through the Apache Project Maturity Model we
believe that we will soon be ready to graduate.
2. Vote to ratify our Development Guidelines and Process for Reporting
Issues
3. Vote to ratify our Release Process
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
We refreshed our website to be more compliant with Apache policies
How has the community developed since the last report?
- We added 2 committers
- We had a clean Apache build
How has the project developed since the last report?
- We closed 63 PRs as of our last build
- We integrated with Apache Ambari to make the project easier to deploy
- We modified and re-voted on our Bylaws
- We successfully filed our Name Search Jira.
Date of last release:
2016-11-14
When were the last committers or PPMC members elected?
2016-9-1
Signed-off-by:
[x](metron) Billie Rinaldi
[ ](metron) Chris Mattmann
[ ](metron) Owen O'Malley
[x](metron) P. Taylor Goetz
[ ](metron) Vinod Kumar Vavilapalli
Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. Metron has been incubating since 12-08-2015 Three most important issues to address in the move towards Graduation. - Building a diverse community of developers for Metron - Getting security practitioners to provide feedback on requirements - Make an Apache release Any issues that the Incubator PMC or ASF Board might wish/need to be aware of - We are currently in the process of producing our third Apache release * How has the community developed since the last report - We received strong community contributions in both code, documentation, and testing from two additional community members and are hoping to make them committers shortly - David Lyle and Nick Allen were promoted to PPMC - Tweaked and re-voted on the community bylaws - Introduced a by-weekly community demo and meeting * How has the project developed since the last report - We closed on 41 more Jiras and made our code base more compliant and introduced several important features. We also had lively discussion on the dev boards about how these features should be implemented. Signed-off-by: [x](metron) Billie Rinaldi [ ](metron) Chris Mattmann [ ](metron) Owen O'Malley [x](metron) P. Taylor Goetz [ ](metron) Vinod Kumar Vavilapalli
Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. Metron has been incubating since 2015-12-06. Three most important issues to address in the move towards Graduation. - Building a diverse community of developers for Metron - Getting security practitioners to provide feedback on requirements - Make an Apache release Any issues that the Incubator PMC or ASF Board might wish/need to be aware of - We are currently trying to produce our second Apache release of Metron How has the community developed since the last report - In the process of adding one additional committer, Michael Miklavcic - We accepted numerous contributions from non-committers interested in Metron, including additional parsers and sample telemetries - We host a weekly UI working session and were able to source requirements for a new UI prototype - We hosted a Metron meetup, which received a lot of interest from the community - We saw an uptick in interest from the community on the dev boards which corresponds to people trying the product prior to an official release, which is a good sign. - We are receiving community JIRAs for bug reports and security issues How has the project developed since the last report - We closed over 100 Jiras and are in the latest stages of releasing our second Apache release. - We added additional installation automation and documentation - We added additional features around parsing and a rules engine through a DSL called Stellar - We are adding infrastructure called "Model as a Service" to uptake ML models Date of last release: April 2016 When were the last committers or PMC members elected? David Lyle on 22 March 2016 Signed-off-by: [x](metron) Billie Rinaldi [x](metron) Chris Mattmann [ ](metron) Owen O'Malley [x](metron) P. Taylor Goetz [ ](metron) Vinod Kumar Vavilapalli
Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. Metron has been incubating since 2015-12-06. Three most important issues to address in the move towards Graduation. - Building a diverse community of developers for Metron - Getting security practitioners to provide feedback on requirements - Make an Apache release Any issues that the Incubator PMC or ASF Board might wish/need to be aware of - We are currently trying to produce the first Apache release of Metron * How has the community developed since the last report - We added one additional committer, David Lyle - We accepted 2 separate contributions from non-committers interested in Metron - We saw an uptick in interest from the community on the dev boards which corresponds to people trying the product prior to an official release, which is a good sign. * How has the project developed since the last report - We closed 20 more Jiras and are in the latest stages of releasing an Apache release. - We added deployment automation for EC2 so trying out Metron in a multi-node environment is even easier - We integrated the CI environment that infra set up for us at our request so that unit tests and apache rat license checks are run on every pull request submitted - We added support for indexing enriched sensor capture data into Apache Solr indexing as well as Elasticsearch Date of last release: -- When were the last committers or PMC members elected? David Lyle on 22 March 2016 Signed-off-by: [X](metron) Billie Rinaldi [ ](metron) Chris Mattmann [X](metron) Owen O'Malley [ ](metron) P. Taylor Goetz [ ](metron) Vinod Kumar Vavilapalli
Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. Metron has been incubating since 12-08-2015 Three most important issues to address in the move towards Graduation: - Building a diverse community of developers for Metron - Getting security practitioners to provide feedback on requirements - Make an Apache release Any issues that the Incubator PMC or ASF Board might wish/need to be aware of? - We are currently trying to produce the first Apache release of Metron - We would like to request Apache infrastructure (a Jenkins server) for CI How has the community developed since the last report? - We voted to add one additional committer, Nick Allen How has the project developed since the last report? - We closed on 15 more Jiras and made our code base more compliant with Apache Licenses. We are at the latest stages of cleaning up the code base to come up with the Apache build. Signed-off-by: [X](metron) Billie Rinaldi [ ](metron) Chris Mattmann [ ](metron) Owen O'Malley [X](metron) P. Taylor Goetz [ ](metron) Vinod Kumar Vavilapalli
Metron integrates a variety of open source big data technologies in order to offer a centralized tool for security monitoring and analysis. Metron provides capabilities for log aggregation, full packet capture indexing, storage, advanced behavioral analytics and data enrichment, while applying the most current threat-intelligence information to security telemetry within a single platform. Metron has been incubating since 12-08-2015 Three most important issues to address in the move towards Graduation. - Building a diverse community of developers for Metron - Getting security practitioners to provide feedback on requirements - Make an Apache release Any issues that the Incubator PMC or ASF Board might wish/need to be aware of? - We are currently trying to produce the first Apache release of Metron - We would like to request Apache infrastructure (a Jenkins server) for CI How has the community developed since the last report - We started working on implementing a variety of new features on Metron - We did a Meetup in the DC area jointly with Capital One. We had over 75 people in attendance with many expressing interest in joining the Metron project How has the project developed since the last report - This month we have closed 7 key Jiras and built up scripts for standing up an integration and test environment for Metron that anyone in the community can take advantage of Signed-off-by: [x](metron) Billie Rinaldi [ ](metron) Chris Mattmann [ ](metron) Owen O'Malley [X](metron) P. Taylor Goetz [ ](metron) Vinod K Shepherd/Mentor notes:
Metron is a project dedicated to providing an extensible and scalable advanced network security analytics tool. It has strong foundations in the Apache Hadoop ecosystem. Metron has been incubating since 2015-12-06. Three most important issues to address in the move towards graduation: 1. Building a diverse community of developers for Metron 2. Getting security practitioners to provide feedback on requirements 3. Make an Apache release Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? - We added Debo Dutta as a committer How has the project developed since the last report? - We received a signed SGA from Cisco - We picked our new logo - We setup our new website - We closed our first few Jiras Date of last release: No release yet. When were the last committers or PMC members elected? 2016-01-08 Signed-off-by: [X](metron) Billie Rinaldi [X](metron) Chris Mattmann [X](metron) Owen O'Malley [X](metron) P. Taylor Goetz [ ](metron) Vinod Kumar Vavilapalli Shepherd/Mentor notes: