Apache Logo
The Apache Way Contribute ASF Sponsors

This was extracted (@ 2017-06-08 23:10) from a list of minutes which have been approved by the Board.
Please Note The Board typically approves the minutes of the previous meeting at the beginning of every Board meeting; therefore, the list below does not normally contain details from the minutes of the most recent Board meeting.

2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2001 | 2000 | 1999 | Pre-organization meetings

Spot

15 Mar 2017

Apache Spot is a solution stack that provides the capability to ingest IT
related telemetry (network flows, domain name service information and proxy
server logs) and provide unsupervised machine learning capabilities to
identify suspicious activity.  The information is organized and presented
using operational analytics so that a security analyst can investigate the
most suspicious connections. Apache Spot is built on an open data model using
Apache Spark and Apache Hadoop.

Spot has been incubating since 2016-09-23.

Three most important issues to address in the move towards graduation:

 1. Move infrastructure and development to ASF (code, issues, mailing
    list, ...)
 2. Build diverse community
 3. Demonstrate ability to create releases

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of?

 None

How has the community developed since the last report?

 Based on initial feedback, process for issues was updated on the project
 website, with primary objective to facilitate the workflow and interaction
 with Community, and having diverse ownership of them until resolution.

 Slack channel has become very popular, however in order to adhere to ASF
 official communications channels, those conversations that involve quick
 question will be kept there, any extended discussion on code, pipeline, and
 architecture, are being ported to Dev mail list.

 There has been a concern to get continuous improvement of the UI on Apache
 Spot, committers have been working on process to get UX interviews that
 help to understand and address community and compliance needs.

How has the project developed since the last report?

 The project got a major architecture change in order to remove CSV’s,
 offload storage from the OS file system and instead leverage HDFS (for
 distributed architecture).

 Per community request through JIRA issue, and in order to facilitate the
 installation/adoption of the project for scale deployments, an installation
 script consolidating the ones that were built per pipeline component has
 been pulled to repository, it will reduce the complexity of porting files
 and configuration variables, by having a central point of deployment.

 Open Data Models, which serves as a framework for data sources
 normalization, initially for ingestion, was ported through its
 Specification to the project repository, this will bring more contributions
 to facilitate the design of the NoSQL table, and then determine technology
 selection through discussion and voting through mailing list.

February Metrics:

   +---------------------------------------------+
   |   Metric                          | counts  |
   +---------------------------------------------+
   | Active Contributors (incl mentors)|    14   |
   | Jira New Issues                   |    6    |
   | Resolved Issues                   |    1    |
   | Pull Requests merged              |    3    |
   | Pull Requests proposed            |    3    |
   +---------------------------------------------+

Date of last release:

 N/A

When were the last committers or PMC members elected?

 Last committer was elected on 2/24

How does the podling rate their own maturity?

 There was a strong focus on code delivery over the last quarter, towards
 Apache release, community adoption keeps growing, now by adding a layer of
 process for opening issues and commits, plus interaction over channels
 we're bringing contributions from others, towards Apache release.

Signed-off-by:

 [x](spot) Jarek Jarcec Cecho
    Comments:
 [ ](spot) Brock Noland
    Comments:
 [ ](spot) Andrei Savu
    Comments:
 [x](spot) Uma Maheswara Rao G
    Comments:

27 Feb 2017

Apache Spot is a solution stack that provides the capability to ingest IT
related telemetry (network flows, domain name service information and proxy
server logs) and provide unsupervised machine learning capabilities to
identify suspicious activity.  The information is organized and presented
using operational analytics so that a security analyst can investigate the
most suspicious connections. Apache Spot is built on an open data model
using Apache Spark and Apache Hadoop.

Spot has been incubating since 2016-09-23.

Three most important issues to address in the move towards graduation:

 1.  Move infrastructure and development to ASF (code, issues, mailing
     list, ...)
 2.  Build diverse community
 3.  Demonstrate ability to create releases

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

 IPMC this point has been posted on the last two report, we have not
 received any feedback in terms of how it goes, please comment.

 Please elaborate on the process for code scanning and IP reviews. On the
 last report this was brought to attention but no communication was
 received.

How has the community developed since the last report?

 Community is pushing more aggressively on project interaction which is
 good, by opening issues on ASF JIRA, some of them have been closed with
 their respective PR for bug fixing. Also developers in Brazil are
 proposing a new UI schema by their own, which once is voted will
 incorporate as contribution/new functionality towards our first Apache
 release.

 Adoption rate and popularity of the project has been recognized by
 Industry receiving an award from Infoworld as Technology of the year and
 also finalist on Edison Awards.

How has the project developed since the last report?

 The Spot team  launched a new project webpage version which incorporate
 the long term vision and objectives of Apache Spot, and also includes a
 new documentation package which is similar in structure to other ASF
 projects.

 Two new processes were published to explain on commits and how to open
 issues, providing a structured frame that Community in general can follow
 up in order to facilitate follow-up in combination of technology tools,
 that can facilitate the life cycle continuity.

 During this period 14 pull request were merged over different pipeline
 components , as committers work also on the new design for data storage
 through non-relational database technologies.

 Also facilitating a quick demo of the project, we have updated our
 container demo, and added automation in order to reflect those changes as
 commits to UI are pulled to ASF Git repository.

Date of last release:

 N/A

When were the last committers or PMC members elected?

 Last committer was elected on 1/24

Signed-off-by:

 [ ](spot) Jarek Jarcec Cecho
 [ ](spot) Brock Noland
 [ ](spot) Andrei Savu
 [X](spot) Uma Maheswara Rao G

21 Dec 2016

Apache Spot is a solution stack that provides the capability to ingest
network related telemetry (network flows, domain name service
information and proxy server logs) and provide unsupervised machine
learning capabilities to identify suspicious activity.  The information
is organized and presented using operational analytics so that a
security analyst can investigate the most suspicious connections. Apache
Spot is built on an open data model using Apache Spark and Apache
Hadoop.

Spot has been incubating since 2016-09-23.

Three most important issues to address in the move towards graduation:

  1.  Move infrastructure and development to ASF (code, issues, mailing list, ...)
  2.  Build diverse community
  3.  Demonstrate ability to create releases

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  Please elaborate on the process for code scanning and IP reviews.

How has the community developed since the last report?

  Community interaction has ramped velocity, as new adopters of the project
  have been posting questions through Twitter and Slack. We have added
  approximately 20% to our Slack channel and added several contributors
  through the ICLA.

How has the project developed since the last report?

  We have moved our repo to ASF as of December 8, 2016.

  We have removed our LDA-C dependencies by switching to Spark LDA,
  eliminating licensing issues on this particular branch.

Date of last release:

  N/A

When were the last committers or PMC members elected?

  N/A

Signed-off-by:

 [ ](spot) Jarek Jarcec Cecho
 [ ](spot) Brock Noland
 [X](spot) Andrei Savu
 [X](spot) Uma Maheswara Rao G

16 Nov 2016

Apache Spot is a solution stack that provides the capability to ingest
network related telemetry (network flows, domain name service information and
proxy server logs) and provide unsupervised machine learning capabilities to
identify suspicious activity.  The information is organized and presented
using operational analytics so that a security analyst can investigate the
most suspicious connections. Apache Spot is built on an open data model using
Apache Spark and Apache Hadoop.

Spot has been incubating since 2016-09-23.

Three most important issues to address in the move towards graduation:

 - Move infrastructure and development to ASF (code, issues, mailing list, …)
 - Build diverse community
 - Demonstrate ability to create releases

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of?

 We currently have a hard dependency via our LDA implementation that
 requires a GPL license.  A rewrite is in progress to move the code from
 LDA-C to Spark LDA.

How has the community developed since the last report?

 This is first report after accepting Apache Spot to incubator and we still
 have not transitioned everything to ASF. We do however see increased
 interest in the project, primarily on our Slack channel.

How has the project developed since the last report?

 This is first report.

Date of last release:

 N/A

When were the last committers or PMC members elected?

 N/A

Signed-off-by:

 [x](spot) Jarek Jarcec Cecho
 [ ](spot) Brock Noland
 [ ](spot) Andrei Savu
 [X](spot) Uma Maheswara Rao G