This was extracted (@ 2023-02-28 12:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Report was filed, but display is awaiting the approval of the Board minutes.
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Nominate RM (release manager) and collect source into tarball
2. Create release notes, instructions for building SDAP from above
source, confirm appropriate headers and licenses are in place.
3. Make official SDAP (Incubating) Release
Our target is to graduate by **early December, 2022**.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Discussion and development is active.
An Apache SDAP talk was given at ApacheCon in October 2022.
SDAP has gained a new mentor, Julian Hyde.
### How has the project developed since the last report?
Completed issues:
- SDAP-398: CDMS API Tests
- SDAP-407: Return depth in CSV and NetCDF outputs
- SDAP-406: Time series comparison stats issues
- SDAP-405: Update matchup endpoint to use SPURS API in AWS
- SDAP-403: Catch ReadTimeout exception when adding remote collections
- SDAP-402: Update match-up algorithm to return all variables at the same
lat,lon,time for matchOnce=true
- SDAP-399: Update SDAP quickstart guide to include instructions for both
docker and k8s installation
New/Updated Issues:
- SDAP-401: Add support for additional JSON outputs for ease of
generating plots
- SDAP-392: Have a distributed configuration for a federation of SDAPs
- SDAP-391: For proxied collections, improve level of metadata in the
/list end-point
- SDAP-389: publish SDAP helm chart in an helm repo
### How would you assess the podling's maturity?
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
No official releases of Apache SDAP have been made.
### When were the last committers or PPMC members elected?
One new member was invited to join in October 2022.
### Have your mentors been helpful and responsive?
Mentors have been helpful and responsive. Our new mentor, Julian Hyde,
has been very helpful in providing guidance regarding graduation.
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not aware of any issues.
### Signed-off-by:
- [X] (sdap) Julian Hyde
Comments:
* The initial draft of the report said that there has been a
release, which highlights a mismatch between SDAP's and ASF's
idea of a release; education is needed.
* SDAP's number 1 problem is their use of dev@. There is activity
in the project (including commit messages going to dev@) but questions
asked on dev@ go unanswered, and therefore conversations don't
happen. Even the report is drafted on private@ rather than dev@.
I think I can work with SDAP and get them to graduate but only if
they engage on dev@.
* I have given notice that I will resign as a mentor by Dec 31st
if I don't see activity, namely a plan to graduate, and activity
to carry out that plan.
- [ ] (sdap) Jörn Rottmann
Comments:
- [ ] (sdap) Trevor Grant
Comments:
### IPMC/Shepherd notes:
SDAP (Science Data Analytics Platform) provides earth observation data
access and computing as scalable services.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2. Continuous Integration / Continuous Deployment
3. Automated testing
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Discussion and development is active.
The following presentations from projects leveraging Apache SDAP were
given at the July 2022 Summer ESIP meeting in Pittsburgh.
- An Earth System Digital Twin for Flood Prediction and Analysis
- Air Quality Collaborative Framework (AQ ACF)
- Cloud-based Data Match-Up Service and AI
### How has the project developed since the last report?
Completed Issues:
- SDAP-396 Update matchup endpoint to use Saildrone API
- SDAP-397 Update matchup outputs per team findings
- SDAP-395 Add in situ JSON schema endpoint to in situ data services
- SDAP-387 Update NetCDF matchup output format
- SDAP-400 Update matchup endpoint to use NCAR API
- SDAP-394 In situ subset API needs to return meta column as one of the
default columns
- SDAP-393 Add optional insitu API endpoint to SDAP ingress
- SDAP-371 Fix domssubset API
- SDAP-390 Update NetCDF reader tool for data match-up
New/Updated Issues:
- SDAP-399 Update SDAP quickstart guide to include instructions for both
docker and k8s installation
- SDAP-403 Catch ReadTimeout exception when adding remote collections
- SDAP-398 Create CDMS API tests
- SDAP-401 Add support for additional JSON outputs for ease of generating
plots
- SDAP-402 Update match-up algorithm to return all variables at the same
lat,lon,time for matchOnce=true
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2022-08-04 (webapp component version 0.4.5a52)
### When were the last committers or PPMC members elected?
Two new members were invited to PPMC and committer in August 2022.
### Have your mentors been helpful and responsive?
Mentors are very helpful and responsive in our developers community.
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not aware of any issues.
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [X] (sdap) Trevor Grant
Comments:
### IPMC/Shepherd notes:
JM: Please consider graduating.
SDAP (Science Data Analytic Platform) provides earth observation data
access and computing as scalable services.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2. Continuous Integration / Continuous Deployment
3. Automated testing
### Are there any issues that the IPMC or ASF Board need to be aware of?
NONE
### How has the community developed since the last report?
7 active developers have committed on the project during the reporting
period (since November 2021).
### How has the project developed since the last report?
The closed ticket during the reporting period are:
| Issue Type | Issue key | Summary
| Updated |
| ----------- | --------- |
----------------------------------------------------------------------------
---------------------------------------------- | -------------- |
| Improvement | SDAP-388 | Enable SDAP to proxy/redirect to alternate
SDAP.
| 6/21/22 9:58 |
| New Feature | SDAP-192 | Create DOMS netCDF reader tool
| 5/31/22 16:15 |
| Task | SDAP-305 | Get current match up working with AVHRR OI data
that is currently ingested in the bigdata cluster
| 11/10/21 22:22 |
| Task | SDAP-311 | Collect performance metrics in current match-up
algorithm
| 11/10/21 22:22 |
| Task | SDAP-312 | Optimize reprojection to UTM in matchup
algorithm
| 11/10/21 22:21 |
| Task | SDAP-315 | Update match up algorithm for satellite to
satellite
| 11/10/21 22:21 |
| Improvement | SDAP-338 | Update match up implementation to support
multi-variable tiles
| 11/10/21 22:20 |
| Improvement | SDAP-353 | Update match-up output to only return variables
that are provided by the source e.g. for ASCAT only return winds variables
| 11/10/21 22:16 |
| Improvement | SDAP-355 | Update matchup parameter and output to use
primary and secondary
| 11/10/21 22:15 |
| Bug | SDAP-351 | Fix reading of data with
cftime.datetime.Gregorian type
| 11/10/21 21:57 |
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [X] Nearing graduation
- [ ] Other:
### Date of last release:
2022-06-22 (webapp component version 0.4.5a46)
### When were the last committers or PPMC members elected?
2022-05-06
### Have your mentors been helpful and responsive?
The application development has been responsive. The mentors are helpful
and responsive in our developers community.
We now also have monthly meetings to coordinate and inform on the
stakeholders using SDAP for multiple projects.
We had difficulties to report regularly on our activity but we set an
organization so that it is now a rolling responsibility shared in the team.
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not aware of any issues ### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [X] (sdap) Trevor Grant
Comments: Congrats on first component release!
### IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Discussion and development continue.
### How has the project developed since the last report?
#### Completed Issues:
- SDAP-217 Add ingest processor to flip tiles vertically
- SDAP-343 Fix reading of time stamp in GPM data
- SDAP-351 Fix reading of data with cftime.datetime.Gregorian type
- SDAP-354 Add initial version of in situ data services to Apache
GitHub
- SDAP-327 New multivariable reading processors missing from granule
ingester module
- SDAP-355 Update matchup parameter and output to use primary and
secondary
- SDAP-353 Update match-up output to only return variables that are
provided by the source e.g. for ASCAT only return winds variables
- SDAP-338 Update match up implementation to support multi-variable
tiles
- SDAP-315 Update match up algorithm for satellite to satellite
- SDAP-311 Collect performance metrics in current match-up algorithm
- SDAP-312 Optimize reprojection to UTM in matchup algorithm
- SDAP-305 Get current match up working with AVHRR OI data that is
currently ingested in the bigdata cluster
#### New/Updated Issues:
- SDAP-303 Add Elasticsearch support for metadata store in Nexus
webapp & ningester
- SDAP-347 Add day_of_year_i field in Tile class
- SDAP-162 Create build for nexus-webapp
- SDAP-352 Fix tile artifact in GPM time averaged map
- SDAP-326 Make ingest processors optional in incubator-sdap-ingestor
- SDAP-319 Fix misleading comment in helm/values.yaml
- SDAP-318 TimeSeriesSpark returns empty list for bounding box larger
than a hemisphere.
- SDAP-316 Update webapp to python version 3 in helm chart.
- SDAP-346 PySpark environment variables incorrectly set
- SDAP-345 Add ability to read time stamp from the filename
- SDAP-344 Add ability to read time stamp from global attributes
- SDAP-342 Update webapp to use spark 3.1.1
- SDAP-321 Allow wildcards in S3 paths for collections
- SDAP-350 Question about described bug in aiomultiprocess
- SDAP-324 Kelvin to Celsius processor not working during ingest after
adding support for multiple variables
- SDAP-323 Update summarizing processor and Solr schema to support
multiple variables
- SDAP-322 Add support for ingestion of data with multiple variables
- SDAP-332 Add OpenAPI specification for data matchup related endpoints
- SDAP-339 Granule ingestion pod needs a way to fetch new AWS access
key for reading data from Earthdata Cloud archive
- SDAP-349 Inefficient swath tile causes memory issues
- SDAP-341 Terraform deployment of Kubernetes and Spark cluster
- SDAP-320 Integrate 1.1.0-SNAPSHOT work into SDAP
- SDAP-357 As an administrator, I would like SDAP to support multiple
s3 buckets, with different credential for each
- SDAP-356 ingress does not find loadbalancer on AWS, 404 error
- SDAP-340 allow null when standard_name is missing
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
One new member was invited to the PPMC in August 2021.
### Have your mentors been helpful and responsive?
Trevor has been a very helpful mentor
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not aware of any issues
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [X] (sdap) Trevor Grant
Comments: Looking good- this note is to the board are there any other
Python first projects we can look to for guidance on Python releases. IF
this project had versions, it would be v1+ as it is in prod at various US
Government agencies.
### IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2.
3.
### Are there any issues that the IPMC or ASF Board need to be aware of?
None
### How has the community developed since the last report?
Discussions in ASF slack channel:
https://the-asf.slack.com/archives/CN8UJ3D0V
### How has the project developed since the last report?
Completed issues:
SDAP-308 deletebyquery.py not working after Nexus Python3 upgrade
SDAP-213 Update dependencies in EDGE requirements.txt
SDAP-310 Update match up output to use CF standard name for
satellite variable
SDAP-154 Python 3
New/Updated issues:
SDAP-316 Update webapp to python version 3 in helm chart.
SDAP-318 TimeSeriesSpark returns empty list for bounding box larger
than a hemisphere.
SDAP-320 Integrate 1.1.0-SNAPSHOT work into SDAP
SDAP-317 Open multiple netcdf files in order to generate granules
with multiple time steps
SDAP-314 Add Elasticsearch support
SDAP-312 Optimize reprojection to UTM in matchup algorithm
SDAP-309 Watch collections iwhich path is a regex
SDAP-307 nexustiles get_tiles_by_polygon() &
get_tiles_by_polygon_sorttimeasc() gets data out of the
requested polygon from Solr
SDAP-319 Fix misleading comment in helm/values.yaml
SDAP-321 Allow wildcards in S3 paths for collections
SDAP-315 Update match up algorithm for satellite to satellite
SDAP-311 Collect performance metrics in current match-up algorithm
SDAP-304 Making Cassandra keyspace creation optional
SDAP-313 Make Cassandra keyspace variable for granule_ingester
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
N/A
### When were the last committers or PPMC members elected?
Two new committers were elected in March 2021.
### Have your mentors been helpful and responsive?
No answer.
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not aware of any issues
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [ ] (sdap) Trevor Grant
Comments:
### IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems. SDAP has been incubating since 2017-10-22. ### Three most important unfinished issues to address before graduating: 1. Make official SDAP (Incubating) Release 2. Improve committer participation 3. Improve/create user guide documentation ### Are there any issues that the IPMC or ASF Board need to be aware of? None ### How has the community developed since the last report? New Committers and PPMC members elected ### How has the project developed since the last report? Completed: - Migrated SDAP to Python 3. New efforts and features: - Working on Elasticsearch integration. - Adding Apache Parquet support for in situ data - Integration with AWS Athena - Enhancements to support multispectral data ### How would you assess the podling's maturity? Please feel free to add your own commentary. - [ ] Initial setup - [X] Working towards first release - [X] Community building - [ ] Nearing graduation - [ ] Other: ### Date of last release: XXXX-XX-XX ### When were the last committers or PPMC members elected? Two new committers were elected in March 2021. ### Have your mentors been helpful and responsive? Are things falling through the cracks? If so, please list any open issues that need to be addressed. Have not heard from Jörn in a while. ### Is the PPMC managing the podling's brand / trademarks? Are 3rd parties respecting and correctly using the podlings name and brand? If not what actions has the PPMC taken to correct this? Has the VP, Brand approved the project name? Not aware of any issues ### Signed-off-by: - [ ] (sdap) Jörn Rottmann Comments: - [X] (sdap) Trevor Grant Comments: ### IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2. Improve committer participation
3. Improve/create user guide documentation
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
No community events to report; development has continued.
### How has the project developed since the last report?
Bug Fixes
- SDAP-302 Collection Manager crashes when Collections Config is updated
while actively scanning S3 dirs
- SDAP-290 Collection manager crashes when granule directory has wildcard
- SDAP-301 Granule Ingester cannot process granules with missing 'units'
attribute
- SDAP-300 Collection Manager won't scan directories on local filesystem
- SDAP-299 Update Helm dependency repo urls
- SDAP-295 Hash dataset name in tile ID
- SDAP-293 New ingestion system should convert Kelvin to Celsius
- SDAP-288 support S3 new ingestion system
- SDAP-286 ingestion should handle 0-360 longitudes
New Features
- SDAP-292 Add Cassandra authentication support to delete_by_query.py
script
- SDAP-298 Helm Chart 1.0.0
Improvements
- SDAP-294 Support date normalization on analysis side
- SDAP-297 Update Collection Manager documentation
- SDAP-296 Make deletebyquery script work out-of-the-box in docker image
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
None yet.
### When were the last committers or PPMC members elected?
Two new committers were elected in April 2020.
### Have your mentors been helpful and responsive?
Have not heard from Jörn in a while.
### Is the PPMC managing the podling's brand / trademarks?
No, PPMC is not managing the podling's brand.
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [X] (sdap) Trevor Grant
Comments:
### IPMC/Shepherd notes:
Justin Mclean: The PPMC does need to manage the brand, please don't
leave this until it's too late and causes issues.
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2. Improve committer participation
3. Improve/create user guide documentation
### Are there any issues that the IPMC or ASF Board need to be aware of?
None.
### How has the community developed since the last report?
Thomas Huang delivered a (virtual) keynote address at the 2020 ApacheCon
@Home on 9/29 and discussed our creation of the Apache Science Data
Analytics Platform (SDAP) as a professional open source Analytics Center
Framework (ACF) and its growing list of NASA and international
applications.
The COVERAGE (CEOS Ocean Variables Enabling Research and Applications for
GEO, https://coverage.ceos.org/technology/#software) development team at
JPL completed an initial deployment of SDAP on European cloud platform,
WEkEO (https://wekeo.eu/). Paired with a previously deployed SDAP on
Amazon Web Services (AWS), an objective of COVERAGE is to enable joint
analytics leveraging geographically distributed SDAP installations that
host distinct yet compatible American and European satellite-based and in
situ ocean-related datasets.
Additional deployments of SDAP that are currently being maintained:
- NASA Estimating the Circulation and Climate of the Ocean (ECCO) (
https://ecco-group.org)
- NASA Gravity Recovery & Climate Experiment (GRACE) Follow-On (
https://grace.jpl.nasa.gov)
- NASA Sea Level Change Portal (https://sealevel.nasa.gov)
### How has the project developed since the last report?
Three new features:
- SDAP-292 Add Cassandra authentication support to delete_by_query.py
script
- SDAP-278 Cassandra authentication for webapp
- SDAP-258 Update Deseason Algorithm to Use Precomputed Climatologies
Two improvements:
- SDAP-284 Collection Manager to support recursive directory structures
- SDAP-285 Solr not indexing lat/lon
Eight bug fixes:
- SDAP-282 Support configuring dimension names and projection during
ingestion
- SDAP-291 netcdf parsing error with GMPE dataset in Granule Ingester
- SDAP-280 Collection Manager should not block when checking ingestion
history
- SDAP-279 Collection Manager does not pick up fs events with NAS mount
- SDAP-267 config operator, manage git url or branch update in the helm
chart
- SDAP-261 bug fixes for new ingestion system (granule ingestion &
collection manager)
- SDAP-277 Better error handling in Granule Ingester
- SDAP-281 bigdata ingestion feedback (reading time)
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
Two new committers were elected in April 2020.
### Have your mentors been helpful and responsive?
No issues, mentors are responsive.
### Is the PPMC managing the podling's brand / trademarks?
The PPMC is not managing the podling's brand / trademarks
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [X] (sdap) Trevor Grant
Comments:
### IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2. Improve committer participation
3. Improve/create user guide documentation
### Are there any issues that the IPMC or ASF Board need to be aware of?
Subscription of PPMC members to the @private mailing list should be
resolved. All PPMC members should now be subscribed to @private. If this
is not accurate, please advise.
### How has the community developed since the last report?
New committers have been added.
### How has the project developed since the last report?
1. Integrated SDAP analytics with Esri ArcGIS front end.
2. Added new temporal variance (2D map) analytic algorithm.
3. Further improvements in Kubernetes-based deployment procedures.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [ ] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
Two new committers were elected in April 2020.
### Have your mentors been helpful and responsive?
Mentors have been helpful.
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not managing the podling's brand / trademarks.
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [x] (sdap) Trevor Grant
Comments:
### IPMC/Shepherd notes:
Justin Mclean: Can I ask why the PPMC is not managing the podlings
brand and trademarks? Also there still 1/3 of of your PPMC members
not signed up to your private list. Also please include a date of
your last release in your next report.
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2. Improve committer participation
3. Improve/create user guide documentation
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
We are continuing to attract new committers.
A NASA-sponsored project to build a cloud workflow for sea ice and ocean
circulation data, in development at JPL, is adapting SDAP for its analytics
platform. Reference: T. Huang, M. DeBellis, I. Fenty, P. Heimbach, J. C.
Jacob, O. Wang, E. Yam, "Analytics Center Framework for Estimating the
Circulation and Climate of the Ocean," 39th IEEE Geoscience and Remote
Sensing Symposium, Jul-Aug 2019, doi: 10.1109/IGARSS.2019.8897904.
### How has the project developed since the last report?
Development of a helm chart for use when deploying to kubernetes has been
opened as a PR.
Further development work has continued and existing installations are being
maintained.
### How would you assess the podling's maturity?
Please feel free to add your own commentary.
- [x] Initial setup
- [x] Working towards first release
- [x] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
Maya Debellis was elected as a committer on 2019-02-08
### Have your mentors been helpful and responsive?
Mentors are helpful and responsive.
### Is the PPMC managing the podling's brand / trademarks?
PPMC is not managing the podling's brand or trademarks.
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [X] (sdap) Trevor Grant
Comments: Need to start working towards release. Let me know if I can
help- I may have some cycles in upcoming months.
### IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important unfinished issues to address before graduating:
1. Make official SDAP (Incubating) Release
2. Improve/create user guide documentation
3. Improve committer participation
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
Interest in the project has increased after presentation at ApacheCon.
New `#sdap` channel created on the-asf.slack.com
### How has the project developed since the last report?
Frank Greguska attended ApacheCon NA and presented an overview of SDAP.
Discussion about what is necessary to produce a release were beneficial
and the path forward is clear. Goal is to get a source release before the
end of the year.
### How would you assess the podling's maturity?
There are several deployments of SDAP actively being used and interest is
high. However, active participation from project members is low. First
source release should be coming soon.
Please feel free to add your own commentary.
- [x] Initial setup
- [x] Working towards first release
- [x] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
Maya Debellis was elected as a committer on 2019-02-08
### Have your mentors been helpful and responsive?
Yes, Trevor has been helpful and responsive. Have not heard from Jörn
recently.
### Signed-off-by:
- [ ] (sdap) Jörn Rottmann
Comments:
- [x] (sdap) Trevor Grant
Comments:
### IPMC/Shepherd notes:
SDAP is an integrated data analytic framework for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important issues to address in the move towards graduation:
1. Make official SDAP (Incubating) Release
2. Improve/create user guide documentation
3. Improve committer participation
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
Interest in the project has increased after presentation at ApacheCon.
New `#sdap` channel created on the-asf.slack.com
### How has the project developed since the last report?
Frank Greguska attended ApacheCon NA and presented an overview of SDAP.
Discussion about what is necessary to produce a release were beneficial
and the path forward is clear. Goal is to get a source release before the end
of the year.
### How would you assess the podling's maturity?
There are several deployments of SDAP actively being used and interest is
high. However, active participation from project members is low. First
source release should be coming soon.
Please feel free to add your own commentary.
- [x] Initial setup
- [x] Working towards first release
- [x] Community building
- [ ] Nearing graduation
- [ ] Other:
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
Maya Debellis was elected as a committer on 2019-02-08
### Have your mentors been helpful and responsive?
Yes, mentors have been helpful and responsive.
### Signed-off-by:
- [ ] (sdap) Jörn Kottmann
Comments:
- [ ] (sdap) Trevor Grant
Comments:
- [ ] (sdap) Lewis John McGibbney
Comments:
SDAP is an integrated data analytic framework for Big Science problems.
SDAP has been incubating since 2017-10-22.
### Three most important issues to address in the move towards graduation:
1. Make official SDAP (Incubating) Release
2. Improve/create user guide documentation
3. Improve committer participation
### Are there any issues that the IPMC or ASF Board need to be aware of?
No.
### How has the community developed since the last report?
We are continuing to attract new committers.
### How has the project developed since the last report?
SDAP is still working towards its first release. Work towards a
repeatable build pipeline has been started.
New functionality has been added to the Distributed Oceanographic Matchup
Service (DOMS) and Extensible Data Gateway Environment (EDGE) components
that allow for filtering in situ measurements by a standardized quality
flag.
### How would you assess the podling's maturity?
There are several deployments of SDAP actively being used and interest is
high. However, active participation from project members is low. A push
is needed to cross the t's and dot the i's in regards to meeting the
requirements Apache has for releasing software so that we can claim a 1.0
version of SDAP.
Please feel free to add your own commentary.
- [X] Initial setup
- [X] Working towards first release
- [X] Community building
- [ ] Nearing graduation
### Date of last release:
XXXX-XX-XX
### When were the last committers or PPMC members elected?
Maya Debellis was elected as a committer on 2019-02-08
### Have your mentors been helpful and responsive?
Yes, mentors have been helpful and responsive.
### Signed-off-by:
- [ ](sdap) Jörn Kottmann
Comments:
- [ ](sdap) Trevor Grant
Comments:
- [ ](sdap) Lewis John McGibbney
Comments:
### IPMC/Shepherd notes:
Justin Mclean: Please use the format provided rather than an old format.
SDAP is an integrated data analytic framework for Big Science problems. SDAP has been incubating since 2017-10-22. Three most important issues to address in the move towards graduation: 1. Make official SDAP (Incubating) Release 2. Improve/create user guide documentation 3. Improve committer participation Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No. How has the community developed since the last report? Committership has been accepted by a community member. SDAP was presented at a Data Science Workshop @ JPL How has the project developed since the last report? SDAP is still working towards its first release. Mentors have provided some suggestions that will be taken into consideration for the Java parts of the project, but the python release process also needs to be better understood. A new tool has been published that helps with reading the output produced from the Matchup algorithm. How would you assess the podling's maturity? Please feel free to add your own commentary. [X] Initial setup [X] Working towards first release [X] Community building [ ] Nearing graduation Date of last release: XXXX-XX-XX When were the last committers or PPMC members elected? Maya Debellis was elected as a committer on 2019-02-08 Have your mentors been helpful and responsive or are things falling through the cracks? In the latter case, please list any open issues that need to be addressed. Yes, mentors have been helpful and responsive. Signed-off-by: [ ](sdap) Jörn Rottmann Comments: [X](sdap) Trevor Grant Comments: IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
Three most important issues to address in the move towards graduation:
1. Make official SDAP (Incubating) Release
2. Improve/create user guide documentation
3. Grow Community
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
A member of the SDAP podling stepped up to the release manager role which
is great. It shows the the podling is maturing.
Unfortunately, the release candidate which was produced was not in
compliance with the ASF release policy, thankfully Justin highlighted
this and we are in the process of rolling the RC back. Lewis (SDAP
champion) and the release manager are working to resolve this and get the
first incubating release candidate finished.
How has the community developed since the last report?
Two VOTE's have been made over on private@sdap regarding extending
PPMC and Committership to two community contributors. This is very
positive.
How has the project developed since the last report?
SDAP is on the verge of it's first release. With some persistence
the podling will have a release candidate for community VOTE soon.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[X] Working towards first release
[X] Community building
[ ] Nearing graduation
[X] Other: One the release management process is documented we will be
pushing for graduation.
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
Elizabeth Lam was elected on 2019-02-06
Maya DeBellis was elected on 2019-02-06
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
Yes mentors have been responsive providing answers.
Signed-off-by:
[X](sdap) Jörn Kottmann
Comments:
[X](sdap) Suneel Marthi
Comments:
[X](sdap) Lewis John McGibbney
Comments:
IPMC/Shepherd notes:
Dave Fisher: Most of the PPMC listed in Whimsy is not subscribed to
private@.
The number of developers on the dev list is small. A little too
soon to be thinking about graduation if you ask me.
Justin Mclean: The IPMC usually likes to see 2 or 3 releases happen
before the project consider graduation.
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
Three most important issues to address in the move towards graduation:
1. Make formal SDAP (Incubating) Release
2. Improve/create user guide documentation
3. Grow Community
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
Added 2 new developers that are becoming familiar with the project and
will soon become committers.
SDAP has been heavily advertised at/in many Earth Science technology
forums.
SDAP was featured at the CUAHSI Biennial Colloquium with an aim towards
growing the community.
How has the project developed since the last report?
Development is still underway to push towards the first incubating
release of SDAP and each of its subcomponents.
How would you assess the podling's maturity?
Podling's still getting established.
[] Initial setup
[X] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
Kevin M Gill was elected on 2018-03-05
Have your mentors been helpful and responsive or are things falling
through the cracks? In the latter case, please list any open issues
that need to be addressed.
As mentors, we have not been very actively involved - but there's nothing ye
t that required the mentor's attention (the project is in good hands under L
ewis :-)).
Mentors are available nevertheless to help with releases and guiding the pod
ling.
Signed-off-by:
[X](sdap) Jörn Kottmann
Comments:
[X](sdap) Suneel Marthi
Comments:
IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
Three most important issues to address in the move towards graduation:
1. Grow community
2. Make formal SDAP (Incubating) releases
3. Evangelize SDAP as an integrated data analytic center for Big Science
problems
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
No.
How has the community developed since the last report?
For the last quarter, again SDAP has been heavily advertised
at/in tons of Earth Science technology forums.
Members of SDAP team demonstrated the software at the ESIP
Summer 2018 meeting in Tucson, AZ with the aim of growing
community.
How has the project developed since the last report?
The project is around a month or so away from making it's first
Incubating release. Development is ongoing and positive.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[X] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
Kevin M Gill was elected on 2018-03-05
Signed-off-by:
[ ](sdap) Jörn Rottmann
Comments:
[ ](sdap) Raphael Bircher
Comments:
[ ](sdap) Suneel Marthi
Comments:
[X](sdap) Lewis John McGibbney
Comments:
IPMC/Shepherd notes:
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
Three most important issues to address in the move towards graduation:
1. Grow community
2. Make formal SDAP (Incubating) releases
3. Evangelize SDAP as an integrated data analytic center for Big Science problems
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
No.
How has the community developed since the last report?
SDAP has been heavily advertised at/in tons of Earth Science
technology forums. The SDAP community has plans to continue
in this thread with loads of activity booked over the summer
including for example, a workshop at the forthcoming ESIP
Summer 2018 meeting in Tucson, AZ
http://esipfed.org/meetings/upcoming-meetings/esip-summer-meeting-2018
How has the project developed since the last report?
Development is being sustained with initial discussion of an initial
Incubating release some time soon. The dev@ community has produced
documentation regarding release artifacts. The aim would be to have
a release candidate ready within the next month or so.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[X] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
Kevin M Gill was elected on 2018-03-05
Signed-off-by:
[ ](sdap) Jörn Rottmann
Comments:
[ ](sdap) Raphael Bircher
Comments:
[ ](sdap) Suneel Marthi
Comments:
[X](sdap) Lewis John McGibbney
Comments:
IPMC/Shepherd notes:
johndament: The report was written by a mentor. It seems only this mentor is active on list.
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
Three most important issues to address in the move towards graduation:
1. Grow community
2. Make formal SDAP (Incubating) releases
3. Evangelize SDAP as an integrated data analytic center for Big Science problems
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
No
How has the community developed since the last report?
The community is demonstrating the ability to VOTE decisively.
We acquired quorum to move canonical source code development
to Gitbox.
How has the project developed since the last report?
All infrastructure and codebase(s) have successfully been
transitioned over to the ASF. Three new repositories have been
created and initial source code imports have taken place.
Development is working through JIRA nicely.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[X] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
No new committers or PPMC have been added other than the
original SDAP committers.
Signed-off-by:
[ ](sdap) Jörn Rottmann
Comments:
[ ](sdap) Raphael Bircher
Comments:
[ ](sdap) Suneel Marthi
Comments:
[X](sdap) Lewis John McGibbney
Comments: SDAP is doing very well. Branding,
trademarks, source code compliance are the
primary issues blocking a release right now.
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
Three most important issues to address in the move towards graduation:
1. Grow community 2. Make formal SDAP (Incubating) releases 3. Evangelize
SDAP as an integrated data analytic center for Big Science problems
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
No
How has the community developed since the last report?
Over the Christmas holidays not work has been done. SDAP is however being
presented at the ESIP Winter 2018 meeting taking place in Bethesda, Maryland,
U.S.A. this is a community building opportunity.
How has the project developed since the last report?
All infrastructure and codebase(s) have successfully been transitioned over to
the ASF. We are still working on branding, trademarks and source code
compliance.
How would you assess the podling's maturity? Please feel free to add your own
commentary.
[X] Initial setup
[X] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
No new committers or PPMC have been added other than the original SDAP
committers.
Signed-off-by:
[ ](sdap) Jörn Rottmann
Comments:
[ ](sdap) Raphael Bircher
Comments:
[ ](sdap) Suneel Marthi
Comments:
[X](sdap) Lewis John McGibbney
Comments: SDAP is doing pretty well.
Branding, trademarks and source code compliance are the primary issues
right now. Once these are addressed SDAP can focus on the first Incubating
release.
SDAP is an integrated data analytic center for Big Science problems.
SDAP has been incubating since 2017-10-22.
Three most important issues to address in the move towards graduation:
1. Grow community
2. Make formal SDAP (Incubating) releases
3. Evangelize SDAP as an integrated data analytic center for Big Science problems
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
No
How has the community developed since the last report?
We have not formally reported before. We hope the community
to grow once we make our first Incubating release.
How has the project developed since the last report?
All infrastructure and codebase(s) have successfully been
transitioned over to the ASF. We are working to comply
with branding, trademarks and source code. This work is ongoing.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[X] Initial setup
[X] Working towards first release
[ ] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
XXXX-XX-XX
When were the last committers or PPMC members elected?
No new committers or PPMC have been added other than the
original SDAP committers.
Signed-off-by:
[ ](sdap) Jörn Rottmann
Comments:
[ ](sdap) Raphael Bircher
Comments:
[ ](sdap) Suneel Marthi
Comments:
[X](sdap) Lewis John McGibbney
Comments: SDAP is doing pretty well. Branding,
trademarks and source code compliance are the
primary issues right now. Once these are addressed
SDAP can focus on the first Incubating release.