This was extracted (@ 2024-03-20 21:10) from a list of minutes
which have been approved by the Board.
Please Note
The Board typically approves the minutes of the previous meeting at the
beginning of every Board meeting; therefore, the list below does not
normally contain details from the minutes of the most recent Board meeting.
WARNING: these pages may omit some original contents of the minutes.
Meeting times vary, the exact schedule is available to ASF Members and Officers, search for "calendar" in the Foundation's private index page (svn:foundation/private-index.html).
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
N/A
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
A discussion thread has begun on the retirement of the Slider podling.
There has not been much activity on the thread so far. Concern was
expressed that users who are unable to upgrade to Hadoop 3 will be
stuck without Slider support. A question was posed about whether an
additional release before retirement would help. Given the lack of
involvement on the thread, it is likely that a retirement vote will be
held soon.
How has the community developed since the last report?
No new community development.
How has the project developed since the last report?
Two commits have been made since the last report. One improved Slider's
behavior in multi-homed environments and the other fixed a bug in how the
Slider agent kills processes.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[x] Other: Nearing retirement
Date of last release:
2017-03-23 slider-0.92.0-incubating
When were the last committers or PPMC members elected?
2018-02-21 New committer and PPMC member Kyungwan Nam
Signed-off-by:
[ ](slider) Arun C Murthy
Comments:
[ ](slider) Devaraj Das
Comments:
[ ](slider) Jean-Baptiste Onofré
Comments:
[ ](slider) Mahadev Konar
Comments:
[X](slider) Vinod Kumar Vavilapalli
Comments: Barring any last minute high-pitch concerns on the discuss thread, the community will / should start a vote thread for retiring the project.
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Most important issues to address in the move towards graduation:
Since new development on one of Slider's primary maven modules has
moved to the hadoop-yarn-services-core module in Apache Hadoop,
development of other Slider modules has also tailed off. The Slider
community needs to decide whether we should retire the remaining
Slider code or propose graduation.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
No additional issues.
How has the community developed since the last report?
Mailing list and commit activity have continued at a low rate. We invited
a new committer / PPMC member, Kyungwan Nam.
How has the project developed since the last report?
An improvement to allow Slider to work in multi-homed environments is
in progress and we have fixed a couple of bugs related to certificate
management and functional test failures when running on newer versions
of Hadoop.
How would you assess the podling's maturity?
The podling is relatively mature, but activity is low.
[ ] Initial setup
[ ] Working towards first release
[ ] Community building
[ ] Nearing graduation
[x] Other: Discussing direction
Date of last release:
2017-03-23 slider-0.92.0-incubating
When were the last committers or PPMC members elected?
2018-02-21 New committer and PPMC member Kyungwan Nam
Signed-off-by:
[ ](slider) Arun C Murthy
Comments:
[ ](slider) Devaraj Das
Comments:
[ ](slider) Jean-Baptiste Onofré
Comments:
[ ](slider) Mahadev Konar
Comments:
[X](slider) Vinod Kumar Vavilapalli
Comments: Given the progress of development in hadoop-yarn-services, I think this community should start the retirement proceedings. The things to figure out when the retirement happens is the website redirect, past releases' bits and any outstanding apps that are not yet migrated.
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Apache Slider community/PPMC has voted to move portions of Slider into
Apache Hadoop YARN as modules. It is possible that the remaining pieces
will be moved at a later point in time or become obsolete or evolve to
work closely with YARN. A vote was initiated in the Apache Hadoop
community to merge all Slider specific changes (now referred to as YARN
Services) from a branch to trunk. Expectation is to make YARN Services
an integral part of Apache Hadoop 3.x release. Few issues were raised
on the changes in the branch, but all have been addressed and a new
vote was initiated on Oct 30, 2017.
2. Getting more external users
3. Growth of a diverse set of developers/committers/PMC members
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
No.
How has the community developed since the last report?
Mailing list activity has been lower due to the bulk of the development
moving to an Apache Hadoop branch. Questions on usage and issues
encountered by end users keep coming at regular intervals, keeping the DL
somewhat active.
How has the project developed since the last report?
Work continues in parallel on the Apache Hadoop yarn-native-services
branch and on the Slider podling. The bulk of the work has been in
yarn-native-services. However, quite a few Fortify identified issues,
a new feature for Percentage based Health Monitor support (SLIDER-1246) and
a few Slider patches (related to critical issues or agent-only issues) have
been committed to the Slider podling, since the last report.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2017-03-23 slider-0.92.0-incubating
When were the last committers or PPMC members elected?
2015-07-07: Yu (Thomas) Liu
Signed-off-by:
[ ](slider) Arun C Murthy
Comments:
[ ](slider) Devaraj Das
Comments:
[ ](slider) Jean-Baptiste Onofré
Comments:
[ ](slider) Mahadev Konar
Comments:
[X](slider) Vinod Kumar Vavilapalli
Comments: Work happening in Apache Hadoop YARN project has reached a critical milestone -
the Apache Hadoop community has voted and Slider functionality is now merged into Apache
Hadoop trunk. It is potentially going to be part of the Apache Hadoop 3.1 release. Slider
community to summarize this on dev-list and figure out the mechanics of working with
Incubator to retire the Slider project and draw plans for hosting old releases, supporting
and migrating existing applications etc.
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Apache Slider community/PPMC has voted to move portions of Slider into
Apache Hadoop YARN as modules. It is possible that the remaining pieces
will be moved at a later point in time or become obsolete or evolve to
work closely with YARN. Slider PPMC will decide what makes the most
sense as we progress through this exciting time.
2. Getting more external users
3. Growth of a diverse set of developers/committers/PMC members is also
crucial towards the final state of Slider
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
No.
How has the community developed since the last report?
Mailing list activity has been lower due to the bulk of the development
moving to an Apache Hadoop branch. Questions on usage and issues
encountered by end users keep coming at regular intervals, keeping the DL
fairly active.
How has the project developed since the last report?
Work continues in parallel on the Apache Hadoop yarn-native-services
branch and on the Slider podling. The bulk of the work has been in
yarn-native-services, while a few Slider patches (related to critical
issues or agent-only issues) have been committed as well.
How would you assess the podling's maturity? Please feel free to add your own
commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2017-03-23 slider-0.92.0-incubating
When were the last committers or PPMC members elected?
2015-07-07: Yu (Thomas) Liu
Signed-off-by:
[ ](slider) Arun C Murthy
Comments:
[ ](slider) Devaraj Das
Comments:
[ ](slider) Jean-Baptiste Onofré
Comments:
[ ](slider) Mahadev Konar
Comments:
[X](slider) Vinod Kumar Vavilapalli
Comments: More work happening in Apache Hadoop YARN project to finish the module move of Slider but it is opaque. Will prod the community to send periodic dev-list updates demonstrating the current progress in this process.
IPMC/Shepherd notes:
johndament: Based on the description, as well as the little bit of information I've been able to get out of the Slider community, it seems that while there is a Slider community they're not actively working on Slider's codebase. My recommendation is probably to retire the Slider community if they cannot be absorbed into the Hadoop TLP.
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Apache Slider community/PPMC has voted to move portions of Slider into
Apache Hadoop YARN as modules. It is possible that the remaining pieces
will be moved at a later point in time or become obsolete or evolve to
work closely with YARN. Slider PPMC will decide what makes the most
sense as we progress through this exciting time.
2. Getting more external users
3. Growth of a diverse set of developers/committers/PMC members is also
crucial towards the final state of Slider
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
No.
How has the community developed since the last report?
Mailing list activity has been lower due to the bulk of the development
moving to an Apache Hadoop branch. Questions on usage and issues
encountered by end users keep coming at regular intervals, keeping the DL
fairly active.
How has the project developed since the last report?
Work continues in parallel on the Apache Hadoop yarn-native-services
branch and on the Slider podling. The bulk of the work has been in
yarn-native-services, while a few Slider patches (related to critical
issues or agent-only issues) have been committed as well.
How would you assess the podling's maturity? Please feel free to add your own
commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[ ] Nearing graduation
[ ] Other:
Date of last release:
2017-03-23 slider-0.92.0-incubating
When were the last committers or PPMC members elected?
2015-07-07: Yu (Thomas) Liu
Signed-off-by:
[ ](slider) Arun C Murthy
Comments:
[ ](slider) Devaraj Das
Comments:
[ ](slider) Jean-Baptiste Onofré
Comments:
[ ](slider) Mahadev Konar
Comments:
[X](slider) Vinod Kumar Vavilapalli
Comments: Joined as a new mentor while the transition of Slider to Apache
Hadoop project as a sub-module continues. Per feedback on general@, the
community shall work on a concrete plan on how the project's journey in
incubator comes to a close.
IPMC/Shepherd notes:
johndament: The IPMC still is looking for clarification on Slider/Hadoop's
relationship. Will follow up.
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Apache Slider community/PPMC has voted to move portions of Slider into
Apache Hadoop YARN as modules. It is possible that the remaining pieces
will be moved at a later point in time or become obsolete or evolve to
work closely with YARN. Slider PPMC will decide what makes the most
sense as we progress through this exciting time.
2. Getting more external users
3. Growth of a diverse set of developers/committers/PMC members is also
crucial towards the final state of Slider
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
No.
How has the community developed since the last report?
There has been one new contributor since the last report. Mailing list
activity has been lower due to the bulk of the development moving to an
Apache Hadoop branch, but the lists are still active.
How has the project developed since the last report?
Work continues in parallel on the Apache Hadoop yarn-native-services
branch and on the Slider podling. The bulk of the work has been in
yarn-native-services, while a few Slider patches (related to critical
issues or agent-only issues) have been committed as well.
Date of last release:
2016-06-28 slider-0.91.0-incubating
When were the last committers or PMC members elected?
2015-07-07: Yu (Thomas) Liu
Signed-off-by:
[ ](slider) Arun C Murthy
[x](slider) Devaraj Das
[ ](slider) Jean-Baptiste Onofré
[ ](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Apache Slider community/PPMC has voted to move portions of Slider into
Apache Hadoop YARN as modules. It is possible that the remaining pieces
will be moved at a later point in time or become obsolete or evolve to
work closely with YARN. Slider PPMC will decide what makes the most
sense as we progress through this exciting time.
2. Getting more external users
3. Growth of a diverse set of developers/committers/PMC members is also
crucial towards the final state of Slider
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
No.
How has the community developed since the last report?
The Apache Hadoop YARN community/PMC and Apache Slider community/PPMC had
decided to move portions of Slider into YARN, to make fast and significant
progress on: YARN-4692 - [Umbrella] Simplified and first-class support for
services in YARN. As a result, the Slider Core module (including Application
Master, Client and Java unit tests) has been rolled into an Apache Hadoop
YARN feature branch as a hadoop-yarn-slider-core module. This effort is
being captured in: YARN-5079 : Native YARN framework layer for services. All
the migrations are happening in a branch (namely yarn-native-services)
created of off Hadoop trunk. As a result of this, we are already seeing
interest in the Hadoop committers/PMC, who have started to contribute and
submit patches to Slider.
In order to support existing users of Slider, and to provide seamless
migration, there will be sufficient overlap between the time when a stable
state of long running services support is available in some future version
of YARN and the time till an independent Slider release is available. The
community/PPMC will also determine the future state of Slider as we navigate
through these changes.
The discussions on the Slider and YARN community DLs can be viewed here -
https://s.apache.org/0hoh
https://s.apache.org/MncV
For the benefit of those who would like to use Slider Core from the Hadoop
codebase, but continue to use classic Slider Agent and legacy app-packages,
a new branch (yarn-native-services) has been created in classic Slider repo.
This branch retains only the Agent (python) code and the App Packages. It
adds Slider Core module as a Hadoop dependency. This allows users to consume
the latest of Slider Core. Future classic Slider releases can be made
purely off of this branch.
Additionally an effort is being made to create an agent-less provider for
legacy app-packages, which could help users to completely migrate to Hadoop
codebase for creating long-running services with Slider. Expectation from
app-package owners would be to make minor modification of their packages.
Primary changes would be to shed the dependency on python Agent code,
effectively making packages much simpler than what they look like today in
classic Slider.
How has the project developed since the last report?
There has been fewer bug fixes on the classic Slider side as most of the
focus has been on developing features on native YARN services in the Hadoop
codebase. Work continues on support for complex services (assemblies) and
agent-less applications in Slider. The efforts on Slider Core will continue
in the new services branch created in YARN. Few key features which were
merged to classic Slider as well were - SLIDER-875 - Ability to create an
Uber application package with capability to deploy and manage as a single
business app, and SLIDER-1107 - Generate app configuration files in AM.
Several issues identified by Coverity scans were resolved as well.
Additionally few patches were contributed by the community fixing functional
and performance issues. Slider community plans to ship a release in the next
quarter with all these features and bug fixes.
Date of last release:
2016-06-28 slider-0.91.0-incubating
When were the last committers or PMC members elected?
2015-07-07: Yu (Thomas) Liu
Signed-off-by:
[ ](slider) Arun C Murthy
[ ](slider) Devaraj Das
[X](slider) Jean-Baptiste Onofré
[X](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Apache Slider community/PPMC has voted to move portions of Slider into
Apache Hadoop YARN as modules. It is possible that the remaining pieces
will be moved at a later point in time or become obsolete or evolve to
work closely with YARN. Slider PPMC will decide what makes the most
sense as we progress through this exciting time.
2. Getting more external users
3. Growth of a diverse set of developers/committers/PMC members is also
crucial towards the final state of Slider
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
No.
How has the community developed since the last report?
The Apache Hadoop YARN community/PMC and Apache Slider community/PPMC has
decided to move portions of Slider into YARN, to make fast and significant
progress on: YARN-4692 - [Umbrella] Simplified and first-class support for
services in YARN. As a result, portions like Slider Core, Application
Master, Client and Tests will roll into Apache Hadoop YARN as module(s).
This effort is being captured in: YARN-5079 : Native YARN framework layer
for services. At this point, a branch has been created in the Hadoop
codebase, and Slider has been selectively migrated. As a result of this,
we are already seeing interest in the Hadoop committers/PMC, who have
started to contribute and submit patches to Slider.
In order to support existing users of Slider, and to provide seamless
migration, there will be sufficient overlap between the time when a stable
state of long running services support is available in some future version
of YARN and the time till an independent Slider release is available. The
community/PPMC will also determine the future state of Slider as we
navigate through these changes.
The discussions on the Slider and YARN community DLs can be viewed here -
https://s.apache.org/0hoh
https://s.apache.org/MncV
How has the project developed since the last report?
We released version 0.91.0-incubating in June, 2016 with significant work
done on token management, unique component support, SLIDER-906 (Support
for Docker based application packaging with first class YARN support) and
several bug fixes. Work continues on support for complex services
(assemblies) and agent-less applications in Slider. The efforts on the
Core will continue in the new services branch created in YARN.
Date of last release:
2016-06-28 slider-0.91.0-incubating
When were the last committers or PMC members elected?
2015-07-07: Yu (Thomas) Liu
Signed-off-by:
[ ](slider) Arun C Murthy
[X](slider) Devaraj Das
[ ](slider) Jean-Baptiste Onofré
[ ](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Getting more external users
2. Getting more diverse set of developers
3. Getting more diverse set of committers/PMC
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?
No.
How has the community developed since the last report?
We continue to see regular interaction with users who are trying out
Apache Slider (incubating). Questions range from introductory "I'm
trying to do $x" to bug reports "I did $a and encountered an issue $b".
The committers try their best to keep people involved and steer them
toward contributions. The strong majority of contributions continue to
come from existing podling members.
How has the project developed since the last report?
The IP clearance for the Apache Kafka Slider "app-package" process
was addressed (after discussion on general@i.a.o) and this codebase was
merged in. This was a great contribution by a few external developers
and very much appreciated.
Work continues on "phase 2" of some long-term work to include support
for running Docker containers in Slider. The intent behind this work is
that we will make it easier for (prospective) users to build
applications that can run on Slider. There is a tentative patch on
SLIDER-906 and some related documentation updates.
We have agreed upon a next release (0.91) happening in May, but have
not made any significant progress towards that release yet.
We had a discussion put forth about the future of Slider by a podling
member. At the inception of Slider, Apache Hadoop's YARN was not ready
to support long-lived services "natively". While Slider has been in
incubation, YARN has continued to grow towards treating these services
natively, partly as a result of requirements necessary of Slider to
work. As such, we discussed whether it would make sense to ask the YARN
project if they would be interesting in combining efforts, moving the
core of Slider into YARN itself. The Slider community reacted
positively, noting that YARN is likely a better long-term home for the
core of Slider; however, there were a few points raised that would need
to be addressed before any action was actually taken. The mail discussion
can be found at https://s.apache.org/3ywX
Date of last release:
2016-01-09 slider-0.90.2-incubating
When were the last committers or PMC members elected?
2015-07-07: Yu (Thomas) Liu
Signed-off-by:
[ ](slider) Arun C Murthy
[ ](slider) Devaraj Das
[X](slider) Jean-Baptiste Onofré
[ ](slider) Mahadev Konar
Shepherd/Mentor notes:
Drew Farris (drew)
- No apparent mentor activity on the dev/private mailing lists over the past
few months for the Slider podling. Active committers and a reasonable
amount of
JIRA and mailing list activity.
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Getting more external users 2. Getting more diverse set of developers 3. Getting more diverse set of committers/PMC Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? We completed the IP clearance for the contribution of a Kafka app package for Slider, KOYA. We have a few patches that have been submitted by contributors and still need to be reviewed. How has the project developed since the last report? We added a new app package for running Apache Tomcat on Slider. We released slider-0.90.2-incubating (the first in the 0.90 line), a preview/alpha release containing a major new feature, anti-affinity placement. Also, we have reworked our release process and are planning our next release for around March 1. Date of last release: 2016-01-09 slider-0.90.2-incubating When were the last committers or PMC members elected? 2015-07-07: Yu (Thomas) Liu Signed-off-by: [ ](slider) Arun C Murthy [ ](slider) Devaraj Das [X](slider) Jean-Baptiste Onofré [ ](slider) Mahadev Konar Shepherd/Mentor notes:
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Getting more external users 2. Getting more diverse set of developers 3. Getting more diverse set of committers/PMC Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? We are seeing traction in the community with a number of new users requesting improvements in deployment and management of applications using Slider. Patches were submitted by a couple of new contributors. We still have to get those people into long term coding, and then bring them in to the committer group. How has the project developed since the last report? We released a slider-0.81.1-incubating bug fix release with 30 JIRAs resolved and have begun discussing the 0.90.0 release. Date of last release: 2015-10-29 slider-0.81.1-incubating When were the last committers or PMC members elected? 2015-07-07: Yu (Thomas) Liu Signed-off-by: [ ](slider) Arun C Murthy [X](slider) Devaraj Das [ ](slider) Jean-Baptiste Onofré [X](slider) Mahadev Konar Shepherd/Mentor notes:
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Getting more external users 2. Getting more diverse set of developers 3. Getting more diverse set of committers/PMC Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? We are seeing a lot of traction in the community, over the improvement in deployment and management of applications using Slider. Good number of emails are pouring in the dev list, primarily on creation of Slider packages for newer applications and willingness to contribute code. Few presentations and meetups were organized by the community, socializing their Slider-ized applications. Occasional patches were submitted and a number of features added to the recent releases were driven by end-user needs. We still have to get those people into long term coding, and then bring them in to the committer group. How has the project developed since the last report? We released slider-0.80.0-incubating in May with 64 JIRAs resolved. It was one of Slider's most important release, with several critical business application features like rolling upgrade, co-processor support for dynamic addition of libraries, and support for Docker containers. We've been debating when to switch from Hadoop 2.6+ support to 2.7.1+ only. Given how Slider has always tended to push much of the YARN services work, it's time to pick up on the changes they've put in. Date of last release: 2015-05-18 slider-0.80.0-incubating When were the last committers or PMC members elected? 2015-07-07: Yu (Thomas) Liu Signed-off-by: [ ](slider) Arun C Murthy [X](slider) Devaraj Das [X](slider) Jean-Baptiste Onofré [ ](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Building a diverse developer and user community
2. Achieving broader adoption of the existing code and slider-deployable
applications (examples: HBase, Accumulo)
3. Making slider better at deploying other applications, so improving
takeup.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
We are getting some questions from users on the list and an occasional
patch submitted. A number of features added to the recent releases
were driven by user needs.
How has the project developed since the last report?
We completed release 0.61.0-incubating in February with more complex
release artifacts than we had released previously. We also released
0.70.1-incubating in March. Planning is under way for releasing 0.80 in
May 2015.
Date of last release:
2015-03-31: Slider 0.70.1-incubating
2015-02-19: Slider 0.61.0-incubating
When were the last committers or PMC members elected?
2014-09-27: Gour Saha, committer and PPMC member
Signed-off-by:
[ ](slider) Arun C Murthy
[ ](slider) Devaraj Das
[ ](slider) Jean-Baptiste Onofré
[ ](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Building a diverse developer and user community
2. Achieving broader adoption of the existing code and slider-deployable
applications (examples: HBase, Accumulo)
3. Making slider better at deploying other applications, so improving
takeup.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
We're getting more people on the mailing list asking for improvements;
anyone with a patch is being helped to get it in. That builds up the
developer base and is intended to move it from a single team to one
distributed community development. As we grow, we're proposing moving
from a single slider developer list to:a separate user mailing list, and a
third list for the JIRA/svn/git events. This will focus the developer list
around discussion, with a user list to help build that user community. We
do of course expect developers to also subscribe to the user list.
How has the project developed since the last report?
We've done a source-only release in November, 0.60.0-incubating, in sync
with features in Hadoop 2.6, with a binary packing version,
0.61.0-incubating has just been voted for release (3-feb 2015); the
incubator vote is now pending. It was nice to see tests and a vote on the
release from an external user & patch submitter -community engagement
includes things like this.
A new release, 0.70 is being created with the release planned
mid-February. This will include improved features and fixes —especially
those reported by users of the 0.60 release. For example, one group wanted
short-lived applications on secure clusters, instances where Slider does
not need to worry about keytab expiry. Another need of people writing
slider-deployed applications was for a placement policy of "only ever ask
for component placement where instances were before"; this is needed for
Kafka.
Some of the feature requests are quite "ambitious", especially those
related to deployed components providing information back to the Web/REST
GUIs, and extending the configuration model to include: more
on-target-machine configuration, per-instance configuration and better
strategies for placing components within the YARN cluster. These requests
do represent real needs; even if they are long term features we need to
think about how to get there.
We're discussing supplementing the dev@ mailing list with issues@ and
user@ lists; the issues list for all JIRA updates -creation and completion
would still go to the developer list. This is to separate the noise of
JIRA-centric development from a developer list focused on broader
application features and building a community. We don't want to scare
people off from too much JIRA, or worse: lose what they have to say in the
emails. Similarly, the user@ list is where we want to encourage users. The
original rationale for a single list was "one single community
discussion", but it's not clear its worked out that way.
Date of last release:
2014-11: Slider 0.60 (source, against Hadoop 2.6)
2015-02: (vote in progress) Slider 0.61.0 (binary, against Hadoop 2.6)
When were the last committers or PMC members elected?
September 2014, new committer, Gour Saha (works at hortonworks)
Signed-off-by:
[ ](slider) Arun C Murthy
[x](slider) Devaraj Das
[x](slider) Jean-Baptiste Onofré
[x](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Increasing community diversity 2. Completing podling name search 3. Building a user community Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? We have added one committer / PMC member, Gour Saha. We're getting some independent users/developers on our list, including some initial contributions and some bug reports. As an example, we have some contributed patches for command line improvements and bug reports around user experience improvement. How has the project developed since the last report? Development and mailing lists have been active, working towards a major upcoming release. A service registry has been redesigned and contributed to Yarn (see YARN-913), and Slider continues to help drive improvements needed for long-lived services in Yarn. The current plan is to release Slider version 0.60 in November. Thanks to the Accumulo, HBase, and Storm community, application packages for all the three are now updated to work with Slider 0.60, Hadoop 2.6, and secured clusters in general. Moreover, HBase and Storm packages for Windows are also already developed. Date of last release: 2014-07-21 When were the last committers or PMC members elected? 2014-09-22 Signed-off-by: [ ](slider) Arun C Murthy [ ](slider) Devaraj Das [ ](slider) Jean-Baptiste Onofré [ ](slider) Mahadev Konar Shepherd/Mentor notes:
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Building a user community 2. Getting those users to contribute their work back 3. Improving the application to make it easier to use Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? We're getting some independent users/developers on our list, including some initial minor contributions and some bug reports. As an example, we have some contributed logos ... which is now going to trigger a competition/vote for a slider logo. The main external developer adoption is not in actual contributions for the core slider engine, but from a few people writing slider application- packages to deploy their own applications. This is a good first step - we have to work with them to get them through this process, note and address issues they have -as well as encouraging them to contribute a bit themselves. There's a tradeoff there: we don't want to dismiss all issues with "file a patch with the JIRA" -maybe there's an intermediate step of "let's work on this, can you take this branch and verify it works for you?" How has the project developed since the last report? 1. We're still fast-iterating through releases. 2. We're testing slider against the forthcoming Hadoop 2.5 release, to help validate that release. 3. We're debating when - in August - to make the leap to only building against Hadoop 2.6 The switch to 2.6 will mean that this code would be developer only, as it would only work against non-production Hadoop clusters. Yet we need this for the forthcoming features: the Credential provider, service registry, Yarn node labeling and other features we need to integrate with. That's a fairly exclusionary move for potential users: the current plan is to make a release in sync with Hadoop 2.5, which will be the last Hadoop 2.4/2.5 compatible version. Yet it not only gives us those new features, it helps tune those features and find bugs in their implementation. As an example, one fix in Hadoop 2.4 is related to an Application Master failure and restart problem which we'd found, a problem which, if we'd switched to Hadoop 2.4-SNAPSHOT earlier, would have been found and fixed in the 2.4 release. Date of last release: 2014-07-21 When were the last committers or PMC members elected? 2014-05 Signed-off-by: [ ](slider) Arun C Murthy [ ](slider) Devaraj Das [X](slider) Jean-Baptiste Onofré [ ](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Building a user community 2. Getting those users to contribute their work back 3. Improving the application to make it easier to use Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? * We've made our first ASF-based release and are starting to get people discussing it on our dev list -our sole mailing list to date. This shows some take up, but it also identifies the challenge in diagnosing problems. We need to provide more application-side diagnostics to help both users and ourselves. How has the project developed since the last report? * As stated, we've made our first ASF release. We plan to do this monthly for the next few months, to get our release process refined, as we as evolve the application from users' experiences. * We've fully migrated to the ASF JIRA server, and have been cross-filing issues with sibling Apache projects -notably YARN- so helping gain awareness of us and our needs. So far the other projects have been very helpful. * We're trying to contribute some of our changes back into the Hadoop and Bigtop projects -our workflow YARN services and service launcher to Hadoop; improvements to the test runner shell for Bigtop. These will spread the benefits of these features, and tighten our relationship with those projects on which we depend. Date of last release: 2014-06-02 When were the last committers or PMC members elected? 2014-05 Signed-off-by: [ ](slider) Arun C Murthy [ ](slider) Devaraj Das [X](slider) Jean-Baptiste Onofré [X](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Podling name search 2. Growing user community 3. Growing and increasing diversity of developer community Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? We're only getting started, and do not have any diversity yet. Our first goal will be to get users, bug reporters and developers. The dev list is up and running -and we do not have any separate user list, so we hope to pull users into coding. The initial release will help to gain awareness, and should bring in users. How has the project developed since the last report? Our main activity has been setting up the incubator-hosted project, JIRA, site, mailing list. etc. The Infra team have been very helpful here. - Making and publishing our site has educated us on site publishing - The initial release has taught us of the release process for incubating projects, and where we need to improve it. We're still trying to get Jenkins building, but that's a matter of handling protobuf-versions on the build machines, rather than infra involvement. We have made our first ASF-hosted release on June 2. This was a source only release; some of the reviewers have made suggestions which will need to be incorporated into the next. We plan to do another release in a few weeks time, and so evolve the project rapidly. Date of last release: 2014-06-02 When were the last committers or PMC members elected? We have only just set up and so the committer and PMC membership is as covered in the incubator proposal. Signed-off-by: [ ](slider) Arun C Murthy [ ](slider) Devaraj Das [ ](slider) Jean-Baptiste Onofré [X](slider) Mahadev Konar
Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 0. Podling name check 1. LICENSE and NOTICE review 2. Make releases 3. Add committers Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? none How has the community developed since the last report? none How has the project developed since the last report? * Accounts, mailing lists, JIRA, subversion repository, and website created. * Initial code contribution completed. * Name research has begun at PODLINGNAMESEARCH-47. Date of last release: none When were the last committers or PMC members elected? none Signed-off-by: [ ](slider) Vinod Kumar Vavilapalli [ ](slider) Jean-Baptiste Onofré [X](slider) Mahadev Konar [X](slider) Arun Murthy [X](slider) Devaraj Das