Container Analysis Environments Workshop

Information about the 2017 Container Analysis Environments Workshop hosted by the Data Exploration Lab and NDS.



Date/Location

Goals

The idea of this workshop emerged from the 7th NDS Workshop as an opportunity for groups leveraging container-based technologies in research computing environments to build community, share information and address common challenges. 

We are proposing the following themes (please feel free to suggest other topics):

  • Users/researchers and why they are using container-based environments (e.g., consistent environments, packaging applications, shifting computation around)
  • Interactive vs non-interactive use cases including approaches to workflow management, orchestration, scalability, and moving analysis to HPC environments
  • Data/storage focusing on models for managing and exposing data to containers
  • Security/permissions/licensing
  • Challenges/what new use cases are we seeing?

The goal will be to approach this from both user and system perspectives, focusing on the science/research cases and how technical solutions are addressing these needs.

Workshop report

  • One output of the workshop will be a report summarizing common use cases, best practices, and challenges supporting container-based analysis and computing environments.

Participating groups 

See Container Analysis Environments Participants.

Format:

The format of the workshop will be presentations mixed with discussions, working groups, or deep-dive presentations. The working groups will be self-organized, based on the goals and needs of participants. Each person/group will present for ~20 minutes. Participants will be from a variety of backgrounds. Presentations should cover supported science cases, overall systems architecture, and any challenges/new directions related to supporting container-based analysis and computing environments.

Communication:

Schedule:

Below is the latest workshop schedule.  Presentations and times are subject to change. Please contact us with any dietary restrictions.

Monday August 14th (tentative)

The first day we will focus on participant presentations with significant Q&A and discussion time.  Topics that emerge from the presentations will be considered for breakout/deep-dive discussions on Tuesday and Wednesday. 

TimeDescription
9:00 - 9:30

Introduction/welcome

Logistics

Data Exploration Lab (Turk)

NDS Welcome (Willis)

9:30 - 11:00

Presentations

Discussion

LSST/DES (Kind)

Blue Waters (Bauer)

LIGO (Haas, Huerta)

11:00 - 11:15Break


11:15 - 12:30

Presentations

Discussion

Cyverse (McEwen)

Cyverse/TACC (Fonner)

yt.hub, Whole Tale (Turk, Kowalik)

12:30 - 1:30Lunch
1:30 - 3:00

Presentations

Discussion

SDSC (Zonca)

SciServer (Lemson)

NDS Labs Workbench (Willis)

3:00 - 3:15Break
3:15 - 5:00

Presentations

Discussion

TERRA-REF (LeBauer, Burnette)

CyberGIS (Liu, Terstriep)

Simulocean/Coastal Modeling Collaboratory (Tao)


5:00 - 5:30Discussion/planning

Tuesday August 15th

Tentative: Based on discussions from Monday, we will organize breakout/deep-dive discussions for topics of interest (feel free to suggest).  Additional presentations may be scheduled, depending on participation:

Topics from discussion:

  • Integration with HPC environments
  • Interactive anlaysis environments
  • Integration with workflow systems (not enough expertise to discuss)
  • Shared storage across containers
  • Managing images/archiving preservation


TimeDescription
9:00 - 9:30Summary/takeaways from Monday?
9:30 - 12:00

Topics:

Singularity tutorials

Integration with HPC environments

Break ~10:45
12:00 - 1:00Lunch
1:00 - 3:00

Topics:

Demos (Agave, WT, SciServer)

Shared storage across containers


3:00 - 3:15Break
3:15 - 5:00

Managing images/archiving presentation

Interactive analysis environments



Wednesday August 16th

Tentative: We will use the morning to conclude any break-out work and to consolidate group output (presentations, documents, etc) for the workshop report.

TimeDescription
9:00 - 9:30Discussion/planning
9:30 - 11:30Breakout groups
11:30 - 12:00Closing

Where to eat

A few recommendations for places to eat in Champaign/Urbana: