...
- Sharing use cases and system architecture information
- Coordinating workshop
Breakout Group Summary
Brief summary of discussion at NDS7:
- SciServer: Uses Docker containers (Jupyter, Matlab, Rstudio) to enable access to several public datasets (astronomy, turbulence, genomics, oceanography), mounted as volumes. They provide custom images for specific domains that include required dependencies. Users are given access to scratch-space and a local database. Soon to release job submission service.
SBGrid: Repository for instrument data for x-ray diffraction. Data is distributed at multiple sites. Containerizing workflows using Singularity to run distributed on XSEDE/Comet. Requirements are currently driven by project not users (no interactive analysis). Discussed use of workflow languages.
- TERRA-REF: Uses Docker via Kubernetes (Labs Workbench) to enable access to large public reference dataset. Labs Workbench supports both official and user-provided containers, including customized Jupyter/Rstudio and development environments (cloud IDEs, console).
- KnowEng: Uses containerized pipelines executed via Mesos to support genetics analysis.
- yt.hub: Combines Girder and Jupyter tmpnb top provide access to very large astronomy datasets.
- Mention of SciDas project.