Group email list: https://groups.google.com/forum/#!forum/container-analysis-environments
Participants:
This interest group emerged from break-out meetings at NDS7 concerning container-based architectures for interactive analysis and batch pipelines. The pattern of providing interactive container-based analysis environments (e.g., Jupyter notebooks, Rstudio, Matlab and other programming environments) near large public datasets has been evolving for several years. Examples can be found in ytHub, SciServer, Whole Tale, and the Labs Workbench projects. Additionally, we are seeing use cases to support batch processing (including distributed). Examples can be found in KnowEng and the SBGrid projects.
The purpose of this interest group is to share information about container-based architectures to support interactive and batch access to research data.
Specific activities may include:
Brief summary of discussion at NDS7:
SBGrid: Repository for instrument data for x-ray diffraction. Data is distributed at multiple sites. Containerizing workflows using Singularity to run distributed on XSEDE/Comet. Requirements are currently driven by project not users (no interactive analysis). Discussed use of workflow languages.