...
Participating groups (tentative)
...
| Projects | Description |
|---|---|
(Kim, Lemson) | SciServer Compute supports interactive and batch access to to multiple large public datasets across several domains (including the Sloan Digital Sky Survey) via containers. They support Rstudio/Jupyter/Matlab interactive environments and have developed a custom job scheduler for containers, each with supporting scripting libraries for SciServer component and data integration. SciServer compute supports SSO with user defined group access to shared storage and access to centralized datasets, some in relational databases |
(McEwan, Fronner) | |
Whole Tale, yt.Hub, RSL, Data Exploration Lab (Turk, Kowalik) | The yt Hub provides access to very large datasets (both observation and simulation based) via the integration of Girder and Jupyter Notebook/Lab. Entire available data is locally mounted to compute nodes of a Docker Swarm cluster via NFS. However, the physical location of the data is abstracted through a FUSE filesystem, which allows to provide only a subset of data selected by the user inside the container running Jupyter Notebook/Lab. The Renaissance Labs project will leverage this same approach to provide access to the Renaissance Simulations at SDSC – adding the ability to move analysis to HPC resources and adding a custom UI. |
| (LeBauer, Burnette) | |
...
(Willis, Lambert, Coakley) | The NDS Labs Workbench is a generic platform for launching containerized environments near remote datasets, leveraging Kubernetes. Labs Workbench is deployed on OpenStack as a Kubernetes cluster with GlusterFS for a shared user filesystem across containers (e.g., home directory). Workbench is used by the TERRA-REF project and increasingly for training/education environments (hackathons, workshops, bootcamps, etc). The DataDNS project is an emerging vision for supporting access to remote computational environments. Workbench is a single optional component of the DataDNS framework. |
(Liu, Terstriep) | |
| SDSC (Zonca) | Deployment of Jupyterhub with Docker Swarm and batch spawner support in HPC environments in support of science gateways, research, and training/education. |
Format:
The format of the workshop will be presentations mixed with discussions, working groups, or deep-dive presentations. The working groups will be self-organized, based on the goals and needs of participants. Each person/group will present for ~20 minutes. Participants will be from a variety of backgrounds. Presentations should cover supported science cases, overall systems architecture, and any challenges/new directions related to supporting container-based analysis and computing environments.
...