Using Containers to Accelerate HPC
ECP Supercontainers Tutorial Session @ Supercomputing Conference 2020 (SC20’)
Date: Tuesday, 10 November 2020 2:30pm - 6:30pm (Eastern Standard Time)
Location: Virtual (Atlanta, GA, USA)
Link: Container Computing for HPC and Scientific Workflows @ SC20
Prerequisites
This is a hands-on tutorial. Participants should bring a laptop and load or pre-install a terminal and/or ssh client in advance to make best use of time during the tutorial.
See also the Setup page.
Questions
You can ask questions verbally or with this Google Doc. Please append your question below the others in the document.
We have also created a Slack Team for this. The invitation link is here.
Schedule
| Setup | ||
| 00:00 | 1. Introduction to containers in HPC |
What is a container and how is it different from a virtual machine?
What are some of the benefits of containers and how can containers help me do my job better? |
| 00:15 | 2. Build and run your first Docker container |
How can I use Docker to run a container?
How do I create an image from scratch? How can I share an image between systems? |
| 00:55 | 3. Deploy containers on a supercomputer |
How can I execute commands in a container with Singularity or Shifter?
How are variables and directories shared between host and container? |
| 01:30 | 4. High performance containers |
How can I run an MPI enabled application in a container using a bind approach?
How can I run a GPU enabled application in a container? |
| 01:55 | 5. Best practices |
Are there any practices I should avoid?
Are there practices I should try to follow? How can I keep my images small? How can I speed up iterative updates and testing? |
| 02:15 | 6. E4S containers initiative |
How can I use the E4S full featured containers?
What packages can I load using Spack? How can I compile and test an MPI application? |
| 02:35 | 7. Advanced container builds |
How can I build better container images?
How can I build more reproducible images? How can I build more performant images? |
| 02:55 | 8. Wrap-up and final Q&A | Any final questions |
| 03:00 | Finish |
The actual schedule may vary slightly depending on the topics and exercises chosen by the instructor.