Running mpi4.py via SLURM

by akkornel 4 years ago

GNU/Linux ◆ xterm-256color ◆ bash 1913 views

This builds on the previous demo (https://asciinema.org/a/251773), but instead of running stand-alone, we run inside of a SLURM job. We ask for 23 MPI tasks, each of which needs only one core and 512 MB of RAM. We say that the job can complete within five minutes. Finally, we ask for at least three nodes, but we are OK with 23 (in other words, having one task run on each of 23 nodes) if that will get the job done faster.

The Python code lives on shared storage, and SLURM does the work of allocating nodes and running jobs.

The code used in this example is the exact same code that was used in the previous examples. No changes were required to make the code work within SLURM.

The code demonstrated in this asciicast is available here: https://github.com/akkornel/mpi4py

More by akkornel

Shrinking a Singularity container image 01:15

by akkornel 7 years ago

Bootstrapping CentOS without yum 00:43

by akkornel 7 years ago

Building Singularity from Scratch, with Dependencies 03:40

by akkornel 7 years ago

Making a simple CentOS Container, on Ubuntu 02:37

by akkornel 7 years ago

See all

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 251795.cast

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/251795.cast',
      document.getElementById('player'),
      { cols: 80, rows: 25 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't offer GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed run the following command to create GIF file:

agg https://asciinema.org/a/251795 251795.gif

Or, if you already downloaded the recording file:

agg 251795.cast 251795.gif

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.