delete large cloud account benchmark

by infinitewarp 2 years ago

macOS ◆ xterm-256color ◆ zsh 1000 views

Important notes:

The celery worker’s output is piped through 2>&1 | tee /tmp/delete-1.txt | grep -v basegenericmodel_post_delete_callback meaning the output you see here does not include basegenericmodel_post_delete_callback messages. This was done because there are 200 MB worth of those messages!
This was recorded with asciinema rec -i3. Even though this recording is only 1.5 minutes long, there’s an unseen gap of about 8 minutes while processing.
Outside of this recording, I ran the same process a second time but with --multiprocess instead of --include-children on the mprof command.

Full unfiltered output of the celery worker:

delete-1.txt.gz for the first run in this recording
delete-2.txt.gz for the second run outside this recording

Graphs of the memory profile:

More by infinitewarp

unexpected sources-api relationship 01:11

by infinitewarp 3 years ago

koku s3 data export to customer bucket demo 04:02

by infinitewarp 4 years ago

perf testing ubi8 a63b3b0a (just before first uib9 update) 11:09

by infinitewarp 1 year ago

629-rhel-tag 00:34

by infinitewarp 4 years ago

See all

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 429896.cast

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/429896.cast',
      document.getElementById('player'),
      { cols: 152, rows: 47 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't offer GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed run the following command to create GIF file:

agg https://asciinema.org/a/429896 429896.gif

Or, if you already downloaded the recording file:

agg 429896.cast 429896.gif

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.