Running Dual ComfyUIs on a Tesla K80 via PCI-e Passthrough to virt-manager

by KeithHanson 2 years ago

GNU/Linux • xterm-kitty • bash 1085 views

This is showing me SSH into my gaming rig.

This PC has an Nvidia 1660 Super in it - while a great budget card, it uses drivers that are incompatible with the Tesla K80 (also a great budget card for ai work). That incompatibility forced me to either have drivers for the K80 or modern drivers for the 1660 Super.

I decided to pass through the PCI-e port to a KVM/QEMU VM via virt-manager.

The Tesla K80 has TWO 12 GB cards packed into a single card - it is bananas. But, it lets you run ComfyUI instance #1 on one internal card, and instance #2 on another, which has some interesting possibilities.

This session was the first time I was able to run both full-tilt now that I have proper cooling in place.

More recordings by KeithHanson

MineTheFutr.com 5:17

by KeithHanson 2 years ago

ComfyUI-Magic - Sponsored by MineTheFUTR.com 0:36

by KeithHanson 2 years ago

simple-comfy-container 0:42

by KeithHanson 2 years ago

untitled 0:17

by KeithHanson 2 years ago

https://asciinema.org/a/616701

Copied!

Append ?t=30 to start the playback at 30s, ?t=3:20 to start the playback at 3m 20s.

See sharing docs for more link customization options.

Embed as image link

Use snippets below to display a preview image linking to this recording.
Ideal for places where scripts are not allowed, such as project README files.

HTML:

<a href="https://asciinema.org/a/616701" target="_blank"><img src="https://asciinema.org/a/616701.svg" /></a>

Copied!

Markdown:

[![asciicast](https://asciinema.org/a/616701.svg)](https://asciinema.org/a/616701)

Copied!

Embed the player

If you're embedding on your own page or on a site which permits script tags, you can use the full player widget:

<script src="https://asciinema.org/a/616701.js" id="asciicast-616701" async="true"></script>

Copied!

Paste the above script tag where you want the player to be displayed on your page.

See embedding docs for more player customization options.

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 616701.cast

Copied!

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="/assets/asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="/assets/asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/616701.cast',
      document.getElementById('player'),
      { cols: 124, rows: 80 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't provide GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed, generate a GIF with the following command:

agg https://asciinema.org/a/616701 demo.gif

Copied!

Or, if you already downloaded the recording file:

agg demo.cast demo.gif

Copied!

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.