vLLM Production Stack Semantic Cache Feature Demo

Link

Append ?t=30 to start the playback at 30s, ?t=3:20 to start the playback at 3m 20s.

Embed image link

Use snippets below to display a screenshot linking to this recording.
Useful in places where scripts are not allowed (e.g. in a project's README file).

HTML:

Markdown:

Embed the player

If you're embedding on your own page or on a site which permits script tags, you can use the full player widget:

Paste the above script tag where you want the player to be displayed on your page.

See embedding docs for additional options.

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 705982.cast

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/705982.cast',
      document.getElementById('player'),
      { cols: 212, rows: 55 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't provide GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed, generate a GIF with the following command:

agg https://asciinema.org/a/705982 demo.gif

Or, if you already downloaded the recording file:

agg demo.cast demo.gif

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.

vLLM Production Stack Semantic Cache Feature Demo

More by rootfs

microshift on jetson xavier 01:38

ONES21 FL demo 04:07

kepler ebpf latency compare between 0.7.8 and latest with ringbuffer change 01:34

PII Detection Experimental Feature for vLLM Production Stack 01:59