Migrating from MongoDB to TokuMX

by leifwalsh 11 years ago

GNU/Linux ◆ rxvt-unicode-256color ◆ zsh 2334 views

TokuMX is a replacement for MongoDB that changes all the storage code for better performance, concurrency, and compression. Because the data format is different than in MongoDB, migration requires a full dump-and-reload, and because the replication format is different, it can be hard to migrate a live production system.

In TokuMX 1.0.3, we are introducing a tool to make this process easier. It replays a vanilla MongoDB replication oplog on TokuMX. This makes the migration process much simpler, more seamless, and it can be done with next to no downtime.

This asciicast is an executable presentation. You can see the org file I walk through and my python script “application” at leifwalsh/tokumx-migration-demo. You can clone this repo, read the presentation, and follow along as you walk through the process yourself, in a terminal or using Babel.

More by leifwalsh

untitled 00:50

by leifwalsh 11 years ago

See all

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 4285.cast

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/4285.cast',
      document.getElementById('player'),
      { cols: 128, rows: 60 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't provide GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed, generate a GIF with the following command:

agg https://asciinema.org/a/4285 demo.gif

Or, if you already downloaded the recording file:

agg demo.cast demo.gif

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.