从 InfluxDB 到 TSDB 数据迁移

by BenedictJin 5 years ago

macOS ◆ xterm-256color ◆ zsh 3706 views

# 首先，检查 InfluxDB 和 TSDB 是否正常运行
curl -sL -I localhost:8086/ping | grep -i version
curl http://localhost:8242/api/version

# 确认版本是否支持
# InfluxDB 只保证 0.9 及以上版本是兼容的
# TSDB 只保证 2.4.x 及以上版本是兼容的

# 下载
cd /tmp/datax
wget https://tsdbtools.oss-cn-hangzhou.aliyuncs.com/datax_influxdb_2_tsdb.tar.gz
tar zxvf datax_influxdb_2_tsdb.tar.gz

# 配置任务
cd /tmp/datax
cp datax/job/job.json influxdb2tsdb.json
{
  "job": {
    "content": [
      {
        "reader": {
          "name": "influxdbreader",
          "parameter": {
            "endpoint": "http://localhost:8086",
            "database": "yuzhouwan",
            "username": "root",
            "password": "root",
            "column": [
              "blog"
            ],
            "beginDateTime": "2019-05-15T17:00:00Z",
            "endDateTime": "2019-05-15T18:00:00Z"
          }
        },
        "writer": {
          "name": "tsdbwriter",
          "parameter": {
            "endpoint": "http://localhost:8242"
          }
        }
      }
    ],
    "setting": {
      "speed": {
        "channel": 1
      }
    }
  }
}

# 启动之前，确认 InfluxDB 存在数据，而 TSDB 不存在数据
# InfluxDB
influx -host 'localhost' -port '8086'
> use yuzhouwan;
> SELECT * FROM blog WHERE time > '2019-05-15T09:00:00Z' AND time < '2019-05-15T10:00:00Z'

# TSDB
curl -X POST -H "Content-Type: application/json " localhost:8242/api/query -d '{"start":1557849600,"end":1557936000,"queries":[{"aggregator":"count","metric":"blog"}]}'




# 通过 datax.py 脚本启动任务
python datax/bin/datax.py mysql2tsdb.json
# 任务已完成
# 现在，我们来检查是否写入成功
# InfluxDB
influx -host 'localhost' -port '8086'
> use yuzhouwan;
> SELECT * FROM blog WHERE time > '2019-05-15T09:00:00Z' AND time < '2019-05-15T10:00:00Z'

# TSDB
curl -X POST -H "Content-Type: application/json " localhost:8242/api/query -d '{"start":1557849600,"end":1557936000,"queries":[{"aggregator":"count","metric":"blog"}]}'


# 恭喜！
# 数据已成功迁移！

More by BenedictJin

宇宙湾 00:20

by BenedictJin 5 years ago

从 OpenTSDB 到 TSDB 数据迁移 08:18

by BenedictJin 5 years ago

从 Prometheus 到 TSDB 数据迁移 08:08

by BenedictJin 5 years ago

数据迁移 Quick Start 04:48

by BenedictJin 5 years ago

See all

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 247699.cast

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/247699.cast',
      document.getElementById('player'),
      { cols: 178, rows: 48 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't offer GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed run the following command to create GIF file:

agg https://asciinema.org/a/247699 247699.gif

Or, if you already downloaded the recording file:

agg 247699.cast 247699.gif

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.