从 OpenTSDB 到 TSDB 数据迁移

by BenedictJin 5 years ago

macOS ◆ xterm-256color ◆ zsh 5713 views

# 首先，检查 OpenTSDB 和 TSDB 是否正常运行
curl http://localhost:4242/api/version
curl http://localhost:8242/api/version

# 确认版本是否支持
# OpenTSDB 只保证 2.3.x 是兼容的
# TSDB 只保证 2.4.x 及以上版本是兼容的

# 配置任务
cd /tmp/datax
cp datax/job/job.json opentsdb2tsdb.json

{
  "job": {
    "content": [
      {
        "reader": {
          "name": "opentsdbreader",
          "parameter": {
            "endpoint": "http://localhost:4242",
            "column": [
              "m"
            ],
            "beginDateTime": "2019-01-01 00:00:00",
            "endDateTime": "2019-01-01 01:00:00"
          }
        },
        "writer": {
          "name": "tsdbwriter",
          "parameter": {
            "endpoint": "http://localhost:8242"
          }
        }
      }
    ],
    "setting": {
      "speed": {
        "channel": 1
      }
    }
  }
}

# 启动之前，确认 OpenTSDB 存在数据，而 TSDB 不存在数据
# OpenTSDB
time curl -X POST -H "Content-Type: application/json " localhost:4242/api/query -d '{"start":1546272000,"end":1546272300,"queries":[{"aggregator":"count","metric":"m","tags":{"ip":"i1"}}]}'

# TSDB
time curl -X POST -H "Content-Type: application/json " localhost:8242/api/query -d '{"start":1546272000,"end":1546272300,"queries":[{"aggregator":"count","metric":"m","tags":{"ip":"i1"}}]}'



# 通过 datax.py 脚本启动任务
python datax/bin/datax.py opentsdb2tsdb.json
# 任务已完成
# 现在，我们来检查是否写入成功
# OpenTSDB
time curl -X POST -H "Content-Type: application/json " localhost:4242/api/query -d '{"start":1546272000,"end":1546272300,"queries":[{"aggregator":"count","metric":"m","tags":{"ip":"i1"}}]}'

# TSDB
time curl -X POST -H "Content-Type: application/json " localhost:8242/api/query -d '{"start":1546272000,"end":1546272300,"queries":[{"aggregator":"count","metric":"m","tags":{"ip":"i1"}}]}'

# 恭喜！
# 数据已成功迁移！

More by BenedictJin

从 Prometheus 到 TSDB 数据迁移 08:08

by BenedictJin 5 years ago

宇宙湾 00:20

by BenedictJin 5 years ago

从 InfluxDB 到 TSDB 数据迁移 09:10

by BenedictJin 5 years ago

数据迁移 Quick Start 04:48

by BenedictJin 5 years ago

See all

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 246856.cast

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/246856.cast',
      document.getElementById('player'),
      { cols: 178, rows: 48 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't provide GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed, generate a GIF with the following command:

agg https://asciinema.org/a/246856 demo.gif

Or, if you already downloaded the recording file:

agg demo.cast demo.gif

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.