从 Prometheus 到 TSDB 数据迁移

by BenedictJin 4 years ago

macOS ◆ xterm-256color ◆ zsh 8894 views

# 首先，检查 Prometheus 和 TSDB 是否正常运行
./prometheus --version
curl http://localhost:8242/api/version

# 确认版本是否支持
# Prometheus 只保证 2.9.x 是兼容的
# TSDB 只保证 2.4.x 及以上版本是兼容的

# 配置任务
cd /tmp/datax
cp datax/job/job.json prometheus2tsdb.json

{
  "job": {
    "content": [
      {
        "reader": {
          "name": "prometheusreader",
          "parameter": {
            "endpoint": "http://localhost:9090",
            "column": [
              "up"
            ],
            "beginDateTime": "2019-05-20T16:00:00Z",
            "endDateTime": "2019-05-20T16:00:10Z"
          }
        },
        "writer": {
          "name": "tsdbwriter",
          "parameter": {
            "endpoint": "http://localhost:8242"
          }
        }
      }
    ],
    "setting": {
      "speed": {
        "channel": 1
      }
    }
  }
}

# 启动之前，确认 Prometheus 存在数据，而 TSDB 不存在数据
# Prometheus
curl -s 'http://localhost:9090/api/v1/query_range?query=up&start=2019-05-20T08:00:00.000Z&end=2019-05-20T08:00:10.000Z&step=1ms'

# TSDB
curl -X POST -H "Content-Type: application/json" localhost:8242/api/query -d '{"start":1558339200,"end":1558339210,"queries":[{"aggregator":"count","metric":"up"}]}'


# 通过 datax.py 脚本启动任务
python datax/bin/datax.py prometheus2tsdb.json
# 任务已完成
# 现在，我们来检查是否写入成功
# Prometheus
curl -s 'http://localhost:9090/api/v1/query_range?query=up&start=2019-05-20T07:15:00.000Z&end=2019-05-20T07:15:10.000Z&step=1ms'
# TSDB
curl -X POST -H "Content-Type: application/json" localhost:8242/api/query -d '{"start":1558307700,"end":1558307710,"queries":[{"aggregator":"count","metric":"up"}]}'

# 恭喜！
# 数据已成功迁移！

More by BenedictJin

数据迁移 Quick Start 04:48

by BenedictJin 4 years ago

宇宙湾 00:20

by BenedictJin 4 years ago

从 InfluxDB 到 TSDB 数据迁移 09:10

by BenedictJin 4 years ago

从 OpenTSDB 到 TSDB 数据迁移 08:18

by BenedictJin 4 years ago

See all

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 247290.cast

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/247290.cast',
      document.getElementById('player'),
      { cols: 178, rows: 48 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't offer GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed run the following command to create GIF file:

agg https://asciinema.org/a/247290 247290.gif

Or, if you already downloaded the recording file:

agg 247290.cast 247290.gif

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.