Project

General

Profile

Actions

Task #7191

closed
NS AB

Setup time servers and monitor time differences

Task #7191: Setup time servers and monitor time differences

Added by Nico Schottelius over 6 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Low
Assignee:
Target version:
-
Start date:
09/30/2019
Due date:
% Done:

0%

Estimated time:
PM Check date:

Description

  • Setup ntpd on black* and red*
  • Configure hosts to synchronise clock with the local time servers
  • Raise an alert if time is > 10 second different to the average of the time servers
    • node_time_seconds in promtheus

AB Updated by Ahmed Bilal over 6 years ago Actions #1

  • Status changed from New to Seen

AB Updated by Ahmed Bilal over 6 years ago Actions #2

  • Assignee changed from Ahmed Bilal to Nico Schottelius

What is red* and black*?

Can I add their time difference monitoring at https://monitoring.place11.ungleich.ch

NS Updated by Nico Schottelius over 6 years ago Actions #3

Ah - the time difference should probably better monitored on
monitoring1.place{5,6}, not on monitoring.place11.

monitoring.place11 should be mainly configured as "monitoring us from
outside".

writes:

AB Updated by Ahmed Bilal over 6 years ago Actions #4

  • Assignee changed from Nico Schottelius to Ahmed Bilal

AB Updated by Ahmed Bilal over 6 years ago Actions #5

Install ntp

apt install ntp
service ntp start

To enable, ntp collector run the following command on targets only if the file is not all commented out.

cat > /etc/default/prometheus-node-exporter << EOF
ARGS="--collector.ntp --collector.ntp.server ::1"
EOF

service prometheus-node-exporter restart

AB Updated by Ahmed Bilal over 6 years ago Actions #6

I think that the prometheus query node_ntp_offset would be the one we needed. For more details, please look https://github.com/prometheus/node_exporter/blob/master/docs/TIME.md.

AB Updated by Ahmed Bilal over 6 years ago Actions #7

  • Assignee changed from Ahmed Bilal to ll nu

Please verify whether the alerts are correct according to above mentioned criteria https://monitoring.place6.ungleich.ch/d/D4dhTzgik/ceph-cluster?orgId=1&panelId=59&fullscreen&edit&tab=alert

AB Updated by Ahmed Bilal over 6 years ago Actions #8

  • Assignee changed from ll nu to Ahmed Bilal

NS Updated by Nico Schottelius over 4 years ago Actions #9

  • Status changed from Seen to Closed
Actions

Also available in: PDF Atom