Alerting and monitoring system

Existing systems

• #monitoring-unms/UISP
  
• Grafana/Prometheus
  • public, setup 4 years ago: https://stats.nycmesh.net
  • Mesh only, Omni's etc: http://10.70.90.82:3000/dashboards
• support report generator

Requirements

• Must:
  • alert Slack team when key infrasture goes offline within 5 minutes
• Should:
  • be easy to update for new equipment
  • be easy to configure to notify new volunteers
  • be easy to deploy
  • be reliable
  • be configurable though a version controlled config to enable easy updates
  • be editable by multiple volunteers

Questions

• Major
  • What key metrics should we alert based on?
• Minor
  • frequency? ~1 point/hour

Proposed software

• Zabbix
• Nagios
• Grafana
• [add your suggestion here]

Log

• prompted by this Slack discussion on Grand St. outage