Commit Graph

45 Commits

Author SHA1 Message Date
Jake Howard
d52f0bc8b2 Remove gitlab configuration 2023-03-30 22:56:35 +01:00
Jake Howard
2f3958b3e6 Reduce speedtest interval
I don't need it to run that often
2023-02-28 08:40:26 +00:00
Jake Howard
11eb833f44 Add some prometheus alerts 2023-02-19 18:31:52 +00:00
Jake Howard
f2f9e194c5 Install node-exporter on pi-hole 2023-01-31 23:10:31 +00:00
Jake Howard
e4fba8208e Add speedtest exporter 2023-01-31 21:45:59 +00:00
Jake Howard
051b5b0e19 Add ICMP checks 2023-01-31 14:29:27 +00:00
Jake Howard
ddc91059b5 Replace telegraf with prometheus exporters
Still missing SMART and ping, but those can come later.

Swapped as the polling model for prometheus doesn't play especially well with telegraf, and leads to gaps in data
2023-01-31 09:11:09 +00:00
Jake Howard
e86ed81102 Decommission decker server
It's been replaced by prometheus running internally, and uptimerobot checking.
2022-12-09 19:04:54 +00:00
Jake Howard
f1c9e10d9a Use IPv4 on blackbox
The docker networks they're running on are v4 only at the moment, so the DNS resolution passes by the connection fails.
2022-12-06 20:46:43 +00:00
Jake Howard
bb4361e25f Use a blackbox with custom DNS rather than proxy
This makes timing information more relevant and should improve reliability
2022-12-06 10:04:23 +00:00
Jake Howard
772cf7536a Run prometheus stack as docker user 2022-12-05 21:17:23 +00:00
Jake Howard
53c969f2b8 Make prometheus config files read only 2022-12-05 21:12:55 +00:00
Jake Howard
3e5b00d176 Add alertmanager 2022-12-05 21:10:41 +00:00
Jake Howard
60514d191a Exclude python stats for HA 2022-12-05 20:36:57 +00:00
Jake Howard
ed7faf4678 Scrape healthchecks.io with prometheus and use it for outbound monitoring of prometheus scrapes 2022-12-05 14:41:48 +00:00
Jake Howard
8e3b381b8d Remove unused prometheus network 2022-12-04 22:12:55 +00:00
Jake Howard
75862dbaf9 Setup blackbox for some HTTP monitoring 2022-12-04 22:11:49 +00:00
Jake Howard
ebfe057658 Add support for public dashboards in Grafana 2022-12-01 13:48:36 +00:00
Jake Howard
4f0ee78b7e Update grafana to use mailgun 2022-09-18 15:27:58 +01:00
Jake Howard
c7d5056f2a Scrape homeassistant metrics into prometheus 2022-09-06 21:29:11 +01:00
Jake Howard
8b21b9e6f2 Monitor decker Traefik with prometheus 2022-08-14 15:04:55 +01:00
Jake Howard
c54ce7b209 For migrate grafana plugins 2022-06-13 21:52:40 +01:00
Jake Howard
c5215e330b Update yamllint to fix dependency issue
I think this still validates everything we need it to
2022-01-11 20:51:12 +00:00
Jake Howard
da41fcd7bc Update grafana DB to postgres 14 2021-12-22 13:10:06 +00:00
Jake Howard
edc5c325b7 Correctly check hostname against PVE hosts
Some of the hostnames have `-` in instead, which caused issues with the SSH config detecting which users to allow
2021-08-23 19:56:04 +01:00
Jake Howard
3c3f69a776 Remove unnecessary influxdb instance
Never used it anyway
2021-06-03 20:50:54 +01:00
Jake Howard
d59e86a8e8 Remove unnecessary private_ip var from forrest
It was redundant
2021-06-03 20:47:33 +01:00
Jake Howard
f1f2c620b0 Replace DHCP on PVE for static IPs
So much easier to deal with!
2021-06-03 20:47:08 +01:00
Jake Howard
407e59ec5a Use variables in prometheus config
Also replace grimes with walker
2021-05-05 18:12:42 +01:00
Jake Howard
1c424cb2ef Update some IP addresses
I really need to stop using these external addresses somewhen...
2021-04-07 22:11:24 +01:00
Jake Howard
1d997d3c33 Remove separate private and protected IP 2021-03-27 18:42:06 +00:00
Jake Howard
6b95b75fc2 Move telegraf to host
This makes metric collection for SMART much simpler. I'll still be using the prometheus node exporter for actual system metrics, though.
2021-03-05 20:39:11 +00:00
Jake Howard
89dbbc71e5 Move files into application directories 2021-03-05 14:40:17 +00:00
Jake Howard
8e977edba1 Ignore go metrics 2021-03-05 14:27:33 +00:00
Jake Howard
b264e5cbcc Monitor traefik with prometheus rather than influxdb 2021-03-04 16:37:53 +00:00
Jake Howard
2e05ed08fa Use hostname rather than fqdn 2021-03-04 16:06:43 +00:00
Jake Howard
aba81f79bc Add telegraf
And input to ping and output via prometheus
2021-03-04 15:16:54 +00:00
Jake Howard
914676d209 Add prometheus for metrics 2021-03-04 14:53:03 +00:00
Jake Howard
fe2450d43b Add grafana docker network and restrict port binds 2021-03-04 14:39:40 +00:00
Jake Howard
b3a72eb8f1 Add influxdb server for metrics 2021-02-14 16:24:45 +00:00
Jake Howard
ec0c78e6d9 Read emails from secrets 2021-02-14 12:29:14 +00:00
Jake Howard
872471ef52 Setup email for grafana 2021-02-14 12:19:51 +00:00
Jake Howard
d8f2a83dfe Move grafana data back to pool 2021-02-14 11:33:46 +00:00
Jake Howard
47df8164fa Define timezone as variable 2021-02-10 09:12:42 +00:00
Jake Howard
149d01165f Restore dockerized grafana setup
It's stil on a separate machine, but in docker to allow more applications to be run easier and tied together.
2021-02-09 09:16:52 +00:00