Host health from the Linux agent, agent self-update, and disk forecast in /metrics
- Linux agent v4: failed systemd services, SMART disk health, ZFS pool state, pacman updates; SMART/ZFS and self-update run in the ExecStartPre=-+ step outside the sandbox - Server: hosts' health stored (servers.host_health, migration 0029), alerts under a new "Failing services" kind plus disk/ZFS alerts, Host health card, Prometheus series - Agent self-update (Linux v4, Windows v3): admin switch on the Servers page, checksum-verified download, atomic replace; GET /api/agent/report/update - homelab_server_disk_days_to_full in /metrics - Tests (server, real PowerShell against a fake server) and docs Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
540ab704b7
commit
5dc6cea69c
38 files changed
+3884
-73
No files matched your search
@@ -49,6 +49,12 @@ All gauges. Labels are escaped as Prometheus requires.
|
||||
| `homelab_server_pending_security_updates` | `server` | Of those, the security fixes, when the package manager can say. |
|
||||
| `homelab_server_reboot_required` | `server` | 1 if a restart is due. |
|
||||
| `homelab_server_agent_outdated` | `server` | 1 if the agent is older than the one this installation would install now. |
|
||||
| `homelab_server_failed_units` | `server` | Services (systemd units) that have failed, when a Linux agent reports them. |
|
||||
| `homelab_server_disk_healthy` | `server`, `device` | 1 if the disk's own SMART self-assessment passes, 0 if it fails. |
|
||||
| `homelab_server_disk_wear_percent` | `server`, `device` | How much of an SSD's rated life is used, where the disk says. |
|
||||
| `homelab_server_disk_temperature_celsius` | `server`, `device` | A disk's temperature. |
|
||||
| `homelab_server_zfs_pool_online` | `server`, `pool` | 1 if a ZFS pool is ONLINE, 0 in any other state. |
|
||||
| `homelab_server_disk_days_to_full` | `server`, `mount` | Days until the disk is full at its present rate of filling; only for disks with a steady climb over the last days (left out for the rest). |
|
||||
| `homelab_alerts` | `severity` | Active alerts: `critical`, `warning`, `info` (not counting silenced ones). |
|
||||
| `homelab_alerts_silenced` | | Alerts held back by a maintenance window. |
|
||||
| `homelab_alerts_grouped` | | Alerts folded under a server that is down. |
|
||||
@@ -60,7 +66,7 @@ All gauges. Labels are escaped as Prometheus requires.
|
||||
| `homelab_scrape_timestamp_seconds` | | When the answer was built. |
|
||||
|
||||
Some alerting ideas: `homelab_server_up == 0`, `homelab_server_disk_used_percent > 90`,
|
||||
`homelab_secret_expiry_days < 14`, `homelab_alerts{severity="critical"} > 0`.
|
||||
`homelab_secret_expiry_days < 14`, `homelab_server_disk_days_to_full < 7`, `homelab_alerts{severity="critical"} > 0`.
|
||||
|
||||
## Event webhooks
|
||||
|
||||
|
||||
Reference in new issue
Block a user