Estate status — lab

generated 2026-09-14T15:45:53Z · refreshes every 5 minutes

187ok
2broken
0off
0undeclared
2attention
9alerts

ArgoCD applications

statenamewherekinddetail
attentionbf-argocdinfraapplicationsync=OutOfSync health=Healthy
okbf-buzzedaapplicationsync=Synced health=Healthy
okbf-cloudflaredinfraapplicationsync=Synced health=Healthy
okbf-esoinfraapplicationsync=Synced health=Healthy
okbf-excalidashworkspaceapplicationsync=Synced health=Healthy
okbf-external-serviceedaapplicationsync=Synced health=Healthy
attentionbf-hulyworkspaceapplicationsync=OutOfSync health=Progressing
okbf-kasm-workspacesedaapplicationsync=Synced health=Healthy
okbf-kube-prometheus-stackinfraapplicationsync=Synced health=Healthy
okbf-n8nn8napplicationsync=Synced health=Healthy
okbf-neutronneutronapplicationsync=Synced health=Healthy
okbf-obsidian-vaultedaapplicationsync=Synced health=Healthy
okbf-openbaosecretsapplicationsync=Synced health=Healthy
okbf-pgadmindatabaseapplicationsync=Synced health=Healthy
okbf-postgresdatabaseapplicationsync=Synced health=Healthy
okbf-postgres-backupdatabaseapplicationsync=Synced health=Healthy
okbf-redisdatabaseapplicationsync=Synced health=Healthy
okbf-reloaderinfraapplicationsync=Synced health=Healthy
okbf-searxngedaapplicationsync=Synced health=Healthy
okbf-syncthingedaapplicationsync=Synced health=Healthy
okbf-traefikinfraapplicationsync=Synced health=Healthy
okdeepbrain-cloudflaredhttps://10.99.0.32:6443/infraapplicationsync=Synced health=Healthy
okdeepbrain-esohttps://10.99.0.32:6443/infraapplicationsync=Synced health=Healthy
okdeepbrain-n8nhttps://10.99.0.32:6443/n8napplicationsync=Synced health=Healthy
okdeepbrain-neutronhttps://10.99.0.32:6443/neutronapplicationsync=Synced health=Healthy
okdeepbrain-postgreshttps://10.99.0.32:6443/databaseapplicationsync=Synced health=Healthy
okdeepbrain-postgres-backuphttps://10.99.0.32:6443/databaseapplicationsync=Synced health=Healthy
okdeepbrain-searxnghttps://10.99.0.32:6443/edaapplicationsync=Synced health=Healthy
okdeepbrain-traefikhttps://10.99.0.32:6443/infraapplicationsync=Synced health=Healthy
okmark-cloudflaredhttps://10.99.0.33:6443/infraapplicationsync=Synced health=Healthy
okmark-esohttps://10.99.0.33:6443/infraapplicationsync=Synced health=Healthy
okmark-n8nhttps://10.99.0.33:6443/n8napplicationsync=Synced health=Healthy
okmark-neutronhttps://10.99.0.33:6443/neutronapplicationsync=Synced health=Healthy
okmark-postgreshttps://10.99.0.33:6443/databaseapplicationsync=Synced health=Healthy
okmark-postgres-backuphttps://10.99.0.33:6443/databaseapplicationsync=Synced health=Healthy
okmark-searxnghttps://10.99.0.33:6443/edaapplicationsync=Synced health=Healthy
okmark-traefikhttps://10.99.0.33:6443/infraapplicationsync=Synced health=Healthy

Cluster workloads

statenamewherekinddetail
okpostgresdeepbrain-k3s/databasestatefulset1/1 ready
oksearxngdeepbrain-k3s/edadeployment1/1 ready
okcloudflareddeepbrain-k3s/infradeployment2/2 ready
okeso-external-secretsdeepbrain-k3s/infradeployment1/1 ready
okeso-external-secrets-cert-controllerdeepbrain-k3s/infradeployment1/1 ready
okeso-external-secrets-webhookdeepbrain-k3s/infradeployment1/1 ready
oktraefikdeepbrain-k3s/infradeployment1/1 ready
okcorednsdeepbrain-k3s/kube-systemdeployment1/1 ready
oklocal-path-provisionerdeepbrain-k3s/kube-systemdeployment1/1 ready
okmetrics-serverdeepbrain-k3s/kube-systemdeployment1/1 ready
oksvclb-traefik-53bf826cdeepbrain-k3s/kube-systemdaemonset1/1 ready
okn8n-maindeepbrain-k3s/n8ndeployment1/1 ready
okn8n-redisdeepbrain-k3s/n8nstatefulset1/1 ready
okn8n-workerdeepbrain-k3s/n8ndeployment1/1 ready
okdeepbraindeepbrain-k3s/neutrondeployment1/1 ready
okdeepbrain-codex-gatewaydeepbrain-k3s/neutrondeployment1/1 ready
okpgadmineda-k3s/databasedeployment1/1 ready
okpostgreseda-k3s/databasestatefulset1/1 ready
okrediseda-k3s/databasestatefulset1/1 ready
okbuzz-object-storeeda-k3s/edadeployment1/1 ready
okbuzz-relayeda-k3s/edadeployment1/1 ready
okobsidian-vaulteda-k3s/edadeployment1/1 ready
oksearxngeda-k3s/edadeployment1/1 ready
oksyncthingeda-k3s/edastatefulset1/1 ready
okalertmanager-kps-alertmanagereda-k3s/infrastatefulset1/1 ready
okargocd-application-controllereda-k3s/infrastatefulset1/1 ready
okargocd-applicationset-controllereda-k3s/infradeployment1/1 ready
okargocd-notifications-controllereda-k3s/infradeployment1/1 ready
okargocd-rediseda-k3s/infradeployment1/1 ready
okargocd-repo-servereda-k3s/infradeployment1/1 ready
okargocd-servereda-k3s/infradeployment1/1 ready
okcloudflarededa-k3s/infradeployment2/2 ready
okeso-external-secretseda-k3s/infradeployment1/1 ready
okeso-external-secrets-cert-controllereda-k3s/infradeployment1/1 ready
okeso-external-secrets-webhookeda-k3s/infradeployment1/1 ready
okgrafanaeda-k3s/infradeployment1/1 ready
okkps-operatoreda-k3s/infradeployment1/1 ready
okkube-prometheus-stack-kube-state-metricseda-k3s/infradeployment1/1 ready
okkube-prometheus-stack-prometheus-node-exportereda-k3s/infradaemonset1/1 ready
okprometheus-kps-prometheuseda-k3s/infrastatefulset1/1 ready
okreloader-reloadereda-k3s/infradeployment1/1 ready
oktraefikeda-k3s/infradeployment1/1 ready
okcorednseda-k3s/kube-systemdeployment1/1 ready
oklocal-path-provisionereda-k3s/kube-systemdeployment1/1 ready
okmetrics-servereda-k3s/kube-systemdeployment1/1 ready
oksvclb-traefik-852b913deda-k3s/kube-systemdaemonset1/1 ready
okn8n-maineda-k3s/n8ndeployment1/1 ready
okn8n-model-gatewayeda-k3s/n8ndeployment1/1 ready
okn8n-rediseda-k3s/n8nstatefulset1/1 ready
okn8n-workereda-k3s/n8ndeployment1/1 ready
okagentedaeda-k3s/neutrondeployment1/1 ready
okagenteda-codex-gatewayeda-k3s/neutrondeployment1/1 ready
okcomputer-486e90dc-ad02-4e22-beda-b2e72f9ac275eda-k3s/neutrondeployment1/1 ready
okcomputer-764db853-dbaa-42b6-ba24-c8e461fe0efdeda-k3s/neutrondeployment1/1 ready
okcomputer-a99abd17-3eb7-4431-926e-2300719abd62eda-k3s/neutrondeployment1/1 ready
okcomputer-b0ea8720-ef49-4e79-8ea8-5aae4f0654a8eda-k3s/neutrondeployment1/1 ready
okcomputer-f7f65bab-2e46-427f-a02d-d928bf03d3f4eda-k3s/neutrondeployment1/1 ready
okneutroncoreeda-k3s/neutrondeployment1/1 ready
okneutroncore-codex-gatewayeda-k3s/neutrondeployment1/1 ready
okvpn-egress-coreeda-k3s/neutrondeployment1/1 ready
okaccounteda-k3s/workspacedeployment1/1 ready
okcollaboratoreda-k3s/workspacedeployment1/1 ready
okelasticeda-k3s/workspacedeployment1/1 ready
okexcalidash-backendeda-k3s/workspacedeployment1/1 ready
okexcalidash-frontendeda-k3s/workspacedeployment1/1 ready
okfronteda-k3s/workspacedeployment1/1 ready
okfulltexteda-k3s/workspacedeployment1/1 ready
okkvseda-k3s/workspacedeployment1/1 ready
okminioeda-k3s/workspacedeployment1/1 ready
okredpandaeda-k3s/workspacedeployment1/1 ready
okrekonieda-k3s/workspacedeployment1/1 ready
okstatseda-k3s/workspacedeployment1/1 ready
oktransactoreda-k3s/workspacedeployment1/1 ready
okworkspaceeda-k3s/workspacedeployment1/1 ready
okpostgresmark-k3s/databasestatefulset1/1 ready
oksearxngmark-k3s/edadeployment1/1 ready
okcloudflaredmark-k3s/infradeployment2/2 ready
okeso-external-secretsmark-k3s/infradeployment1/1 ready
okeso-external-secrets-cert-controllermark-k3s/infradeployment1/1 ready
okeso-external-secrets-webhookmark-k3s/infradeployment1/1 ready
oktraefikmark-k3s/infradeployment1/1 ready
okcorednsmark-k3s/kube-systemdeployment1/1 ready
oklocal-path-provisionermark-k3s/kube-systemdeployment1/1 ready
okmetrics-servermark-k3s/kube-systemdeployment1/1 ready
oksvclb-traefik-5c6fb6f3mark-k3s/kube-systemdaemonset1/1 ready
okn8n-mainmark-k3s/n8ndeployment1/1 ready
okn8n-redismark-k3s/n8nstatefulset1/1 ready
okn8n-workermark-k3s/n8ndeployment1/1 ready
okmarkmark-k3s/neutrondeployment1/1 ready
okmark-codex-gatewaymark-k3s/neutrondeployment1/1 ready

Host units

statenamewherekinddetail
okagentkit-update.servicelab (agentkit-update.timer)timerlast result success
okapt-daily-upgrade.servicelab (apt-daily-upgrade.timer)timerlast result success
okapt-daily.servicelab (apt-daily.timer)timerlast result success
okbizfoundry-host-cleanup.servicelab (bizfoundry-host-cleanup.timer)timerlast result success
okdpkg-db-backup.servicelab (dpkg-db-backup.timer)timerlast result success
oke2scrub_all.servicelab (e2scrub_all.timer)timerlast result success
okeda-k3s-deadman.servicelab (eda-k3s-deadman.timer)timerlast result success
okeda-kubernetes-observer.servicelab (eda-kubernetes-observer.timer)timerlast result success
okestate-heartbeat.servicelab (estate-heartbeat.timer)timerlast result success
okestate-status.servicelab (estate-status.timer)timerlast result success
okfstrim.servicelab (fstrim.timer)timerlast result success
oklab-backup-check.servicelab (lab-backup-check.timer)timerlast result success
oklab-backup-restore-test.servicelab (lab-backup-restore-test.timer)timerlast result success
oklab-backup.servicelab (lab-backup.timer)timerlast result success
oklab-box-backup-check.servicelab (lab-box-backup-check.timer)timerlast result success
oklab-box-backup-restore-test.servicelab (lab-box-backup-restore-test.timer)timerlast result success
oklab-box-backup.servicelab (lab-box-backup.timer)timerlast result success
oklogrotate.servicelab (logrotate.timer)timerlast result success
okman-db.servicelab (man-db.timer)timerlast result success
okmdcheck_start.servicelab (mdcheck_start.timer)timerlast result success
okmdmonitor-oneshot.servicelab (mdmonitor-oneshot.timer)timerlast result success
okmotd-news.servicelab (motd-news.timer)timerlast result success
okpmie_check.servicelab (pmie_check.timer)timerlast result success
okpmie_daily.servicelab (pmie_daily.timer)timerlast result success
okpmie_farm_check.servicelab (pmie_farm_check.timer)timerlast result success
okpmlogger_check.servicelab (pmlogger_check.timer)timerlast result success
okpmlogger_daily.servicelab (pmlogger_daily.timer)timerlast result success
okpmlogger_farm_check.servicelab (pmlogger_farm_check.timer)timerlast result success
oksystemd-tmpfiles-clean.servicelab (systemd-tmpfiles-clean.timer)timerlast result success

Host containers

statenamewherekinddetail
okagentxlabcontainerdeclared and running
okapexlabcontainerdeclared and running
okassay-runnerlabcontainerdeclared and running
okdeepbrain-k3slabcontainerdeclared and running
okeda-browser-fleetlabcontainerdeclared and running
okeda-claudelabcontainerdeclared and running
okeda-coderlabcontainerdeclared and running
okeda-edgelabcontainerdeclared and running
okeda-hermezlabcontainerdeclared and running
okeda-k3slabcontainerdeclared and running
okeda-kasmlabcontainerdeclared and running
okeda-n8n-sandboxlabcontainerdeclared and running
okeda-openbaolabcontainerdeclared and running
okeda-postgreslabcontainerdeclared and running
okgithub-runnerlabcontainerdeclared and running
okgitlab-runnerlabcontainerdeclared and running
okjeebon-devlabcontainerdeclared and running
okmark-k3slabcontainerdeclared and running
okn8n-image-builderlabcontainerdeclared and running
oktest-backuplabcontainerdeclared and running

Host resources

statenamewherekinddetail
okcpulabresource11.1% busy
okmemorylabresource40.3% used
okdisk /labresource49.4% of 258 GiB used
okdisk /datalabresource1.3% of 1006 GiB used

Local endpoints

statenamewherekinddetail
okclaude-proxylabendpointlistener 127.0.0.1:3456
okopenclaw-gatewaylabendpointlistener 127.0.0.1:18789

Alerts

severityalertlabelssincealertmanager
criticalHostDiskSpaceLowinstance=10.99.0.1:9100 job=lab-node2026-09-14T14:47:57.612Zops-obs
criticalN8nExternalAdapterUnavailableinstance=10.99.0.1:18081 job=scrapeConfig/n8n/n8n-external-claude namespace=n8n2026-09-04T11:55:03.987Zeda-k3s
criticalN8nExternalAdapterUnavailableinstance=10.99.0.1:18082 job=scrapeConfig/n8n/n8n-external-codex namespace=n8n2026-09-04T11:55:03.987Zeda-k3s
criticalProbeFailedinstance=https://forgejo.deepbrain.space/ job=blackbox_http2026-09-09T01:59:11.844Zops-obs
criticalProbeFailedinstance=https://git.deepbrain.space/ job=blackbox_http2026-09-09T01:59:11.844Zops-obs
warningEDAHostFilesystemFillingSooninstance=eda-host job=eda-host2026-09-14T15:27:27.695Zeda-k3s
warningEDAHostFilesystemSpaceLowinstance=eda-host job=eda-host2026-09-14T14:32:27.695Zeda-k3s
warningTargetDownjob=scrapeConfig/n8n/n8n-external-claude namespace=n8n2026-09-04T11:51:08.980Zeda-k3s
warningTargetDownjob=scrapeConfig/n8n/n8n-external-codex namespace=n8n2026-09-04T11:51:08.980Zeda-k3s

External probes

statenamewherekinddetail
okhttp://10.10.0.27:8200/v1/sys/healthblackbox_httpprobeprobe_success=1
okhttp://10.99.0.32:8200/v1/sys/healthblackbox_httpprobeprobe_success=1
okhttp://10.99.0.33:8200/v1/sys/healthblackbox_httpprobeprobe_success=1
okhttps://agentgit.org/blackbox_httpprobeprobe_success=1
okhttps://assay.deepbrain.space/auth/.well-known/openid-configurationblackbox_httpprobeprobe_success=1
okhttps://command.deepbrain.space/blackbox_httpprobeprobe_success=1
brokenhttps://forgejo.deepbrain.space/blackbox_httpprobeprobe_success=0
brokenhttps://git.deepbrain.space/blackbox_httpprobeprobe_success=0
okhttps://neutroncore.ai/blackbox_httpprobeprobe_success=1

Sources unavailable

every source answered