Deep Analytics & Simulation: GPU Health Score
Full analytical implementation of the mathematical GPU health index from codebook/health_v0.2.1.yaml & glyphrca/health.py. Evaluates HBM3 ECC decay, thermal Arrhenius stress, NVLink degradation, and 30-day survival probability.
🎚️ Card Telemetry & Parameters
H100-SXM5-80GBCluster Fleet Health Heatmap Under Stress
Updated Health Analytics Python Script (glyphrca/health.py)
# GlyphAI Fleet RCA: Predictive GPU Health Engine (v0.2.1 extended)
# Built from Moon-stone-AI/glyph-fleet-rca/glyphrca/health.py
# (c) 2026 Vitali de Mille · Sovereign Artificial Mind Telemetry
import math
from dataclasses import dataclass
from typing import Dict
@dataclass
class GpuTelemetryProfile:
host: str
bdf: str
model: str
hours: float
junction_temp_c: float
hotspot_delta_c: float
ecc_dbe: int
ecc_contained: int
sbe_rate_per_hr: float
row_remap_events: int
spare_rows_pct: float
row_remap_fail: bool
bus_lost: int
nvlink_crc_rate: bool
link_degraded: bool
thermal_throttle: bool
sdc_diag_fail: bool
def compute_gpu_health_score(g: GpuTelemetryProfile) -> Dict:
penalties = {"memory": 0.0, "severe_xid": 0.0, "links": 0.0, "throttling": 0.0, "diagnostics": 0.0, "age": 0.0}
verdicts = []
# 1. Memory (max 35)
mem = (g.ecc_contained * 3.0) + (g.ecc_dbe * 8.0) + (g.row_remap_events * 4.0)
if g.sbe_rate_per_hr > 1.0: mem += 5.0
if g.spare_rows_pct < 20: mem += 15.0
penalties["memory"] = min(mem, 35.0)
# 2. Severe Xid (max 25)
penalties["severe_xid"] = min(g.bus_lost * 8.0, 25.0)
# 3. Links (max 15)
lnk = (5.0 if g.nvlink_crc_rate else 0.0) + (10.0 if g.link_degraded else 0.0)
penalties["links"] = min(lnk, 15.0)
# 4. Throttling (max 10)
thr = (5.0 if g.thermal_throttle or g.junction_temp_c >= 88 else 0.0)
if g.junction_temp_c >= 95: thr += 5.0
penalties["throttling"] = min(thr, 10.0)
# 5. Diagnostics (max 10)
if g.sdc_diag_fail: penalties["diagnostics"] = 10.0
# 6. Age (max 5, 1 pt per 8760 h)
penalties["age"] = min(round((g.hours / 8760.0), 1), 5.0)
score = 100.0 - sum(penalties.values())
# Hard Caps
if g.row_remap_fail:
score = min(score, 10.0)
verdicts.append("RMA: row-remapping capacity exhausted")
if g.sdc_diag_fail:
score = min(score, 10.0)
verdicts.append("RMA: failed matrix-math Tensor Core diagnostic")
if g.spare_rows_pct <= 0:
score = min(score, 30.0)
verdicts.append("0% spare rows left in memory banks")
# Group Caps (uncorrectable memory incidents)
uncorr = g.ecc_dbe + g.row_remap_events
if uncorr >= 2:
score = min(score, 49.0)
verdicts.append("Repeated uncorrectable memory: not for sale")
elif uncorr >= 1:
score = min(score, 74.0)
verdicts.append("Uncorrectable memory error: sell only with disclosure")
score = max(0.0, round(score, 1))
# Arrhenius physics acceleration: Ea = 0.7 eV
T_base, T_j = 348.15, g.junction_temp_c + 273.15
arrhenius_af = math.exp((0.7 / 8.61733e-5) * (1.0 / T_base - 1.0 / T_j))
hazard = (1.45 / 80000.0) * math.pow(g.hours / 80000.0, 0.45) * max(0.2, arrhenius_af)
if g.ecc_dbe > 0: hazard *= 3.5
if g.hotspot_delta_c > 14: hazard *= 1.8
survival_30d = round(math.exp(-hazard * 720.0) * 100.0, 1)
return {
"score": score,
"band": "excellent" if score >= 90 else "good" if score >= 75 else "caution" if score >= 50 else "do_not_sell",
"breakdown": penalties,
"arrhenius_af": round(arrhenius_af, 2),
"predicted_mtbf_hours": int(1.0 / hazard),
"survival_30d_pct": survival_30d,
"verdicts": verdicts
}
Architectural Irreversibility for Hardware Assets.
Raw GPU logs are linguistic noise. GlyphAI translates vendor dialects (NVIDIA Xid, IPMI SEL, DCGM) into a single semantic vocabulary. Each event becomes a quantifiable concept. Health Score is the deterministic sum of these concepts, not a probabilistic guess.
Semantic Preservation, Not Concealment.
We do not encrypt or conceal raw text; we change its representational class. Raw logs are decomposed into semantic atoms and ontological relations. Through Codebook-driven transformation (Codebook v0.2.1), they are mapped to structured glyphs. The original surface form is architecturally discarded. Meaning is preserved for analytics; the possibility of reconstructing the raw text is eliminated at the architectural level, rather than through computational complexity.
Semantic Transformation Pipeline
3 quantified stages of deterministic ontological evaluation
Localised Ingestion & Data Minimisation
Semantic Transformation & Decoder Separation
Deterministic Scoring & Policy-Bound Output
Pricing Tiers & Service Parameters
Clear performance metrics scaled precisely to your operational compute requirements.
| Tier | Fleet Size | Price per GPU | Turnaround | Support | Key Ontological Features |
|---|---|---|---|---|---|
| Pilot | 1 server (8 GPUs) | €35 | 48 Hours | Email Only | Free first report, standard semantic vocabulary mapping, read-only collector validation. |
| Transactional Audit | 2–24 servers (16–192 GPUs) | €28 | 3–5 Biz Days | Standard (9-5) | Batch intake, default data masking, 30-day secure log retention, standard Codebook v0.2.1. |
|
High-Volume Fleet
Popular
|
25–99 servers (200–792 GPUs) | €22 | 5–7 Biz Days | Priority Channel | Vocabulary tuned to specific hardware topology, masking audit per batch, expedited parsing. |
| Institutional | 100+ servers (800+ GPUs) | Custom Matrix | < 72 Hours Custom | 24/7 Dedicated Eng | On-premise collector option, custom Codebook generation, formal compliance documentation, API access. |
Frequently Asked Questions (FAQ)
Q: What happens if logs on the server have been wiped?
Architectural irreversibility requires data. If raw logs are absent, the system cannot reconstruct historical semantic atoms. Evaluation strictly reverts to active diagnostic benchmarks (e.g. dcgmi diag), with the report explicitly recording "No historical semantic data". The system preserves uncertainty rather than hallucinating a score.
Q: How does this differ from standard anonymization or encryption?
Encryption preserves the original form and conceals it reversibly. Anonymization removes identifiers while leaving inferential paths intact. GlyphAI applies Codebook-Controlled Non-Interpretability: it changes the representational class of the data. The original surface form is never stored; only structured semantic concepts strictly required for the health scoring task are retained, guaranteeing true Data Minimisation at the architectural level.
Q: Who owns the data and can it be reconstructed back into the original raw log?
The transformed glyph representation is a many-to-one mapping. Because the original linguistic surface is discarded during transformation, unique reconstruction of the raw text is architecturally unviable rather than merely computationally difficult. Raw logs are purged from GlyphAI intake nodes within 30 days of report generation, ensuring the semantic tier remains the sole operational artifact.