Files
aimsight-optimizer/sessions/NORDEND_2026-11-05T0600_2026-11-05T1200_20261116T1028Z/validation.md
T

1.9 KiB

Validation

Verdict: keep

Answers

  1. Detectors load: no skipped line in benchmark-before, -S1 or -after; rerunning the benchmark at HEAD gives output identical to benchmark-after.
  2. No station goes back: only Thermal displacement changes, on JUNGFRAU, NORDEND and SNCF01. "Found" rises on all three. The worst "correct" drop is SNCF01, 95.5 → 94.0 (-1.5 points), which is under 2 points.
  3. Simple and proportionate: one constant (RETURN) and one changed comparison in _episodes. The rule is generic: the cooling return ends at a lower share of the amplitude than the start does. The range gains +20 instants (56 → 77 %) and the whole benchmark gains +1089 found instants (68 → 74 %) while "correct" rises (73 → 75 %). The constant is not cut to the range's bounds.
  4. Rules: still six detectors, one per family. Contract and episode keys are unchanged. No station-, sensor- or date-specific rule (station names appear only in provenance comments). Standard library only. thresholds.md has the new RETURN row and an updated EDGE row, matching the constants in the code.

The range

NORDEND 2026-11-05T00:00Z → 2026-11-06T00:00Z

  • Thermal displacement: found 53/95 (56 %) → 73/95 (77 %); correct 53/53 (100 %) → 73/73 (100 %)
  • Displacement, Obstruction, Target issue, Visibility: unchanged

Non-regression

  • JUNGFRAU, Thermal displacement: found 1544/2557 (60 %) → 2300/2557 (90 %); correct 1544/1786 (86.4 %) → 2300/2654 (86.7 %)
  • NORDEND, Thermal displacement: found 4769/7667 (62 %) → 5066/7667 (66 %); correct 4769/5097 (93.6 %) → 5066/5411 (93.6 %)
  • SNCF01, Thermal displacement: found 1218/1726 (71 %) → 1254/1726 (73 %); correct 1218/1275 (95.5 %) → 1254/1334 (94.0 %)
  • Total, Thermal displacement: found 10897/16142 (68 %) → 11986/16142 (74 %); correct 10897/14828 (73 %) → 11986/16069 (75 %)

Reservations

none

Tools

none