Files
aimsight-detectors/thresholds.md
T
maximeandClaude Opus 5.5 7e3043d3a0 wf-improve: S1
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-14 14:59:41 +01:00

12 KiB
Raw Blame History

Detector thresholds

Every threshold of the detectors (scripts/*.py, one per family of the families document, D-119) is provisional: tuned on the six data sets of events E-001 to E-005 and NORDEND of October, then adjusted by wf-improve sessions. When bulk data arrives, this is the list to review. A constant added or changed updates this file in the same change. Check: grep -nE "^[A-Z_0-9]+ = " scripts/*.py.

The detectors must detect everything (the user, 2026-10-26, D-068): a setting chosen to hide something from the client is not a detection rule; the wf-improve workflow may change it. What is shown to the client is decided in a separate layer.

"wf-improve X, mod. 1, S2": suggestion S2 of modification 1 of the wf-improve run on X. "X, batch 01": first batch of the earlier loop on station X.

Detector Constant Value Tuned on
visibility K_MAD 10 E-001 (fog 11 to 57 MAD), E-005 (10 to 70 MAD)
FACTOR 2 drops sensors with a near-zero MAD (E-004, E-005); also, alone (without K_MAD), something passing in front of one or two targets or a reference, rejected for a single measurement (point 2): wf-improve Obstruction, mod. 1, S3 (WILDSTRUBEL: by day, heat shimmer inflates the MAD; R1 rejected at ×3.6 under 10 MAD)
RUN_MIN 3 E-001, rain of E-005
BRIEF_MIN 3 trains of E-005 (5 to 17 sensors)
SALIENCE 3 trains (5 to 17) against the cobweb of E-002 (2 to 9)
FRAC 0.15 tails of PR09 and CTR01 (NORDEND October)
BREAK 2 h NORDEND October, night of the 13th to the 14th
K_TARGET 5 leaves of E-005 (6 to 25 MAD)
TARGET_MIN 3 —; 2 when TARGET_MIN measurement steps do not fit in TARGET_GAP: wf-improve Obstruction, mod. 1, S6 (BREITHORN, one measurement every 4 h: vehicles parked at night, two or three rejections)
TARGET_GAP 6 h leaves of E-005 (7 rejections in 12 h); at least two measurement steps (same S6)
GAP_STEPS 2.5 steps timestamp jitter
REJECT_FACTOR 1.2 FLORIDA, batch 01: a rejection at 10 MAD is high without doubling (targets at level 0.6); drops C24 of E-009 (0.68, rejected at ×1.04)
HALF 0.5 level "none" (point 5): NORDEND 09/10 23:00 (68 % rejected) against the rain of E-005 (24 to 33 %)
K_DIFFUSE 2.5 MAD diffuse nuisance (point 8): median, over the sensors, of the error_value in MAD above each one's median, RUN_MIN instants in a row, rejected or not: Poor visibility "reduced"; not within heat shimmer; wf-improve Visibility, mod. 1, S2 (JUNGFRAU, FLORIDA, NORDEND: reduced visibility of the whole scene without rejection; at 2, nights labelled thermal at JUNGFRAU and jumps back of WILDSTRUBEL absorbed; at 3, half the gain)
FEW 3 targets Poor visibility on at most 3 targets, no reference: an object in front of them, Target obscured (boundary "Visibility or Obstruction" of the families document); BREITHORN, batch 01 (vehicles parked in front of 2 or 3 targets out of 12)
visibility (heat shimmer) RATIO 1.5 E-003 (×1.7 to ×3 the night)
SHARE 0.5 —
RATIO_ERR 1.5 E-003 (×1.7 to ×3.2)
REJECT_MAX 15 % E-003 ≤ 7 %; cobweb and rain ≥ 18 %; rejections beyond each sensor's habit (its share of rejections over the export): wf-improve Visibility, mod. 1, S1 (WILDSTRUBEL: a reference or targets usually rejected dropped the days of heat shimmer; 4 to 14 % against 9 to 22 % raw)
STRONG 2× E-003 (×2.3 to ×2.6)
MIN_DURATION 3 h E-003 (10-11 h) against the morning of E-004 (2 h); the classification drops this morning too, whatever the duration
displacement (jumps) K 20 noises E-001 (at 15, two healthy targets greyed); do not lower for the trains, seen by visibility
K_LASTING 7 noises jump under K that stays (point 8 of displacement.py): NIEDERHORN, batch 01 (e09, corr_y −0.19 px at once, 8 noises, stayed 5 days)
PLATEAU 8 ordinary variations same point: gap between the medians of the day after and the day before, in ordinary variations of the level from one day to the next; NIEDERHORN, batch 01 (e09: 13; E-001, healthy targets: 6 at most)
K_PEAK 6 noises one-step peak common to several targets: NORDEND, batch 01 (shakes of the whole image, 6 to 11 noises)
PEAK_MIN 3 targets NORDEND, batch 01 (3 to 5 targets per shake)
BASE 4 measurements 1 h at 15 min; the return of a jump is judged on an hour of measurements, BASE at most, one at least (wf-improve MICHIGAN, mod. 1: at a 4 h step, a peak back at the next measurement became "Large shift")
GAP 1 h —
BACK_H 24 h E-002 (plateaus up to 11.5 h)
REPEAT 5 jumps back CLARIDEN, batch 01: PR_BG flips 28 times in 2.5 days, the other targets 3 at most (morning of the movement)
FLIP 36 h problem target (D-074): PR_BG of CLARIDEN flips 2.5 days; C8 and C13 of E-009, 5 flips in 1 h 20 on the morning of the movement, stay brief jumps; 6 h → 36 h: wf-improve Target issue, mod. 1, S2 (NORDEND PR12, PR14, PR08, PR05, JUNGFRAU BJ_G: 12 to 28 h of flips within a loss of visibility, labelled Visibility or Obstruction, absorbed by it)
MAX_FLIPPING 2 targets problem target: FLORIDA, the two stuck targets; E-002, cobweb on the references, 15 targets flip at once
LARGE 0.5 large shift ("Large shift", D-074): E-004 and CLARIDEN, 18 targets on the morning of the movement; also, slow drift of the camera (LARGE of the targets in corr and of the sensors in raw x, y, on the same side: no "Slow drift" over the whole window, only the pieces of PIECE): wf-improve MICHIGAN, mod. 1 (BREITHORN kept); wf-improve Displacement, mod. 1, S2 (NEBRASKA reported in pieces, JUNGFRAU still silent)
displacement (slow drift) HOURS 20 h out of 24 as the trend of the Displacements tab (D-055); as a share of the hours the station measures (wf-improve MICHIGAN, mod. 1: 5 out of 6 at one measurement every 4 h, no day counted)
DAYS 5 days D-055: a trend needs at least 5 UTC days
SIZE 1 D-055: drift over the period ≥ one daily amplitude; amplitude of the day: 9th and 1st deciles of corr
STEADY 0.6 D-055: Kendall tau of the daily levels; a step from one day to the next of more than half the drift drops it (a jump)
PIECE 3.5 amplitudes piecewise drift, for a target without a drift over the whole window (point 4b of displacement.py): wf-improve Displacement, mod. 1, S1 (rows of CLARIDEN, 3.8 to 8.3 amplitudes; JUNGFRAU, thermal cycles without a Displacement label, 3.1 at most; at 1, NORDEND and JUNGFRAU overflow)
MAX_HOLE 2 days a drift piece (point 4b) does not go from one kept day to the next more than 2 days apart: wf-improve Displacement, mod. 2, S1 (CLARIDEN, hole from 10-03 to 10-05: the pieces from 09-28 to 11-01 fall; at 1, the missing days of a half-day hole cut the drifts of CLARIDEN and NEBRASKA)
thermal_displacement MIN_HOURS 20 h —; days of the profile
PARTIAL 12 h an incomplete day (fewer than MIN_HOURS) gets its episode if it looks like the profile on the hours it has, without entering the profile; wf-improve Thermal displacement, mod. 1, S4 (SNCF01, NORDEND, JUNGFRAU: labelled cycles of days cut by a hole; MIN_HOURS at 12 or 16 made NIEDERHORN go back)
REPRO 0.6 pure noise ≈ 0
SHARE 0.5 NORDEND October just under (9/19)
WARM 0.3 —; only says there is a cycle (at least MIN_WARM_HOURS warm hours), its bounds are at EDGE
EDGE 0.1 bounds of the wave: start and return of the profile, the return after midnight if needed, at most to the next day's start; wf-improve Thermal displacement, mod. 1, S1 (NORDEND, JUNGFRAU, SNCF01: labelled evenings and nights, the wave stopped at the last warm hour; at 0.15 and 0.2, fewer nights found, FLORIDA overflows in the evening anyway)
DAY_MATCH 0.5 —
NIGHT 8 h —
R2_MIN 0.3 24 h sinusoid: PS des Coudres 14 axes out of 22 above, CLARIDEN 0 out of 48; no longer asked for the camera (raw positions) since WILDSTRUBEL, batch 01 (1 target out of 7, the wrong pointings crush the fit)
MIN_WARM_HOURS 2 h WILDSTRUBEL, batch 01: a single warm hour is not a cycle (NIEDERHORN, E-005: noon, trains and holes)
SLIDE_K 3 noises common camera slide without a cycle ("Camera thermal movement"): gap from the median of the day before, raw positions and corrected curves; wf-improve MICHIGAN, mod. 1 (at 2, Displacement instants of BREITHORN taken)
COLD 4 one-hour noises the camera moves with the cold ("Camera thermal movement", without a cycle): the pose (tilt, rotation or scale) moves away from its median of the day before while the temperature falls under its own, the same hour; noise: variations over an hour, one step at 4 h; wf-improve Thermal displacement, mod. 1, S3 (BREITHORN, CLARIDEN, NEBRASKA: targets in opposite directions, or compensated; at 3, Displacement instants of NEBRASKA taken)
no_data MISSING 2 steps user's rule, 2026-10-23; also applied between the last measurement and the end of the window read (CLARIDEN, batch 01); the step is at least an hour divided by the median instants per clock hour (bursts of measurements: the cycle, not the minute inside a burst; wf-improve, batch 2026-11-05, S1: SUSTENHORN)
target_issue CALM 0.25 (detector added on 2026-10-27, see its docstring)
SHARE 0.5 —; the target hidden at times ("Target obscured")
SHARE_WEEK 0.25 share of the calm instants rejected that makes a degraded day of the problem target ("Degraded target", at least WEEK days): regularity rather than the share of the day; wf-improve Target issue, mod. 1, S1 (WILDSTRUBEL R3 rejected from 04:00 to 16:00 every day, 30 to 45 %: seen only on days without night measurements; NORDEND PR04 and CTR01, NIEDERHORN PWD_IMP_B08_024_C09, under half)
MIN_HOURS 3 h hours of calm instants per day, at the station's cadence (median gap between two instants): 12 instants at 15 min; wf-improve NEBRASKA, batch 01 (one measurement every 4 h: no day counted, the lost reference REFCOLH22 was not seen)
MIN_DAYS 2 days NORDEND: isolated days on 16 sensors
WEEK 7 days problem target ("Degraded target") if hindered at least a week in a row, otherwise a target hidden at times ("Target obscured"): boundary "Target issue or Obstruction" of the families document; wf-improve NEBRASKA, batch 01 (BREITHORN, parked vehicles, 2 to 5 days; NEBRASKA and MICHIGAN, lost reference, 25 days; JUNGFRAU, PM_G, 63 days)
BRIDGE 1 day non-degraded days in a row that do not break the run of a problem target ("Degraded target": WEEK days from the first to the last degraded day, SHARE_WEEK of rejections over the bridged run); wf-improve Obstruction, mod. 1, S1 (FLORIDA, SNCF01, NORDEND, NIEDERHORN: problem targets cut into Target obscured by a day under SHARE; BREITHORN, parked vehicles, unchanged); 2 → 1: wf-improve Target issue, mod. 1, S1 (at a quarter, two bridging days joined the parked vehicles of BREITHORN, POUI22, into a week)
STUCK 0.05 stuck target (D-074): E-011, C2 and C3 at 0.006 and 0.016 of the others' noise; NORDEND, E-001: 0.7 at the lowest
categories (classification) MERGE 1 h rule validated by the user: same variety less than an hour apart, a single event; two Obstruction (Target obscured, Brief obstruction) only if they share a sensor (wf-improve Obstruction, mod. 1, S1 and S3), two Target issue too (wf-improve Target issue, mod. 1, S3); a Brief obstruction only absorbs the jumps back within MERGE after its instant (S3)