detectors

The AIMsight anomaly detectors and their benchmark. Python 3, standard library only.

The detectors

Five modules in scripts/, one per kind of reading; each gives episodes of one or more of the six families:

Module Reads Families (varieties)
visibility.py error_value of each sensor; fast noise of the curves Visibility (Poor visibility "none" or "reduced", Heat shimmer), Obstruction (Brief obstruction)
target_issue.py rejections day after day Target issue (Degraded target), Obstruction (Target obscured)
thermal_displacement.py the daily wave of the curves Thermal displacement (Thermal expansion / contraction, Camera thermal expansion / contraction, Camera thermal movement)
no_data.py the cadence of the measurements No data
displacement.py jumps and slow drift of the corrected curves Displacement (Sudden jump, back to normal; Lasting shift; Jump, not back yet; Slow drift)

episodes.py holds their shared helpers. categories.py runs them all and classifies their episodes into events (a jump back joins the visibility loss or the obstruction that explains it; the same variety less than an hour apart, one event), one line per event. The measurements are read by scripts/data.py of the tools repository, the sibling ~/aimsight-tools.

python3 scripts/categories.py <station folder> --from YYYY-MM-DD --to YYYY-MM-DD   # --chunk N, --history N

thresholds.md is the registry of the detectors' thresholds and what each was tuned on.

Measuring them: bench/

The detectors against labels (JSONL, one per line, {"id", "start", "end", "family", "description"}, UTC ISO times):

python3 bench/score.py <station folder> --labels <labels.jsonl> --from YYYY-MM-DD --to YYYY-MM-DD       # the score of a range
python3 bench/regression.py --labels <folder of <STATION>.jsonl> --data <folder of <STATION>/>       # the benchmark; --from/--to: one range for all
python3 bench/compare.py <before.txt> <after.txt>                                                      # two benchmarks: the regressions, the complexity
python3 bench/sensors.py <station folder> --from YYYY-MM-DD --to YYYY-MM-DD                             # the sensors of each event

A change to a detector is checked with the benchmark; a refactoring leaves every figure unchanged.

Improving them

The detectors are improved by Optimizer (its optimize skill, from one analysis), with the upgrader and validator agents of the agents repository: on the range of an analysis, its labels as the truth, the upgrader fixes the detectors (one commit per fix here) and the validator keeps, removes or cancels the fixes against overfitting, judged by this benchmark. Nothing is pushed.

Copied from Support-Agent on 2026-11-13 (commit 48a3092), simplified on 2026-11-16 (branch simplify); the detectors now evolve here. Used by aimsight-app and Optimizer, through a detectors -> ~/aimsight-detectors link (one copy on the workstation); their labels come from the labeling repository, their data from aimsight-data. The architecture of the repositories: ~/aimsight-app/docs/architecture.drawio.

S
Description
Detectors for time series classification
Readme
417 KiB
0 Stars 1 Watchers 0 Forks
Languages
Python 100%