43 lines
3.1 KiB
Markdown
43 lines
3.1 KiB
Markdown
# detectors
|
|
|
|
The AIMsight anomaly detectors and their benchmark. Python 3, standard library only.
|
|
|
|
## The detectors
|
|
|
|
Five modules in `scripts/`, one per kind of reading; each gives episodes of one or more of the seven families:
|
|
|
|
| Module | Reads | Families (varieties) |
|
|
|---|---|---|
|
|
| `visibility.py` | error_value of each sensor; fast noise of the curves | Visibility (Poor visibility "none" or "reduced", Heat shimmer), Obstruction (Brief obstruction) |
|
|
| `target_issue.py` | rejections day after day | Target issue (Degraded target), Obstruction (Target obscured) |
|
|
| `thermal_displacement.py` | the daily wave of the curves | Thermal displacement (Thermal expansion / contraction, Camera thermal expansion / contraction, Camera thermal movement) |
|
|
| `no_data.py` | the cadence of the measurements | No data |
|
|
| `displacement.py` | jumps and slow drift of the corrected curves | Displacement (Lasting shift; Jump, not back yet; Slow drift), Perturbation (Sudden jump, back to normal) |
|
|
|
|
`episodes.py` holds their shared helpers. `categories.py` runs them all and classifies their episodes into events (a jump back joins the visibility loss or the obstruction that explains it; the same variety less than an hour apart, one event), one line per event. The measurements are read by `scripts/data.py` of the tools repository, the sibling `~/aimsight-tools`.
|
|
|
|
```bash
|
|
python3 scripts/categories.py <station folder> --from YYYY-MM-DD --to YYYY-MM-DD # --chunk N, --history N
|
|
```
|
|
|
|
`thresholds.md` is the registry of the detectors' thresholds and what each was tuned on.
|
|
|
|
## Measuring them: `bench/`
|
|
|
|
The detectors against labels (JSONL, one per line, `{"id", "start", "end", "family", "description"}`, UTC ISO times):
|
|
|
|
```bash
|
|
python3 bench/score.py <station folder> --labels <labels.jsonl> --from YYYY-MM-DD --to YYYY-MM-DD # the score of a range
|
|
python3 bench/regression.py --labels <folder of <STATION>.jsonl> --data <folder of <STATION>/> # the benchmark; --from/--to: one range for all
|
|
python3 bench/compare.py <before.txt> <after.txt> # two benchmarks: the regressions, the complexity
|
|
python3 bench/sensors.py <station folder> --from YYYY-MM-DD --to YYYY-MM-DD # the sensors of each event
|
|
```
|
|
|
|
A change to a detector is checked with the benchmark; a refactoring leaves every figure unchanged.
|
|
|
|
## Improving them
|
|
|
|
The detectors are improved by Optimizer (its `optimize` skill, from one analysis), with the `upgrader` and `validator` agents of the agents repository: on the range of an analysis, its labels as the truth, the upgrader fixes the detectors (one commit per fix here) and the validator keeps, removes or cancels the fixes against overfitting, judged by this benchmark. Nothing is pushed.
|
|
|
|
Copied from Support-Agent on 2026-11-13 (commit 48a3092), simplified on 2026-11-16 (branch `simplify`); the detectors now evolve here. Used by aimsight-app and Optimizer, through a `detectors -> ~/aimsight-detectors` link (one copy on the workstation); their labels come from the `labeling` repository, their data from `aimsight-data`. The architecture of the repositories: `~/aimsight-app/docs/architecture.drawio`.
|