2.8 KiB
2.8 KiB
aimsight-models
Learned detectors for AIMsight: models trained on the reviewed labels to tell, at each measurement instant of a station, which families are present (labeling/families.md), and which sensors carry them. A pilot, not yet in use: the detectors in production are the rules of aimsight-detectors.
The pilot
- Families: Visibility and Obstruction; the others stay rules for now.
- Model: multiple-instance learning, since a label names a station and a range, not its sensors, and each station has its own number of sensors: one small MLP shared by every sensor, attention pooling to a score per family for the station; the attention weights give the sensors.
- Inputs: each sensor against its own usual level (median and MAD over the 3 days before), on windows in hours (the step goes from 5 min to 4 h); the station context (share of high and rejected sensors,
sigma0, references, camera pose, housing temperature, common mode by PCA); the image quality metrics when present, with a mask. - Training: pre-training on the outputs of the current detectors over all the data, then fine-tuning on the reviewed labels of
labeling/auto/. - Evaluation: leave one station out; the measure of
detectors/bench/score.py(found, correct, per family and per instant), against the rules on the same stations. - Steps: dataset, evaluator (reproducing the rules' figures first), gradient boosting baseline, the PyTorch model, pre-training compared with and without, decoding into episodes.
Use
uv venv .venv && uv pip install -p .venv -r requirements.txt
.venv/bin/python test_dataset.py ~/aimsight-detectors
.venv/bin/python dataset.py --detectors ~/aimsight-detectors --data ~/aimsight-data/data --labels ~/aimsight-labeling/auto --out cache
dataset.py (step 1, ~2 min): one cache/<STATION>.npz per labelled station, over its labelled range as the benchmark reads it: xs [instant, sensor, feature], xc [instant, feature], y [instant, family] with the conventions of bench/score.py (its labelled instants per family are the benchmark's, exactly). NaN where a value does not exist (a 1 h window at a 4 h step, no temperature, no image quality outside LENZSPITZE).
Contracts
- Reads the measurements through
detectors/scripts/data.py, the reading of the benchmark; the labels fromlabeling/auto/; the data fromdata/(read-only). Paths are passed as arguments. - Never changes
aimsight-detectors(neitherscripts/norbench/): the benchmark is the measure. - Episodes in the format of the detectors' contract (
start,end,kind,label,text,ignore,sensors), so that a model can later sit behinddetect(measurements).
Rules
- Every time is in UTC. No rule specific to a station, a target or a date.
- English for code, identifiers and docs.