Files
aimsight-labeling/auto/analyses/NIEDERHORN_2026-10-11T0500_2026-10-21T1200/analysis.md
T
maximeandClaude Opus 5.5 ddb17c2189 auto: labels requalified under the 5-noise rules (only what stands out from the noise): 32 analyses refined, the 6 paused periods verified, the long labels requalified with the fixes the period analysts found; 1153 -> 961 labels
- 32 analyses: each label kept, rewritten or removed by its analyst (section Requalification of the report; mm magnitudes where the targets have them)
- SNCF01 x3, WILDSTRUBEL 2026-09-01 -> 2026-10-06 x3: verified from their existing labels under the new rules
- long labels (no analysis): auto/analyses/long-labels/<STATION>/; NORDEND-169 and -195 run to 07/11, so NORDEND-283 and -284 (their continuation) are removed
- reading-rules.md, stations.md: the citations of removed or rewritten labels point to their successor, or to [expert]

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-17 23:58:00 +01:00

115 lines
17 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# Labels: NIEDERHORN, 2026-10-11T05:00Z → 2026-10-21T12:00Z (UTC)
Request (2026-11-17): requalify the 45 labels of this analysis (`work/requalify_input.jsonl`, identical to the previous `labels.jsonl`) under the new rules (`labeling-rules.md` section 1, `families.md` "What is not labeled"): only what stands out from the noise of the corrected curves is labelled. Not a new reading: each label is measured with `ranges.py` at `--k 5` and kept, rewritten or removed. DETECTORS: no.
Station context (unchanged from the verification of this range): railway tracks seen from below a road, references PWD_REF08 to PWD_REF12 on the road, floodlight at night, hourly cadence (232 instants). No `weather/` folder for NIEDERHORN (station without a Swiss position): no MeteoSwiss weather. Image quality columns empty: no `quality.py`. Distances (`inventory.py`): the PWD targets from 11.7 m (PWD_RMP_B12_017_C09, 4.2 mm/px) to 29.7 m (PWD_RMP_B17_026_C09, 10.5 mm/px); the e targets have no distance, so no mm.
Result: **39 labels: 37 kept as they are, 2 rewritten, 6 removed.**
## 1. My labels
The labels are those of the verification (see its reasoning in the previous version of this file, `git log` of the labeling repository); only their measurement under the new threshold is added here. Deviations: the largest |deviation| of a target, in its own noise, at `--rolling 3` for a short event (a passage, the sun, the plant), from the night level for a thermal cycle, across the step for a lasting jump. The references and PWD_IMP_B07_016_C09 (the plant) are left out of the thermal test.
| Id | Bounds (UTC) | Family | Verdict | Deviation that holds it (noises) |
|---|---|---|---|---|
| NIEDERHORN-163 | 11T05 → 11T07 | No data | kept | no measurement at all at 06:00 |
| NIEDERHORN-54 | 11T15 → 11T18 | Thermal displacement | kept | PWD_IMP_B07_018_C09 corr_x −8.1 at 16:00 from the night level, 2 of 3 measurements beyond 5 |
| NIEDERHORN-164 | 11T21 → 12T06 | Visibility | kept | PWD_RMP_B15_020_C09 corr_x −20.9 at 12T01, e10 −18.2, PWD_IMP_B08_025_C09 −17.1 (26 target-columns beyond 5); the description already states these drops |
| NIEDERHORN-56 | 12T03 → 12T05 | Obstruction | kept | PWD_RMP_B12_018_C09 corr_y +16.3, PWD_RMP_B12_017_C09 +13.9, PWD_RMP_B12_019_C09 corr_x −12.3 at 12T04 |
| NIEDERHORN-57 | 12T15 → 13T00 | Thermal displacement | kept | PWD_IMP_B07_018_C09 corr_x −12.1, PWD_RMP_B12_018_C09 −11.8 from the night level (18 target-columns beyond 5 on ≥ 2 measurements) |
| NIEDERHORN-58 | 12T16 → 12T19 | Obstruction | kept | PWD_IMP_B07_016_C09 corr_y +5.2 at 12T18 (rolling ±3; +5.8 against the batch level): just over the threshold |
| NIEDERHORN-60 | 13T07 → 13T20 | Obstruction | kept | PWD_IMP_B07_016_C09 corr_x +14.6 at 13T12, +12.9 at 10:00, corr_y +10.3 at 19:00 |
| NIEDERHORN-61 | 13T08 → 13T15 | Visibility | **rewritten** | PWD_RMP_B15_020_C09 corr_x −14.7 at 10:00, PWD_IMP_B08_025_C09 −14.6, PWD_RMP_B16_026_C09 −13.4 at 12:00, e15 −19.2, e14 −8.3, PWD_RMP_B12_017_C09 +11.6 at 12:00, e06 −9.9 at 14:00 |
| NIEDERHORN-62 | 13T12 → 13T14 | Obstruction | kept | PWD_RMP_B12_019_C09 corr_y +23.4, PWD_RMP_B12_020_C09 +18.2, e13 corr_x −8.8 at 13T13 |
| NIEDERHORN-165 | 13T13 → 14T06 | Thermal displacement | kept | PWD_RMP_B12_019_C09 corr_x +17.6, PWD_RMP_B16_026_C09 +17.1, PWD_RMP_B15_020_C09 +15.3, all 9 measurements beyond 5 (30 target-columns) |
| NIEDERHORN-66 | 13T22 → 14T00 | Obstruction | kept | PWD_RMP_B12_019_C09 corr_y +35.0, PWD_RMP_B12_020_C09 +29.1, PWD_RMP_B12_018_C09 +17.6, e14 +14.5 at 13T23 |
| NIEDERHORN-67 | 14T07 → 15T02 | Obstruction | kept | PWD_IMP_B07_016_C09 corr_y +11.3 at 14T18, −6.6 at 14T13 |
| NIEDERHORN-68 | 14T11 → 14T14 | Visibility | kept | e10 corr_x −19.7, PWD_RMP_B12_018_C09 +12.9, PWD_IMP_B08_025_C09 corr_y +12.3 at 14T12 |
| NIEDERHORN-69 | 14T13 → 14T23 | Thermal displacement | kept | PWD_IMP_B07_018_C09 corr_x −9.4 from the night level, 8 of 9 measurements beyond 5; PWD_IMP_B08_024_C09 −9.0 |
| NIEDERHORN-166 | 15T01 → 15T03 | Obstruction | kept | e09 corr_x +8.0, corr_y −5.3, PWD_RMP_B16_026_C09 corr_x +5.3 at 15T02 |
| NIEDERHORN-167 | 15T01 → 15T04 | Displacement | kept | PWD_RMP_B16_026_C09 corr_y from about 1.41 px (four measurements before) to 1.66-1.71 px from 02:00 until the gap: about ten noises (batch noise 0.027 px), lasting |
| NIEDERHORN-71 | 15T13 → 15T22 | Thermal displacement | kept | PWD_RMP_B15_018_C09 corr_y +9.7 at 17:00, PWD_IMP_B07_018_C09 corr_x −6.4, 4 of 9 measurements beyond 5 |
| NIEDERHORN-72 | 15T22 → 16T11 | No data | kept | no measurement at all for twelve steps |
| NIEDERHORN-168 | 15T22 → 16T12 | Displacement | kept | e10 corr_x jump −48.8 noises across the gap, e09 −33.3, e13 −22.2, PWD_RMP_B16_026_C09 −25.4, and it stays |
| NIEDERHORN-169 | 16T11 → 16T18 | Visibility | **rewritten** | PWD_IMP_B08_025_C09 corr_x −34.9 at 11-12:00, PWD_RMP_B15_020_C09 −16.8, PWD_IMP_B08_024_C09 −14.8, PWD_RMP_B17_026_C09 −11.8 then −13.2 at 13:00, e14 −10.6, PWD_RMP_B15_019_C09 corr_y +16.4 at 13:00, PWD_RMP_B16_026_C09 corr_x −14.5 at 14:00, e10 −18.8 at 16:00 |
| NIEDERHORN-170 | 16T11 → 17T12 | Thermal displacement | kept | against the calm night of 14-15.10 (no night before the label, the gap): PWD_IMP_B08_025_C09 corr_x −11.8 at 17T11 (5 of 18 measurements beyond 5), PWD_RMP_B12_018_C09 corr_y +8.8, corr_x +7.6, PWD_RMP_B12_020_C09 corr_x +7.2; against the night of 17-18.10, PWD_IMP_B08_025_C09 −7.6. Left-edge targets left out (their step) |
| NIEDERHORN-76 | 16T14 → 17T01 | Obstruction | kept | PWD_IMP_B07_016_C09 corr_x +5.8 at 16T21, +5.7 at 20:00, +5.6 at 16:00 (rolling ±3; +6.8 against the batch level) |
| NIEDERHORN-77 | 16T16 → 16T18 | Obstruction | kept | PWD_RMP_B17_026_C09 corr_y −11.3, PWD_RMP_B16_026_C09 +9.5 at 16T17 |
| NIEDERHORN-78 | 16T18 → 16T20 | Obstruction | kept | PWD_RMP_B17_026_C09 corr_y +10.0, PWD_RMP_B16_026_C09 +5.9 at 16T19 |
| NIEDERHORN-171 | 17T12 → 17T16 | Visibility | kept | PWD_IMP_B08_025_C09 corr_x +8.6, PWD_IMP_B07_017_C09 +7.2, PWD_RMP_B12_017_C09 +6.5 at 17T14 |
| NIEDERHORN-82 | 17T12 → 18T00 | Thermal displacement | kept | PWD_RMP_B12_018_C09 corr_x −21.3 from the night level, 8 of 8 measurements beyond 5 (26 target-columns) |
| NIEDERHORN-172 | 18T12 → 18T15 | Visibility | kept | PWD_IMP_B07_017_C09 corr_x −8.0, e13 +7.4 at 18T13, PWD_RMP_B15_018_C09 +6.9 at 14:00 |
| NIEDERHORN-85 | 18T12 → 19T00 | Thermal displacement | kept | PWD_RMP_B12_018_C09 corr_x −21.5, PWD_RMP_B12_020_C09 −15.4, 9 of 9 measurements beyond 5 |
| NIEDERHORN-87 | 19T05 → 19T22 | Obstruction | kept | PWD_IMP_B07_016_C09 corr_y +10.7 at 19T20, +9.3 at 19T06 |
| NIEDERHORN-88 | 19T09 → 19T11 | No data | kept | no measurement at all at 10:00 |
| NIEDERHORN-173 | 19T11 → 19T15 | Visibility | kept | e13 corr_x −11.8, e06 −11.7, e15 −11.2, PWD_RMP_B17_026_C09 −9.9 at 19T12 |
| NIEDERHORN-90 | 19T11 → 20T00 | Thermal displacement | kept | PWD_RMP_B12_018_C09 corr_x −22.0, PWD_IMP_B07_018_C09 −20.1 from the night level (26 target-columns) |
| NIEDERHORN-91 | 19T20 → 19T22 | No data | kept | no measurement at all at 21:00 |
| NIEDERHORN-92 | 20T05 → 20T13 | Obstruction | kept | PWD_IMP_B07_016_C09 corr_y −13.0 at 20T09, −11.7 at 07:00, corr_x −10.1 |
| NIEDERHORN-93 | 20T11 → 20T13 | Obstruction | kept | PWD_RMP_B15_020_C09 corr_y +46.2, PWD_RMP_B12_019_C09 +33.5, PWD_RMP_B12_020_C09 +28.7 at 20T12 |
| NIEDERHORN-174 | 20T12 → 20T15 | Visibility | kept | PWD_IMP_B08_025_C09 corr_x −6.2 at 14:00 (−8.8 at rolling ±6), PWD_RMP_B15_019_C09 −6.1 at 13:00 |
| NIEDERHORN-95 | 20T12 → 20T23 | Thermal displacement | kept | PWD_IMP_B08_024_C09 corr_x −17.8, PWD_IMP_B07_018_C09 −15.9, e06 +15.8 from the night level (29 target-columns) |
| NIEDERHORN-96 | 20T16 → 20T18 | Obstruction | kept | PWD_RMP_B17_026_C09 corr_y +6.3 at 20T17 with its recognition error up at that measurement (a spike, not the thermal ramp): just over the threshold |
| NIEDERHORN-97 | 20T20 → 20T22 | No data | kept | no measurement at all at 21:00 |
### NIEDERHORN-61, rewritten: 2026-10-13T08:00Z → 2026-10-13T15:00Z
- **Phenomenon of the catalogue**: Rain / visibility drops over the whole scene, without an obstacle (unchanged).
- **Precedents**: none new; the label was validated (review 2026-11-17) on the same reading.
- **Family**: Visibility, unchanged: the whole group of targets degrades together, the references hold.
- **Measured**: the description listed the rejections and "the others fluctuate"; under the new rule the label holds by what the episode does to the curves still measured, so the description now states it (values in the table). The 13:00 train (62) and the plant (60) are named as labelled apart. Bounds, family and cause unchanged; it loses its review field.
- **Images**: none new (the 11:00 thumbnails of the verification).
- **Confidence**: high on the effect, medium on the cause (rain or mist not distinguished).
### NIEDERHORN-169, rewritten: 2026-10-16T11:00Z → 2026-10-16T18:00Z
- **Phenomenon of the catalogue**: Rain / visibility drops over the whole scene (unchanged).
- **Precedents**: NIEDERHORN-61, -164, same station, same family.
- **Family**: Visibility, unchanged.
- **Measured**: the description rested on the rejections at the resumption; it now states the drops of PWD_IMP_B08_025_C09, PWD_RMP_B15_020_C09, PWD_RMP_B17_026_C09, PWD_IMP_B08_024_C09 and e14 at 11:00-12:00 (back at 14:00, read on the values: PWD_IMP_B08_025_C09 corr_x −0.44, −0.01, +0.04 then +0.28 px), PWD_RMP_B15_019_C09 corr_y at 13:00, and the unsettled PWD_RMP_B16_026_C09 and e10 until the afternoon (e10 −18.8 at 16:00). The left-edge targets at 11-13:00 are not named for their deviation there: the rolling level mixes values from before the step (168). Bounds and cause unchanged. No review field before.
- **Confidence**: high on the effect, low on the cause.
## 2. What I left without a label
**Removed by the requalification** (6):
- **NIEDERHORN-59**, 2026-10-13T04:00Z → 06:00Z, Obstruction (lit vehicle, PWD_IMP_B07_017_C09, PWD_RMP_B12_018_C09, PWD_RMP_B15_018_C09 rejected for one measurement): **missing points only**. At rolling ±3, no target beyond 5 noises at 05:00 (largest under 5; the static +7.6 of PWD_RMP_B16_026_C09 and the ±12 +7.9 of PWD_IMP_B08_025_C09 are the level of the day, the 05:00 values lie between their neighbours: B16_026 corr_x 0.374, 0.410, 0.422 px at 04, 05, 06:00).
- **NIEDERHORN-64**, 2026-10-13T16:00Z → 18:00Z, Obstruction (passenger train, e02, e06, e09, PWD_RMP_B17_026_C09 rejected): **missing points only**. The only rolling deviation, PWD_IMP_B07_017_C09 corr_x −7.2 at 17:00, is the trough of the thermal cycle (NIEDERHORN-165), not a spike: its values −0.249, −0.202, −0.039 px at 16, 17, 18:00 put 17:00 between its neighbours, the same smooth trough as PWD_RMP_B12_018_C09 (−0.585, −0.485, −0.403).
- **NIEDERHORN-65**, 2026-10-13T19:00Z → 21:00Z, Obstruction (e02 rejected alone, the underside of a wagon): **missing point only**. At 20:00, e15 (+6.6), PWD_RMP_B17_026_C09 (+6.0) and e09 (+5.4) jump together on corr_x without their recognition error rising (0.06, 0.04, 0.17 as before), while the references PWD_REF09_C09 and PWD_REF11_C09 move apart on corr_x (about −5 and +4 noises): a hesitation of the compensation in the evening thermal return, already under NIEDERHORN-165; a wagon over e02 at the bottom of the image cannot move the left-edge targets and the references on the road.
- **NIEDERHORN-80**, 2026-10-17T04:00Z → 18:00Z, Obstruction (plant in front of PWD_IMP_B07_016_C09): **under the threshold**. Largest rolling ±3 deviation of PWD_IMP_B07_016_C09: corr_y +4.1 at 17:00, corr_x −3.7 at 09:00, −3.6 at 12:00 (with `--k 3`); its two rejections (05:00, 14:00) are missing points. The deviations above 5 against the batch level (corr_x +6.1 at 09:00, corr_y +7.0 at 17:00) are the cold-night drift (170) and the thermal cycle (82), which every target shares that morning.
- **NIEDERHORN-83**, 2026-10-18T06:00Z → 10:00Z, Obstruction (tip of a leaf on PWD_IMP_B07_016_C09, no rejection): **under the threshold**. Largest rolling ±3 deviation: corr_x +4.1 at 09:00, +3.8 at 07:00, corr_y −3.2 at 09:00; against the night level (about −0.23 px at 00-05:00) the 09:00 value +0.089 px is about 4.3 noises.
- **NIEDERHORN-86**, 2026-10-18T20:00Z → 22:00Z, Obstruction (PWD_IMP_B07_016_C09 rejected alone): **missing point only**. No target beyond 5 noises at rolling ±3 at 21:00; PWD_RMP_B17_026_C09 corr_x 0.265, 0.371, 0.300 px at 20, 21, 22:00 is about 4 noises over its neighbours (+6.5 only at rolling ±6, within the thermal return of 85).
**Still under a label but noted**: NIEDERHORN-58 (+5.2) and NIEDERHORN-96 (+6.3) are just over the threshold: kept, since one target exceeds 5 noises; a stricter reading would remove them. In 96, e15 rises over 16-18:00 as a ramp (0.336, 0.460, 0.577 px), not the one-measurement jump the description says; left as is (the label holds, its bounds and text are not touched).
The rest of section 2 of the verification stands (PWD_IMP_B08_024_C09 at 14T03 covered by its Target issue; the night relaxation of the pan; REF11 error at 20T16 and REF09 at 17T12, 18T12 without effect on the curves).
## 3. The documentation
- `labeling-rules.md` section 1 and `families.md` "What is not labeled" gave the rule directly; the request's instruction "`ranges.py` at --k 5, with --rolling under a drift or a thermal cycle" was the key to the plant labels: against the batch level, PWD_IMP_B07_016_C09 crosses 5 noises in 80 and 83 because of the cold-night drift and the thermal cycle, not of the plant.
- Missing in the rule: which level for a thermal label right after a gap (170 has no night before it). I took the nearest calm nights on each side (14-15.10 and 17-18.10), which both give more than 5 noises.
- Missing: a rule for a passage that falls on the steep part of a thermal ramp (64): the rolling median then gives several noises without any spike. Reading the values at the measurement before and after settles it; worth a line in `reading-rules.md`.
- The validator reports 5 overlaps between Obstruction labels (the plant labels and the trains of the same hours): they are two events on different targets, kept as before.
- 167 still refers to the step during the gap as "NIEDERHORN#73", its old id (now NIEDERHORN-168); not changed, since a label that holds is kept exactly.
## Requalification
Commands (from the repository root; outputs in `work/requal/`):
```
python3 tools/scripts/ranges.py data/NIEDERHORN --columns corr_x,corr_y --start 2026-10-10T17:00Z --end 2026-10-21T12:00Z [--rolling 3|6|12] > work/requal/ranges_{static,r3,r6,r12}.txt
python3 scripts/requalify.py <folder> # per label, the targets whose k5 extreme falls inside it, each mode -> work/requal/requalify.txt
python3 tools/scripts/ranges.py ... --rolling 3 --k 3 --sensors PWD_IMP_B07_016_C09 # the plant labels under the threshold
python3 scripts/thermal_night.py <folder> 6 # thermal labels against the level of the 6 h before their start -> work/requal/thermal_night.txt
python3 scripts/values.py T1 T2 SENSORS # values around 13T05, 13T17, 13T20, 15T02, 16T11-19, 17-18.10, 18T21, 20T17
python3 scripts/write_labels.py <folder> # labels.jsonl
python3 labeling/scripts/validate.py <folder>/labels.jsonl # 39 labels, 0 errors, 5 overlaps to look at
```
Values: see the tables of sections 1 and 2. Noises (batch, own noise of `ranges.py`, px): PWD_IMP_B07_016_C09 corr_x 0.074, corr_y 0.12; PWD_RMP_B16_026_C09 corr_y 0.027; e09 corr_x 0.023; PWD_IMP_B08_025_C09 corr_x 0.021; PWD_RMP_B12_018_C09 corr_x 0.027; PWD_RMP_B17_026_C09 corr_x 0.025, corr_y 0.023.
## Difficulties
- My first parser of the `ranges.py` output missed the short sensor names (e01-e15), whose name is followed by spaces; fixed before any decision.
- The thermal test first skipped the instants under the long plant labels, which emptied 69 and 170; the plant labels touch one target, so that target was left out instead.
## Sources read
`instructions/analyst.md`, the request, `labeling/labeling-rules.md` (in full), `labeling/families.md` (sections "A gap", "Target issue", "What is not labeled", and the families table), `tools/GUIDE.md` (ranges, days), `work/requalify_input.jsonl`, the previous `analysis.md` and `report.md` of this folder, `work/inventory.txt` and `inventory.py` (distances, mm/px), `data/NIEDERHORN/` through `tools/scripts/data.py`. Tools: `ranges.py` (static, `--rolling 3/6/12`, `--k 3`, `--outside`), `inventory.py`; my scripts `scripts/requalify.py`, `scripts/thermal_night.py`, `scripts/write_labels.py`, `scripts/values.py` (from the verification).