- 32 analyses: each label kept, rewritten or removed by its analyst (section Requalification of the report; mm magnitudes where the targets have them) - SNCF01 x3, WILDSTRUBEL 2026-09-01 -> 2026-10-06 x3: verified from their existing labels under the new rules - long labels (no analysis): auto/analyses/long-labels/<STATION>/; NORDEND-169 and -195 run to 07/11, so NORDEND-283 and -284 (their continuation) are removed - reading-rules.md, stations.md: the citations of removed or rewritten labels point to their successor, or to [expert] Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
113 lines
16 KiB
Markdown
113 lines
16 KiB
Markdown
# Labels: LENZSPITZE, 2026-10-16T02:35Z → 2026-10-23T23:55Z (UTC)
|
||
|
||
Request: requalify the 50 labels of this analysis (`work/requalify_input.jsonl`) under the new rule of `labeling/labeling-rules.md`, section 1: only what stands out from the noise of the corrected curves is labelled (at least one target beyond 5 of its own noises; thermal only when the corrected curves keep it; missing points not labelled for themselves; No data only when the station delivers nothing). Not a new reading: no new event searched, no bound moved. The reading of the range (method, weather, images, precedents) is that of the previous version of this file, summarised below where it matters; the scripts and outputs of that reading stay in `scripts/` and `work/`.
|
||
|
||
Result: **46 labels** in `labels.jsonl`: 45 kept exactly as they were (start, end, family, description, review), 1 rewritten (LENZSPITZE-82), 4 removed (LENZSPITZE-79, 80, 81, 88).
|
||
|
||
Context kept from the reading: weather from MeteoSwiss Pully (8.9 km, 456 m): rain on 17/10 afternoon and evening, 18/10 from late morning, 21/10 night to late morning and showers after, 23/10 morning and evening; dry and sunny 16/10 and 22/10; dry and overcast 19–20/10. Targets: only 1023 (about 12 m from the camera, 4.56 mm/px) and 1024 (about 12 m, 4.27 mm/px) have a sure mm factor; the other targets have two disagreeing lines in `targets.csv` (`?(2)`), so no mm; they lie from about 64 m (1001, 1002) down to about 16 m (1021, 1022); 1020 at about 21 m. Only `temperature_deg_c` is filled (the housing temperature).
|
||
|
||
## 1. My labels
|
||
|
||
The kept labels are unchanged; what justifies each is its measured deviation, in the table below (the full description of each was justified in the previous version of this analysis). Measures (section "Requalification"): `ranges.py --k 5` on corr_x, corr_y, level and noise outside the label (`--outside`), plain (`P`) and with `--rolling 12` (`R`, twelve measurements on each side; used for the brief events, under a thermal cycle or a visibility episode); for the thermal labels, the hourly median of the corrected curve against the level of the night before (`T`, `scripts/thermal.py`). "Max" is the target farthest from its level inside the label, in its own noises.
|
||
|
||
| Id | Bounds | Family | Verdict | Max deviation (target, column, noises, instant) |
|
||
|---|---|---|---|---|
|
||
| LENZSPITZE-1 | 16/10 02:35 → 06:40 | Visibility | kept | 201B corr_x +26, 202H corr_x +16, 101B corr_x +14 (3-point median against the evening of 16/10, `work/requalify_label1.txt`); R: 7013H corr_x −64 at 06:30 |
|
||
| LENZSPITZE-2 | 16/10 02:55 → 04:00 | No data | kept | no measurement of any sensor at the missing instants (inventory: 02:55–03:10, 03:10–03:40, 03:40–03:50, 03:50–04:00) |
|
||
| LENZSPITZE-3 | 16/10 06:05 → 06:40 | No data | kept | 4 + 1 instants absent, all sensors |
|
||
| LENZSPITZE-4 | 16/10 06:30 → 22:30 | Thermal displacement | kept | T: 1020 corr_y −60 (hour 11), 1020 corr_x +27 |
|
||
| LENZSPITZE-72 | 16/10 07:30 → 08:00 | Obstruction | kept | R: 1008 corr_x +24 (07:50), 1010 corr_y −24 (07:40) |
|
||
| LENZSPITZE-6 | 16/10 11:00 → 16:15 | Visibility | kept | R: 32 targets beyond 5; 7013H corr_y −69 (13:30) |
|
||
| LENZSPITZE-7 | 16/10 14:20 → 14:30 | No data | kept | one instant absent, all sensors |
|
||
| LENZSPITZE-73 | 16/10 22:25 → 17/10 05:05 | Visibility | kept | R: 1022 corr_x +22 (03:30), 102H corr_y −20 (03:50), 201B corr_y −18 |
|
||
| LENZSPITZE-9 | 17/10 05:00 → 05:05 | Obstruction | kept | R: 1009 corr_y +14, 1020 corr_y −13 (05:01), 8 targets |
|
||
| LENZSPITZE-10 | 17/10 05:30 → 18:45 | Thermal displacement | kept | T: 1020 corr_y −40 (hour 10), 1020 corr_x +31 |
|
||
| LENZSPITZE-74 | 17/10 09:00 → 09:45 | Obstruction | kept | R: 1022 corr_x −48 (09:01), still −26 at 09:30 |
|
||
| LENZSPITZE-75 | 17/10 10:00 → 10:55 | Obstruction | kept | R: 1012 corr_x +29 (10:05), 1010 corr_x +26 |
|
||
| LENZSPITZE-13 | 17/10 10:55 → 17:30 | Visibility | kept | R: 1023 corr_y +218 (14:05) |
|
||
| LENZSPITZE-14 | 17/10 11:50 → 12:00 | Obstruction | kept | R: 102H corr_x +10, 7013H corr_y −9 (11:55), 10 targets |
|
||
| LENZSPITZE-76 | 17/10 17:30 → 18/10 01:30 | Visibility | kept | R: 1023 corr_y +185 (22:10) |
|
||
| LENZSPITZE-77 | 18/10 05:05 → 06:35 | Visibility | kept | R: 102H corr_y −34, 7013H corr_x −33 (05:30), 101B corr_x +29 |
|
||
| LENZSPITZE-78 | 18/10 08:00 → 19/10 07:10 | Visibility | kept | R: 1023 corr_y +202 (09:00), 1019 corr_x +143 |
|
||
| LENZSPITZE-17 | 19/10 07:00 → 20/10 06:45 | Thermal displacement | kept | T: 1020 corr_y −49 (hour 09) |
|
||
| LENZSPITZE-18 | 19/10 07:40 → 10:30 | Visibility | kept | R: 7013H corr_x −34, 1009 corr_x −34 (09:25–09:30) |
|
||
| LENZSPITZE-19 | 19/10 07:55 → 08:01 | Obstruction | kept | R: 1001 corr_x −9, 1005 corr_x −9 (08:00) |
|
||
| LENZSPITZE-20 | 19/10 09:05 → 10:10 | No data | kept | 8 instants absent, all sensors |
|
||
| LENZSPITZE-82 | 19/10 13:45 → 13:55 | Obstruction | **rewritten** | R: 1008 corr_x +5.7, 102H corr_y −5.1 (13:50); P: 1008 +7.1 |
|
||
| LENZSPITZE-21 | 19/10 20:45 → 21:40 | No data | kept | 6 instants absent, all sensors |
|
||
| LENZSPITZE-83 | 20/10 05:00 → 06:25 | Visibility | kept | R: 1015 corr_y +59 (05:20), 1023 corr_y +44, 1013 corr_x +39 |
|
||
| LENZSPITZE-22 | 20/10 06:15 → 06:25 | No data | kept | one instant absent, all sensors |
|
||
| LENZSPITZE-23 | 20/10 06:45 → 18:30 | Thermal displacement | kept | T: 1020 corr_y −121 (hour 11) |
|
||
| LENZSPITZE-24 | 20/10 06:50 → 07:00 | Obstruction | kept | R: 1007 corr_x −33, 1005 corr_x −29 (06:55), 15 targets |
|
||
| LENZSPITZE-84 | 20/10 11:10 → 11:20 | Displacement | kept | R: 7013B corr_x −17, 1019 corr_x −17 (11:15), 14 targets |
|
||
| LENZSPITZE-25 | 20/10 12:00 → 12:10 | Obstruction | kept | R: 1007 corr_x −7.0, 1001 −6.9, 1011 −5.9 (12:05), 6 targets together |
|
||
| LENZSPITZE-85 | 20/10 13:25 → 13:50 | Obstruction | kept | R: 102H corr_y −31 (13:40), 1016 corr_x +9 |
|
||
| LENZSPITZE-86 | 20/10 15:00 → 15:20 | Obstruction | kept | R: 1019 corr_x +84 (15:10), 1013 corr_x +42 |
|
||
| LENZSPITZE-26 | 20/10 17:05 → 21/10 01:05 | Visibility | kept | R: 1013 corr_x +48 (17:35), 1019 corr_x +44 |
|
||
| LENZSPITZE-87 | 21/10 01:00 → 11:35 | Visibility | kept | R: 1023 corr_y +233 (08:05) |
|
||
| LENZSPITZE-28 | 21/10 08:50 → 09:00 | Obstruction | kept | R: 1001 corr_x −9.2, 102H corr_y −8.2 (08:55), noise taken inside the visibility episode |
|
||
| LENZSPITZE-29 | 21/10 10:30 → 14:00 | Thermal displacement | kept | T: 1020 corr_y −0.031 px = −21 noises (11:45–13:10 against the calm night 19→20; −2.3 against the rainy night 20→21, whose noise is inflated); 1020 corr_x +6.6 against 20→21 |
|
||
| LENZSPITZE-30 | 21/10 13:15 → 22/10 08:00 | Visibility | kept | R: 1023 corr_y +218 (14:05) |
|
||
| LENZSPITZE-31 | 22/10 03:35 → 03:45 | Obstruction | kept | R: 1016 corr_x −39, 1023 corr_x −30 (03:40), 21 targets |
|
||
| LENZSPITZE-32 | 22/10 07:30 → 19:10 | Thermal displacement | kept | T: 1020 corr_y −52 (hour 10), 1020 corr_x +38 |
|
||
| LENZSPITZE-33 | 22/10 07:40 → 15:20 | Visibility | kept | R: 1011 corr_x −39, 1022 corr_x +38 (08:40) |
|
||
| LENZSPITZE-34 | 22/10 19:40 → 23/10 04:40 | Visibility | kept | R: 1013 corr_x +26 (02:25), 8010 corr_x +15 (22:45) |
|
||
| LENZSPITZE-35 | 23/10 02:20 → 13:15 | Visibility | kept | R: 1023 corr_y +142 (10:40) |
|
||
| LENZSPITZE-36 | 23/10 11:15 → 15:30 | Thermal displacement | kept | T: 1020 corr_y −37 (hour 14), 1021 corr_x +40 |
|
||
| LENZSPITZE-89 | 23/10 13:30 → 13:45 | Obstruction | kept | R: 1022 corr_y +22, 1022 corr_x −17 (13:35), 1008 corr_x +12 |
|
||
| LENZSPITZE-37 | 23/10 14:01 → 14:30 | Visibility | kept | R: 1023 corr_y +99 (14:05), 1019 corr_x +25 |
|
||
| LENZSPITZE-38 | 23/10 15:00 → 23:55 | Visibility | kept | R: 1023 corr_x −260 (22:10) |
|
||
| LENZSPITZE-39 | 23/10 16:55 → 17:01 | Obstruction | kept | R: 1017 corr_x +8.8, 201B corr_x +8.4 (17:00) |
|
||
|
||
### 2026-10-19T13:45Z → 2026-10-19T13:55Z (LENZSPITZE-82, rewritten)
|
||
- **Phenomenon of the catalogue**: A pass-by hides the targets for the length of one measurement (here a reference); A reference dropped: the base changes
|
||
- **Precedents**: none consulted for the requalification; the label itself and LENZSPITZE-85 (92H hidden on 20/10, the targets shift together).
|
||
- **Family**: Obstruction, unchanged: the flux of 8014 alone is cut, the other sensors intact (`families.md`, "A hindered reference").
|
||
- **Measured**: at 13:50, 8014 rejected; `ranges.py --rolling 12`: 1008 corr_x +5.7 noises, 102H corr_y −5.1, then 1015, 201B, 1004 at −3 to −4, all at this instant only; in a four-hour window around (`scripts/neighbours.py`), no other instant takes 1008 or 102H as far. The old description said "the targets do not jump": a small common jump stands just beyond the noise. Description rewritten on that effect; it loses no review (it had none).
|
||
- **Images**: 14:00 (from the reading): nothing in front of 8014.
|
||
- **Confidence**: medium: the effect is at the threshold.
|
||
|
||
## 2. What I left without a label
|
||
|
||
Removed labels (all four are a reference rejected for one measurement, its flux cut, a missing point; the rule keeps them only if the episode moves the other curves beyond the noise):
|
||
|
||
- **LENZSPITZE-79**, 2026-10-19T05:45Z → 05:55Z, Obstruction (8014 hidden at 05:50, inside the reduced visibility LENZSPITZE-78). Only 1013 passes 5 noises (corr_y −8.7 with `--rolling 12`, −8.2 plain); 1013 is the target that stays dark and shifted all that night (LENZSPITZE-78), and in the 2.5 h around, three other instants take it as far: its own agitation, not the base change. No other target beyond 4.6 noises. Removed: missing point only.
|
||
- **LENZSPITZE-80**, 2026-10-19T07:35Z → 07:45Z, Obstruction (8014 hidden at 07:40, at the start of the turbulence LENZSPITZE-18). `--rolling 12` with the noise of the window (calmer night included): 1009 corr_x +6.5, four targets at 5.2–5.6; against the agitation of the three hours around, the largest is 4.6 noises (1017) and each of these targets reaches as far at five to fourteen other instants. The deviation is that of the turbulence, already labelled (LENZSPITZE-18); the label's own description said "the targets move only with the turbulence". Removed: missing point only.
|
||
- **LENZSPITZE-81**, 2026-10-19T12:55Z → 13:05Z, Obstruction (92H hidden at 13:00, under the thermal cycle LENZSPITZE-17). `--rolling 12`: no target beyond 5 noises; the largest 1003 corr_y +4.8, 7013H +4.4, 1015 +4.3, 1016 +4.2 (a small common shift under the threshold); the reference 8019 +5.2. Plain: 1003 +5.8, 1015 +5.4 (the plain level is skewed by the thermal cycle, hence `--rolling`). Removed: under the threshold.
|
||
- **LENZSPITZE-88**, 2026-10-21T11:35Z → 11:45Z, Obstruction (92H hidden at 11:40, just after LENZSPITZE-87). `--rolling 12`: no target beyond 5 noises (the reference 8019 +6.8); in the three hours around, the largest is 3.3 noises (1023) and nine other instants as far. The plain run gives 1013 corr_x −19, but that is the tail of 1013 coming back from LENZSPITZE-87, not a jump at 11:40. Removed: missing point only.
|
||
|
||
Borderline, said for the reader: LENZSPITZE-81 (removed, 4.8 noises) and LENZSPITZE-82 (kept, 5.7 noises) are the same phenomenon at the same size, one on each side of the threshold with the prescribed measure (`--rolling` under the thermal cycle). In a four-hour window with my own noise estimate, 81 reaches 6.4 (7013H) and 82 5.7: the decision depends on the window over which the noise is computed. I applied the measure of the instruction.
|
||
|
||
What was already left without a label in the reading (1006 and 1009 sitting slightly higher on 16/10 and 19–20/10; single-target excursions of 8 to 15 noises on 19/10 11:15 and 21/10 13:00–13:10; rejections of 8004, 8014, 8012 inside the visibility episodes) stays without a label: either under existing labels, or single isolated points.
|
||
|
||
The No data labels: LENZSPITZE-2, 20 and 21 hold measurements inside them (16/10 03:10, 03:40, 03:50; 19/10 09:25, 09:45; 19/10 21:05–21:15). Every missing instant has no measurement of any sensor (the station delivers nothing), so they hold; their cutting around the isolated measurements is not a question of this requalification (no bound moved).
|
||
|
||
## Requalification
|
||
|
||
Commands (from the root of aimsight-app; outputs in `work/`):
|
||
|
||
- `python3 labeling/auto/analyses/LENZSPITZE_2026-10-16T0235_2026-10-23T2355/scripts/requalify.py work/requalify_input.jsonl plain` → `work/requalify_plain.txt`: for each label, `tools/scripts/ranges.py data/LENZSPITZE --columns corr_x,corr_y --k 5 --merge 0min --start <label − margin> --end <label + margin> --outside <start>/<end>` (margin: 8 h for thermal, the label's length and at least 3 h otherwise), ranges overlapping the label.
|
||
- Same with `12` → `work/requalify_rolling12.txt`: `--rolling 12` added (margin twice the length, at least 3 h); the measure used for the brief labels.
|
||
- `.venv/bin/python scripts/thermal.py work/requalify_input.jsonl [1020]` → `work/requalify_thermal.txt`, `work/requalify_thermal_1020.txt`: hourly median of corr within each thermal label against the night before (20:00–03:00), in the noise of that night.
|
||
- `scripts/neighbours.py START END INSTANT targets` → `work/requalify_neighbours.txt`, `work/requalify_neighbours2.txt`: rolling deviation of every target at the label's instant, and how many instants of the window reach as far (79, 80, 81, 82, 88).
|
||
- `ranges.py … --k 3 --rolling 12 --start 2026-10-19T09:55Z --end 2026-10-19T16:05Z --outside 2026-10-19T12:55Z/2026-10-19T13:05Z`: values under 5 at 81 and 82.
|
||
- An inline script for LENZSPITZE-1 (3-point median against the evening of 16/10, `work/requalify_label1.txt`) and LENZSPITZE-29 (against three nights).
|
||
- `python3 labeling/scripts/validate.py labels.jsonl`: 46 labels, 0 errors, 3 overlaps between Visibility labels (LENZSPITZE-26/87, 30/33, 34/35), all already there in the verified labels; bounds not moved.
|
||
|
||
Values: see the table of section 1 and the list of section 2.
|
||
|
||
## 3. The documentation
|
||
|
||
- `labeling-rules.md` section 1 and `families.md` ("A gap", "What is not labeled") gave the rule directly; the requalification instruction gave the tool (`ranges.py --k 5`, `--rolling` under a cycle).
|
||
- What was missing: on which window the own noise is computed for a single-measurement event. With `--outside`, the noise of `ranges.py` comes from the whole window around; a calm night in it lowers the noise, an episode of turbulence or rain raises it, and a one-measurement effect of 4 to 7 noises (81, 82, 80) falls on one side or the other depending on it. A rule ("noise over the same image regime, e.g. the hour or three hours around, outside the label") would make the threshold reproducible.
|
||
- Also missing: whether a deviation of a target inside another labelled nuisance (1013 dark under LENZSPITZE-78, the turbulence of LENZSPITZE-18) counts for the brief label that falls on it. I judged it against the instants around: if the target reaches as far elsewhere in the same nuisance, the deviation belongs to that nuisance.
|
||
- The thermal rule "beyond 5 noises from the night level" depends on which night: on 21/10 the night before was rainy (inflated noise, shifted level); against a calm night, 1020 stays far beyond the threshold in noises, though small in px. Said in the table.
|
||
|
||
## Difficulties
|
||
|
||
- `ranges.py` run 100 times on the whole station takes more than ten minutes; the loop was run in the background.
|
||
|
||
## Sources read
|
||
|
||
`instructions/analyst.md`, the request, `tools/GUIDE.md`, `tools/DATA.md`, `labeling/families.md`, `labeling/labeling-rules.md`, `labeling/reading-rules.md`, `labeling/stations.md`, `work/requalify_input.jsonl`, the previous `analysis.md` and `report.md` of this folder, `tools/scripts/data.py` (the `load` function), `data/LENZSPITZE/` through `inventory.py`, `ranges.py` and my scripts.
|