Files
aimsight-labeling/auto/analyses/NORDEND_2026-08-23T0515_2026-09-04T0615/scripts/thermal_nights.py
T
maximeandClaude Opus 5.5 ddb17c2189 auto: labels requalified under the 5-noise rules (only what stands out from the noise): 32 analyses refined, the 6 paused periods verified, the long labels requalified with the fixes the period analysts found; 1153 -> 961 labels
- 32 analyses: each label kept, rewritten or removed by its analyst (section Requalification of the report; mm magnitudes where the targets have them)
- SNCF01 x3, WILDSTRUBEL 2026-09-01 -> 2026-10-06 x3: verified from their existing labels under the new rules
- long labels (no analysis): auto/analyses/long-labels/<STATION>/; NORDEND-169 and -195 run to 07/11, so NORDEND-283 and -284 (their continuation) are removed
- reading-rules.md, stations.md: the citations of removed or rewritten labels point to their successor, or to [expert]

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-17 23:58:00 +01:00

39 lines
2.2 KiB
Python

"""Weak thermal labels: per target, hourly median of corr (instants inside non-thermal labels left out) minus a
night level (median of 3 h of a given night), in the target's batch noise (ranges.py, k 5 rolling 8, noise column).
Usage: python3 thermal_nights.py labels.jsonl ranges_roll8.txt ID NIGHT_START [ID NIGHT_START ...]"""
import sys, json, re, statistics
from datetime import timedelta
sys.path.insert(0, "tools/scripts"); import data
labs = {json.loads(l).get("id"): json.loads(l) for l in open(sys.argv[1])}
noise = {}; col = None
for line in open(sys.argv[2]):
m = re.match(r"== (corr_[xy]):", line)
if m: col = m.group(1); continue
if line.startswith("corr_"): col = None; continue
f = line.split()
if col and len(f) >= 4 and f[0] != "sensor":
try: noise[(col, f[0])] = float(f[3])
except ValueError: pass
OTHER = [(data.parse_time(l["start"]), data.parse_time(l["end"])) for l in labs.values() if l["family"] not in ("Thermal displacement", "No data")]
excl = lambda t: any(a < t < b for a, b in OTHER)
by = data.load("data/NORDEND")
for ms in by.values():
for m in ms: m["t"] = m["t"].replace(second=0, microsecond=0)
tg = [s for s in by if s not in ("CTR02", "CTR03", "CTR04", "PR04")]
a = sys.argv[3:]
for i in range(0, len(a), 2):
l = labs[a[i]]; N = data.parse_time(a[i + 1]); S, E = data.parse_time(l["start"]), data.parse_time(l["end"])
res = []
for c in ("corr_x", "corr_y"):
for s in tg:
night = [m[c] for m in by[s] if N <= m["t"] <= N + timedelta(hours=3) and m[c] is not None and not excl(m["t"])]
if len(night) < 4: continue
lv = statistics.median(night); hours = {}
for m in by[s]:
if S <= m["t"] <= E and m[c] is not None and not excl(m["t"]):
hours.setdefault(m["t"].replace(minute=0), []).append(m[c])
for h, v in hours.items():
if len(v) >= 3: res.append(((statistics.median(v) - lv) / noise[(c, s)], s, c, h))
res.sort(key=lambda x: -abs(x[0]))
print(a[i], "night from", a[i + 1], "max", f"{abs(res[0][0]):.1f}", "|", " ".join(f"{s}.{c[-1]} {d:+.1f}@{h:%d %H}h" for d, s, c, h in res[:6]))