- Every station's auto labels reviewed by an analyst (/review-auto-labels), then a cross-review per family across all stations (new skill /cross-review-labels), a finishing pass, and descriptions rewritten in words (no numeric values). - The three never-labeled ranges (WILDSTRUBEL 07/09-01/10, NORDEND 16/08-01/10) labeled and reviewed: 991 auto labels on 11 stations, labeling/controle.py at 0 errors. - Labeling knowledge gathered in labeling/: regles-d-etiquetage.md (new), familles.md (settled boundaries), connaissances/ (notes moved from docs/, links updated), the label map rebuilt from reviewed labels, events and cases; events tied to their stations (PS_DES_COUDRES is JUNGFRAU). The labeler and reviewers read only labeling/. - labels-map reads auto labels and events; decision D-130; living plan points 73-75. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
22 lines
1.3 KiB
Python
22 lines
1.3 KiB
Python
"""Épisodes de rejets (capteurs hors --sauf) : suites d'instants avec au moins un rejet, coupées par un écart de plus de GAP minutes.
|
|
Par épisode : premier et dernier instant rejeté, nombre d'instants, capteurs et leur nombre de rejets. NORDEND 16/08-09/09.
|
|
Usage : python3 labeling/auto/etiqueteur/NORDEND_2026-08-16/outils/episodes.py [SAUF=PR04] [GAP=60]"""
|
|
import csv, glob, sys
|
|
from collections import defaultdict, Counter
|
|
from datetime import datetime, timedelta
|
|
sauf = set(sys.argv[1].split(",")) if len(sys.argv) > 1 else {"PR04"}
|
|
gap = timedelta(minutes=int(sys.argv[2]) if len(sys.argv) > 2 else 60)
|
|
R = defaultdict(list)
|
|
for p in sorted(glob.glob("data/NORDEND/displacement/NORDEND_advanced_*.csv")):
|
|
if "20260816" <= p[-12:-4] <= "20260908":
|
|
for r in csv.DictReader(open(p)):
|
|
if float(r["error_value"]) > float(r["error_threshold"]) and r["sensor_name"] not in sauf:
|
|
R[datetime.fromisoformat(r["time_utc"][:16])].append(r["sensor_name"])
|
|
ts = sorted(R)
|
|
ep = [[ts[0]]]
|
|
for a, b in zip(ts, ts[1:]):
|
|
(ep[-1].append(b) if b - a <= gap else ep.append([b]))
|
|
for e in ep:
|
|
c = Counter(s for t in e for s in R[t])
|
|
print(f"{e[0]:%d/%m %H:%M} → {e[-1]:%d/%m %H:%M} {len(e):3d} inst " + " ".join(f"{k}:{v}" for k, v in c.most_common()))
|