Auto labels reviewed per station and cross-reviewed; all labeling knowledge in labeling/ (D-130)
- Every station's auto labels reviewed by an analyst (/review-auto-labels), then a cross-review per family across all stations (new skill /cross-review-labels), a finishing pass, and descriptions rewritten in words (no numeric values). - The three never-labeled ranges (WILDSTRUBEL 07/09-01/10, NORDEND 16/08-01/10) labeled and reviewed: 991 auto labels on 11 stations, labeling/controle.py at 0 errors. - Labeling knowledge gathered in labeling/: regles-d-etiquetage.md (new), familles.md (settled boundaries), connaissances/ (notes moved from docs/, links updated), the label map rebuilt from reviewed labels, events and cases; events tied to their stations (PS_DES_COUDRES is JUNGFRAU). The labeler and reviewers read only labeling/. - labels-map reads auto labels and events; decision D-130; living plan points 73-75. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
8e1cfc52c9
commit
35b5ed4d74
298 files changed
+30413
-960
No files matched your search
@@ -1,36 +1,51 @@
|
||||
"""Contrôle de la carte des étiquettes face à labeling/manual/*.jsonl (skill labels-map).
|
||||
"""Contrôle de la carte des étiquettes (skill labels-map).
|
||||
|
||||
python3 .claude/skills/labels-map/controle.py
|
||||
Rend : clés citées inconnues, étiquettes revues absentes, où chaque étiquette est citée,
|
||||
les chiffres hors clés (à justifier un par un : nom de capteur, heure d'une image).
|
||||
Rend : clés citées inconnues (ni étiquette de l'expert, ni automatique), events cités inconnus,
|
||||
étiquettes revues de l'expert absentes, où chaque étiquette de l'expert est citée,
|
||||
les chiffres hors clés et hors comptes « et N autres » (à justifier un par un : nom de capteur, heure d'une image).
|
||||
Les étiquettes automatiques ne sont citées qu'en exemples : leur absence n'est pas une erreur.
|
||||
"""
|
||||
import glob
|
||||
import json
|
||||
import os
|
||||
import re
|
||||
|
||||
CLE = r"[A-Z][A-Z_]{3,} \d\d\.\d\d \d\d:\d\d"
|
||||
CLE = r"[A-Z][A-Z0-9_]{3,} \d\d\.\d\d \d\d:\d\d"
|
||||
EVENT = r"E-\d{3}"
|
||||
|
||||
|
||||
def cle(station, debut):
|
||||
return f"{station} {debut[8:10]}.{debut[5:7]} {debut[11:16]}"
|
||||
|
||||
|
||||
revues = {}
|
||||
for chemin in sorted(glob.glob("labeling/manual/*.jsonl")):
|
||||
station = os.path.basename(chemin)[: -len(".jsonl")]
|
||||
for ligne in open(chemin, encoding="utf-8"):
|
||||
e = json.loads(ligne)
|
||||
revues[cle(station, e["debut"])] = "revue" in e
|
||||
def lire(motif):
|
||||
cles = {}
|
||||
for chemin in sorted(glob.glob(motif)):
|
||||
station = os.path.basename(chemin)[: -len(".jsonl")]
|
||||
for ligne in open(chemin, encoding="utf-8"):
|
||||
if ligne.strip():
|
||||
e = json.loads(ligne)
|
||||
cles[cle(station, e["debut"])] = "revue" in e
|
||||
return cles
|
||||
|
||||
|
||||
expert = lire("labeling/manual/*.jsonl")
|
||||
auto = lire("labeling/auto/*.jsonl")
|
||||
events = set(re.findall(EVENT, open("events/INDEX.md", encoding="utf-8").read()))
|
||||
|
||||
carte = open("labeling/carte-des-etiquettes.md", encoding="utf-8").read()
|
||||
citees = set(re.findall(CLE, carte))
|
||||
print("Clés inconnues :", sorted(citees - set(revues)) or "aucune")
|
||||
print("Revues absentes :", [k for k, r in revues.items() if r and k not in citees] or "aucune")
|
||||
print("Clés inconnues :", sorted(citees - set(expert) - set(auto)) or "aucune")
|
||||
print("Events inconnus :", sorted(set(re.findall(EVENT, carte)) - events) or "aucun")
|
||||
print("Revues de l'expert absentes :", [k for k, r in expert.items() if r and k not in citees] or "aucune")
|
||||
print("Automatiques citées :", len(citees & set(auto)), "sur", len(auto))
|
||||
sections = re.split(r"\n(?=#{2,4} )", carte)
|
||||
for k in sorted(revues):
|
||||
for k in sorted(expert):
|
||||
titres = [s.splitlines()[0].lstrip("# ")[:40] for s in sections if k in s]
|
||||
print(f" {k}{'' if revues[k] else ' (non revue)'} : {' | '.join(titres)}")
|
||||
print(f" {k}{'' if expert[k] else ' (non revue)'} : {' | '.join(titres)}")
|
||||
reste = re.sub(CLE, "", carte)
|
||||
reste = re.sub(EVENT, "", reste)
|
||||
reste = re.sub(r"et \d+ autres?\s*:[^)\n]*", "", reste)
|
||||
print("Chiffres hors clés :", sorted(set(re.findall(r"\S*\d\S*", reste))))
|
||||
print(len(carte.splitlines()), "lignes")
|
||||
Reference in new issue
Block a user