Labeling processes: lessons from the auto-label reviews (D-130)
- The labeler writes to its own folder (etiquettes.jsonl); labeling/auto/ only holds reviewed labels, merged by /review-auto-labels (new apply script: dated, sorted, checked). - labeling/controle.py also checks a proposed file; the labeler and reviewers run it before handing back. Reviewers keep their measurements in revue.md, never in the labels. - Reviewer instructions explicitly add their scripts, .venv/bin/python and for loops to the lire-les-donnees commands (the contradiction raised by 12 reviews). - Expert validation optional in /review-auto-labels; an expert hint given to the labeler is written in the labels it touches. Cross-review ends with the releveur. - docs/ameliorations-processus.md: 17 entries from this review, by the releveur. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
14ad6ea3f9
commit
7c0cdee8cf
6 files changed
+386
-2
No files matched your search
+5
-2
@@ -2,6 +2,7 @@
|
||||
|
||||
python3 labeling/controle.py # toutes les stations
|
||||
python3 labeling/controle.py NORDEND # une station
|
||||
python3 labeling/controle.py <dossier>/etiquettes-proposees.jsonl # un fichier proposé, avant d'être versé (sans `revue` exigé)
|
||||
|
||||
Erreurs (à corriger) : JSON illisible, champ manquant, famille inconnue, date mal formée, debut >= fin,
|
||||
étiquette sans `revue`, doublon exact, valeur chiffrée, heure locale, "probablement pas un mouvement". « Rien à craindre » n'est juste qu'avec une cause établie : à juger à la lecture, pas par script.
|
||||
@@ -24,7 +25,9 @@ stations = sys.argv[1:] or sorted(os.path.basename(p)[:-6] for p in glob.glob("l
|
||||
erreurs, signales, total = [], [], 0
|
||||
for st in stations:
|
||||
vues, es = set(), []
|
||||
for n, ligne in enumerate(open(f"labeling/auto/{st}.jsonl", encoding="utf-8"), 1):
|
||||
propose = st.endswith(".jsonl") # un fichier proposé : sa ligne n'a pas encore `revue`
|
||||
chemin = st if propose else f"labeling/auto/{st}.jsonl"
|
||||
for n, ligne in enumerate(open(chemin, encoding="utf-8"), 1):
|
||||
if not ligne.strip():
|
||||
continue
|
||||
total += 1
|
||||
@@ -33,7 +36,7 @@ for st in stations:
|
||||
e = json.loads(ligne)
|
||||
except json.JSONDecodeError:
|
||||
erreurs.append(f"{ou} JSON illisible"); continue
|
||||
manque = {"debut", "fin", "categorie", "description", "revue"} - e.keys()
|
||||
manque = ({"debut", "fin", "categorie", "description"} | (set() if propose else {"revue"})) - e.keys()
|
||||
if manque:
|
||||
erreurs.append(f"{ou} champ manquant : {sorted(manque)}")
|
||||
if e.get("categorie") not in FAMILLES:
|
||||
|
||||
Reference in new issue
Block a user