1 parent
887b313ba2
commit
7e3043d3a0
2 files changed
+10
-4
No files matched your search
+9
-3
@@ -1,8 +1,11 @@
|
||||
"""Detector of the No data family (the families document): moments without a measurement (the cadence of the "advanced"
|
||||
export is broken).
|
||||
|
||||
Cadence: median gap between two measurement instants, all sensors together. A hole: more than MISSING missing steps
|
||||
between two measurements (gap > MISSING + 1 cadences); the episode runs from the last measurement to the next one.
|
||||
Cadence: median gap between two measurement instants, all sensors together; at least an hour divided by the median
|
||||
number of instants of the clock hours that have one: a station measuring in bursts (three measurements a minute apart
|
||||
every 15 min) has a median gap of a minute, but a cycle of 5 min; at the median gap, every gap between two bursts was a
|
||||
hole, a whole day of No data (wf-improve, batch 2026-11-05, S1). A hole: more than MISSING missing steps between two
|
||||
measurements (gap > MISSING + 1 cadences); the episode runs from the last measurement to the next one.
|
||||
End of the window read (end, when the caller gives it: the chunked run of categories.py): the same rule between the last
|
||||
measurement and end, the episode running up to end (CLARIDEN, batch 01: 44 h without a measurement up to the end of
|
||||
the batch, not reported). No measurement in the export does not mean the station stopped: the text only says that the
|
||||
@@ -30,7 +33,10 @@ def detect(measurements, end=None):
|
||||
if len(ts) < 3:
|
||||
return []
|
||||
gaps = [(b - a).total_seconds() for a, b in zip(ts, ts[1:])]
|
||||
step = statistics.median(gaps)
|
||||
per_hour = {}
|
||||
for t in ts:
|
||||
per_hour[t.replace(minute=0)] = per_hour.get(t.replace(minute=0), 0) + 1
|
||||
step = max(statistics.median(gaps), 3600 / statistics.median(per_hour.values())) # bursts: the cycle
|
||||
out = [(a, b, g, "") for a, b, g in zip(ts, ts[1:], gaps)]
|
||||
if end: # end excluded: the last expected measurement is at end − 1 step, the gap counts as between two measurements
|
||||
out.append((ts[-1], end, (end - ts[-1]).total_seconds(), ", up to the end of the period"))
|
||||
|
||||
Reference in new issue
Block a user