maximeandClaude Opus 5.5 81908ca370 Pumping of the differential images: extraction/pump_diff.sh into data_diff/<SERIAL>/, in the tree of data/ (never data/ itself)
The OPTICAL_SHIFT-DIFF images full size, with what measuring them again needs under images_diff/ (index of every
measurement per day with its exact time and why an image is missing, sensors.json with every pattern archived
included, unit.json), and the metrics, IRON images, weather and targets.csv as pump.py and weather.py write them into
data/. Its own lock and log; a day is indexed last, and not when its metrics failed; --min-free-gb. pump_metrics now
returns whether every day succeeded; weather.py takes --data. Tried on JUNGFRAU 2026-09-01 and 2026-10-12..16: DIFF
images byte-identical to pump.py --diff, metrics, IRON and weather byte-identical to data/.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-19 09:59:50 +01:00

aimsight-data

The data of the AIMsight stations, in a single copy on the workstation, and their pumping.

  • data/<SERIAL>/: filled by the pumping, out of git (metrics/, displacement/, camera/, images/, weather/ for a station with a Swiss position…). A lost folder is pumped again.
  • extraction/: the pumping, read-only on the platform; how to use it: extraction/README.md. VS Code tasks "pump" and "pump a range". extraction/pumping.py: the tracked stations, launching the pumping and its state, for the callers (aimsight-app, page Stations).
  • weather/: the weather measured by MeteoSwiss at a place over a past range (weather/meteoswiss.py), written into data/<SERIAL>/weather/ at each pumping (extraction/weather.py); its doc in weather/README.md.
  • .env: the credentials of the database and of S3, at the root, never versioned.

The other repositories (aimsight-app, Optimizer) read the data through a link data -> ~/aimsight-data/data, ignored by git. The methods that bring data in live here; the app only calls them. Pumping is done from here only: the lock out/pump.lock holds for this folder alone.

The labels are in the neighbouring repository ~/aimsight-labeling.

Extracted from aimsight-app on 2026-11-13 (commit 462ba9e); the earlier history of the pumping is in Support-Agent.

S
Description
Données des stations AIMsight (hors de git) et leur pompage
Readme
229 KiB
0 Stars 1 Watchers 0 Forks
Languages
Python 96%
Shell 4%