Repository navigation
Environment: import in-situ temperature loggers - #94
Merged
Merged
Conversation
- loggers.ts reads raw HOBO (English/French, comma/tab, UTF-8/Mac Roman) and EnvLogger CSVs anywhere under DATA_DIR, converting every reading to Moorea local time; app logs, empty downloads and unknown CSVs are skipped. - insitu.ts assigns each file to a nursery (download GPS, logger name, register workbook, file name or the workbooks' HOBO log), trims deployment edges, drops implausible readings, merges repeated downloads and builds site-hourly, daily (>= 18 h) and diel tables. - The EnvLogger register is recognised by its header before the GPS/location file-name rule, so it no longer floods Data quality. - sets.insitu_temp: logger temperature during each set (Drivers variable). - Water quality: logger section (stats, nursery vs offshore SST, daily cycle, daily maximum by nursery, coverage); nursery profiles get their own temperature and daily-cycle charts; new live finding. - CSVs are part of the import fingerprint; IMPORTER_VERSION 4. - Synthetic HOBO + EnvLogger fixtures, parser unit tests, docs. Closes #10 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The light-peak clock check raised false alarms: HOBO 7 and 11 peak in light at 17:00 and 07:00 because of shading, yet their temperature cycles line up hour for hour with their partner loggers. Replace it with a check of each download's hourly series against the loggers at the other nurseries (compareSeries): r < 0.5 leaves the download out (logger_files.excluded) and a best alignment shifted by >= 3 h warns of a clock problem. On the real data this drops two downloads that do not follow the lagoon (HOBO 17b Oct18-Feb19, HOBO 20 Nov16-Apr17). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This was referenced Nov 3, 2026
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Imports the raw temperature logger exports (#10) and uses them across the site. Drop the folder anywhere under
DATA_DIR(e.g.data/Temperature loggers/); like the workbooks, the CSVs are only read, never edited or committed.Importer (
import/loggers.ts,import/insitu.ts)logger_files,logger_daily(days with ≥ 18 site-hours) andlogger_diel, and addssets.insitu_temp(logger temperature during the set)./gps|location/file-name rule, so it no longer produces spurious "unknown site" warnings.IMPORTER_VERSION→ 4.Pages
Notes for the lab (on the Data quality page after deploy): a few HOBO files whose light channel suggests the clock was off, one EnvLogger named for one nursery but downloaded at another, a lab test logger, and empty downloads.
Checks
pnpm lint,pnpm check,pnpm test(56 passed, new parser tests plus a fixture import test), real-data import (opt-in),pnpm build,pnpm test:e2e(29 passed, axe light and dark). Checked both pages by hand against the real data, including at phone width. Fixtures are synthetic (invented serials and readings).Closes #10
🤖 Generated with Claude Code