Skip to content

Normalize raw session metadata before ingest in the nightly cron #354

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lecriste merged 1 commit into from
Aug 14, 2026
Merged

Normalize raw session metadata before ingest in the nightly cron #354

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions dj_pipeline/cron_script.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,4 +10,5 @@ vr4mice_cron_init
vr4mice_git_info
vr4mice_compose_up db client

vr4mice_run_sync_days
vr4mice_run_cron_scenario local
9 changes: 9 additions & 0 deletions dj_pipeline/docker/cron_common.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,3 +67,12 @@ vr4mice_run_cron_scenario() {
fi
vr4mice_exec_client "${cmd}"
}

vr4mice_run_sync_days() {
# Resync the per-experiment `day` stored in the raw .npy files before ingest, so
# (mouse_name, day, attempt) does not collide across dates (the GUI can reset day
# to 1). Runs in the client container against /data/data, and must run BEFORE
# populate_rig moves the files to processed/.
vr4mice_check_env_file ".env" ".env.example"
vr4mice_exec_client "${BASE_INSTALL} && set -a && source .env && set +a && python run.py sync_days"
}
Loading