Skip to content

Combine batching outputs - #249

Open
sjavis wants to merge 2 commits into
batching-registryfrom
batching-combine-trajectories
Open

sjavis wants to merge 2 commits into
batching-registryfrom
batching-combine-trajectories

Conversation

@sjavis

@sjavis sjavis commented Aug 27, 2026

Copy link
Copy Markdown
Collaborator

This combines the multiple batched trajectory files into one single netcdf file.

It does this by re-indexing the trajectories since each file starts from an index of zero, padding the trajectories so they all match in length, and then combining them with cf.aggregate.

The netcdf variable names are used to match variables in cf.aggregate because the default method fails due to the start and end flags both having the same standard_name.

It also fixes a mistake in the padding in to_netcdf which was causing issues with the concatenation.

Closes #247

@sjavis sjavis self-assigned this Aug 27, 2026
@sjavis sjavis linked an issue Aug 27, 2026 that may be closed by this pull request
@sjavis
sjavis force-pushed the batching-combine-trajectories branch 2 times, most recently from 7d02005 to 6aab36c Compare August 28, 2026 10:45
@sjavis
sjavis changed the base branch from batching to batching-registry August 28, 2026 10:47
@sjavis
sjavis force-pushed the batching-registry branch from b00f608 to 66713a5 Compare August 28, 2026 12:35
@sjavis
sjavis force-pushed the batching-combine-trajectories branch from 6aab36c to b55726d Compare August 28, 2026 12:35
@sjavis
sjavis force-pushed the batching-registry branch from 66713a5 to 4dcd5a5 Compare August 28, 2026 13:22
@sjavis
sjavis force-pushed the batching-combine-trajectories branch from b55726d to ecdf9b4 Compare August 28, 2026 13:22
@sjavis
sjavis marked this pull request as ready for review August 28, 2026 13:27
@sjavis
sjavis force-pushed the batching-registry branch from 4dcd5a5 to bf1a7ac Compare August 28, 2026 14:23
@sjavis
sjavis force-pushed the batching-combine-trajectories branch from ecdf9b4 to b13d586 Compare August 28, 2026 14:23
@sjavis
sjavis force-pushed the batching-registry branch from bf1a7ac to 8fb5fe9 Compare August 28, 2026 14:54
@sjavis
sjavis force-pushed the batching-combine-trajectories branch from b13d586 to 8df00ba Compare August 28, 2026 14:54
@sjavis
sjavis removed this pull request from stack #251 September 10, 2026 15:48
@sjavis
sjavis force-pushed the batching-combine-trajectories branch from 8df00ba to d50d035 Compare September 10, 2026 15:49
@sjavis
sjavis force-pushed the batching-combine-trajectories branch from d50d035 to b1667b5 Compare September 16, 2026 17:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Combine batch outputs

1 participant