ci: parallelise secret CI, cache HF dataset, speed up docker build#291
Merged
Conversation
Collaborator
luarss
commented
Jun 6, 2026
luarss
commented
- Split monolithic build-backend-docker job into lint-backend, lint-frontend, lint-evaluation (ubuntu-latest), test, and docker-eval jobs; lint jobs run free runners in parallel
- Remove redundant HF source_list.json download from test step
- Add docker-compose.ci.yml override: skips HF clone via SKIP_HF_DOWNLOAD build arg, bind-mounts pre-downloaded ./data, reduces healthcheck start_period from 1200s to 300s
- Add docker-up-ci / docker-down-ci Makefile targets using the CI compose override
- Use pytest -n auto in make test to parallelise 349 tests via already-installed pytest-xdist
- Add SKIP_HF_DOWNLOAD ARG to backend/Dockerfile so production builds still clone the dataset; CI skips it and mounts instead
- Change uv sync --dev to uv sync in Dockerfile to omit dev tools from the production image
- Split monolithic build-backend-docker job into lint-backend, lint-frontend, lint-evaluation (ubuntu-latest), test, and docker-eval jobs; lint jobs run free runners in parallel - Remove redundant HF source_list.json download from test step - Add docker-compose.ci.yml override: skips HF clone via SKIP_HF_DOWNLOAD build arg, bind-mounts pre-downloaded ./data, reduces healthcheck start_period from 1200s to 300s - Add docker-up-ci / docker-down-ci Makefile targets using the CI compose override - Use pytest -n auto in make test to parallelise 349 tests via already-installed pytest-xdist - Add SKIP_HF_DOWNLOAD ARG to backend/Dockerfile so production builds still clone the dataset; CI skips it and mounts instead - Change uv sync --dev to uv sync in Dockerfile to omit dev tools from the production image Signed-off-by: Jack Luar <jluar@precisioninno.com>
luarss
added a commit
to luarss/ORAssistant
that referenced
this pull request
Jun 6, 2026
…he-OpenROAD-Project#291) - Split monolithic build-backend-docker job into lint-backend, lint-frontend, lint-evaluation (ubuntu-latest), test, and docker-eval jobs; lint jobs run free runners in parallel - Remove redundant HF source_list.json download from test step - Add docker-compose.ci.yml override: skips HF clone via SKIP_HF_DOWNLOAD build arg, bind-mounts pre-downloaded ./data, reduces healthcheck start_period from 1200s to 300s - Add docker-up-ci / docker-down-ci Makefile targets using the CI compose override - Use pytest -n auto in make test to parallelise 349 tests via already-installed pytest-xdist - Add SKIP_HF_DOWNLOAD ARG to backend/Dockerfile so production builds still clone the dataset; CI skips it and mounts instead - Change uv sync --dev to uv sync in Dockerfile to omit dev tools from the production image Signed-off-by: Jack Luar <jluar@precisioninno.com>
luarss
added a commit
to luarss/ORAssistant
that referenced
this pull request
Jun 6, 2026
…he-OpenROAD-Project#291) - Split monolithic build-backend-docker job into lint-backend, lint-frontend, lint-evaluation (ubuntu-latest), test, and docker-eval jobs; lint jobs run free runners in parallel - Remove redundant HF source_list.json download from test step - Add docker-compose.ci.yml override: skips HF clone via SKIP_HF_DOWNLOAD build arg, bind-mounts pre-downloaded ./data, reduces healthcheck start_period from 1200s to 300s - Add docker-up-ci / docker-down-ci Makefile targets using the CI compose override - Use pytest -n auto in make test to parallelise 349 tests via already-installed pytest-xdist - Add SKIP_HF_DOWNLOAD ARG to backend/Dockerfile so production builds still clone the dataset; CI skips it and mounts instead - Change uv sync --dev to uv sync in Dockerfile to omit dev tools from the production image Signed-off-by: Jack Luar <jluar@precisioninno.com> Signed-off-by: Jack Luar <jluar@precisioninno.com>
luarss
added a commit
to luarss/ORAssistant
that referenced
this pull request
Jun 6, 2026
…he-OpenROAD-Project#291) - Split monolithic build-backend-docker job into lint-backend, lint-frontend, lint-evaluation (ubuntu-latest), test, and docker-eval jobs; lint jobs run free runners in parallel - Remove redundant HF source_list.json download from test step - Add docker-compose.ci.yml override: skips HF clone via SKIP_HF_DOWNLOAD build arg, bind-mounts pre-downloaded ./data, reduces healthcheck start_period from 1200s to 300s - Add docker-up-ci / docker-down-ci Makefile targets using the CI compose override - Use pytest -n auto in make test to parallelise 349 tests via already-installed pytest-xdist - Add SKIP_HF_DOWNLOAD ARG to backend/Dockerfile so production builds still clone the dataset; CI skips it and mounts instead - Change uv sync --dev to uv sync in Dockerfile to omit dev tools from the production image Signed-off-by: Jack Luar <jluar@precisioninno.com>
2 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.