Add Colab LavaSR validation workflow - #60
Merged
Merged
Conversation
There was a problem hiding this comment.
Pull request overview
This PR introduces a remote-only Google Colab CLI workflow to collect “real-weight/GPU” validation evidence for LavaSR v0.6.0, aligning heavyweight validation with the project’s compute policy (no local GPU/real-weight runs).
Changes:
- Add a Colab-only Python script that clones the repo, installs dependencies, runs gated GPU/weight tests plus an eval matrix, and archives logs/manifests.
- Document the Colab CLI session commands for running, downloading evidence, and cleanup.
- Add a README pointer directing users to the remote-only accelerator validation workflow.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| README.md | Adds a clear pointer that heavyweight validation must be done remotely via the accelerators documentation. |
| examples/colab_lavasr_validation.py | New Colab-only evidence collection script that runs gated tests/evals and packages results into a tarball. |
| docs/ACCELERATORS.md | Documents the Colab CLI workflow and notes environment overrides and the “no local execution” policy. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
+121
to
+122
| if Path.cwd() != Path("/content"): | ||
| raise RuntimeError("This validation script must run inside a Colab runtime rooted at /content") |
Comment on lines
+22
to
+26
| WORK_ROOT = Path(os.environ.get("ASR_COLAB_WORK_ROOT", "/content/audio-super-resolution-validation")) | ||
| REPO_DIR = WORK_ROOT / "repo" | ||
| CACHE_DIR = WORK_ROOT / "models" | ||
| EVIDENCE_DIR = WORK_ROOT / "evidence" | ||
| ARCHIVE_PATH = Path(os.environ.get("ASR_COLAB_ARCHIVE", "/content/asr-v0.6.0-colab-evidence.tar.gz")) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Compute policy
The script refuses to run outside /content. No real weights, GPU inference, or HPE validation were run locally. Two T4 allocation attempts were made through Colab CLI; both timed out connecting to colab.research.google.com before a runtime was allocated.
Local lightweight validation