Conversation
…dd-script Add GPU setup guide and predictor smoke-test helper
…oke-tests Fix GPU setup reruns and repository-relative smoke tests
…y-in-pyproject.toml Use credential-free phonemizer dependency
…for-language-model-download Add opt-in cached English KenLM download and validation for GPU smoke tests
…test_gpu_predictors.py Range-extract the English model from the Zenodo archive
…m-and-documentation Correct the built-in Zenodo language model checksum
Author
|
Premature; forgot to include:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds a reproducible GPU setup and smoke-test workflow for PathBench’s ArtP and DArtP evaluators, including support for Google Colab T4 runtimes.
The new
tools/test_gpu_predictors.pyhelper:The dependency configuration now uses the published
phonemizer-fork==3.3.2release instead of an inaccessible Git repository.Documentation and network-free tests cover the GPU workflow, range-based ZIP extraction, archive validation, checksum failures, interrupted requests, insufficient disk space, cache reuse, and related failure cases. An opt-in live test verifies that the expected English model remains available at the pinned location in the Zenodo archive.
Colab validation
Proof: https://colab.research.google.com/drive/1o3G8XjImfuzn2mpvtDrl3_7Y4LEixsfL
The cumulative changes were tested in Google Colab with:
wiki_en_token.arpa.binsize: 14,600,342,241 bytesResults:
33 passed, 1 skippedThe skipped default unit test is the intentionally opt-in live-network check.
This upstream PR consolidates the work developed and validated through PRs #1–#6 in the fork.