Skip to content

Fix dead wikitext-103 S3 link in quicktour.mdx#2215

Open
RudrenduPaul wants to merge 1 commit into
huggingface:mainfrom
RudrenduPaul:fix/quicktour-wikitext-s3-link-1625
Open

Fix dead wikitext-103 S3 link in quicktour.mdx#2215
RudrenduPaul wants to merge 1 commit into
huggingface:mainfrom
RudrenduPaul:fix/quicktour-wikitext-s3-link-1625

Conversation

@RudrenduPaul

Copy link
Copy Markdown

Closes #1625

What this PR does

Fixes the broken wget URL in the "Build a tokenizer from scratch"
section of docs/source-doc-builder/quicktour.mdx. The link pointed at:

https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-103-raw-v1.zip

which has been dead since the research.metamind.io bucket was taken
down (confirmed still broken today — see Verification below). Anyone
following the quicktour hits a dead link on the very first command.

Change

docs/source-doc-builder/quicktour.mdx: replaced the dead S3 URL with
the canonical wikitext-103-raw-v1.zip mirror hosted on the Hugging
Face Hub (huggingface.co/datasets/mattdangerw/wikitext-103-raw). The
archive contents and internal layout are identical, so the existing
unzip wikitext-103-raw-v1.zip step and downstream paths in the rest of
the tutorial are unaffected.

# before
wget https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-103-raw-v1.zip

# after
wget https://huggingface.co/datasets/mattdangerw/wikitext-103-raw/resolve/main/wikitext-103-raw-v1.zip

Background

Verification

Confirmed the old link is still dead and the replacement resolves and
serves the real archive:

$ curl -sI https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-103-raw-v1.zip
HTTP/1.1 301 Moved Permanently
(bucket redirect does not resolve to usable content)

$ curl -sI -L https://huggingface.co/datasets/mattdangerw/wikitext-103-raw/resolve/main/wikitext-103-raw-v1.zip
HTTP/2 302
...
HTTP/2 200
content-type: application/zip
content-length: 191984949
content-disposition: inline; filename*=UTF-8''wikitext-103-raw-v1.zip; filename="wikitext-103-raw-v1.zip"

The Hub redirects to its CDN and serves the full ~192 MB zip with the
expected filename and content type.

Scope

Docs-only, single file changed. No code, tests, or build changes.

Note: Claude Code was used to assist in drafting this change. All
changes were reviewed by the submitter.

The wget URL pointed at s3.amazonaws.com/research.metamind.io, which has
been dead since the research.metamind.io takedown. Replace it with the
canonical wikitext-103-raw-v1.zip mirror on the Hugging Face Hub so the
quicktour download step works again.

Closes huggingface#1625
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Tokenizer Quickstart Tutorial: Broken Links

1 participant