PyTorch transformer input from raw bytes with zero learned input parameters: no tokenizer, embedding table, or learned input projection.
-
Updated
Jul 30, 2026 - Python
PyTorch transformer input from raw bytes with zero learned input parameters: no tokenizer, embedding table, or learned input projection.
Language-model proof of operation for HSL's zero-learned-parameter input path. Open code, weights, and documented limitations; not a SOTA claim.
To associate your repository with the embedding-free topic, visit your repo's landing page and select "manage topics."