Skip to content

Pull requests: allenai/dolma

New pull request New
27 Open 187 Closed
27 Open 187 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: secret span offsets use line number not find()
#311 opened Jul 17, 2026 by Chessing234 Loading…
1 task
fix: gopher duplicate-line char fraction denom
#310 opened Jul 17, 2026 by Chessing234 Loading…
1 task
fix: whitespace tokenizer uses findall for token count
#309 opened Jul 17, 2026 by Chessing234 Loading…
1 task
fix: RedPajama token count uses findall not split
#308 opened Jul 17, 2026 by Chessing234 Loading…
1 task
docs: add community health files and README updates
#306 opened Jul 9, 2026 by Mukller Loading…
fix: avoid divide-by-zero in code composition tagger
#305 opened Jun 27, 2026 by Chessing234 Loading…
1 task
fix(taggers): avoid regex hang in not_alphanum_paragraph_v1
#304 opened Jun 24, 2026 by Chessing234 Loading…
1
fix(tokenizer): honor max_size bytes and default files_per_process
#303 opened Jun 24, 2026 by Chessing234 Loading…
2 tasks
1
fix(taggers): use HTTPS URL for code composition model
#302 opened Jun 24, 2026 by Chessing234 Loading…
1
docs: clarify temporal deduplication strategies and document types (Issue #267)
#276 opened Nov 27, 2025 by ada-ggf25 Loading…
1
Script to produce dolma 2 ablation config
#275 opened Sep 24, 2025 by soldni Contributor Loading…
Improve WARC processing
#260 opened Apr 15, 2025 by soldni Contributor • Draft
first
#240 opened Feb 14, 2025 by Whattabatt Contributor • Draft
6
[WIP DO NOT MERGE] Learn2Code Feature Branch
#233 opened Feb 13, 2025 by cmwilhelm Contributor Loading…
simpler logic for calculating code taggers
#229 opened Feb 12, 2025 by kyleclo Contributor Loading…
Bump openssl from 0.10.66 to 0.10.70 in the cargo group dependencies Pull requests that update a dependency file rust Pull requests that update Rust code
#228 opened Feb 3, 2025 by dependabot Bot Loading…
Fixed ignore_existing flag not working as expected.
#224 opened Jan 1, 2025 by soldni Contributor Loading…
3
New language ID
#223 opened Dec 30, 2024 by soldni Contributor Loading…
Adding support for Classifiers and Search tools
#219 opened Oct 24, 2024 by soldni Contributor • Draft
DCLM Style Deduplications
#214 opened Sep 30, 2024 by revbucket Loading…
7
Mattj/requirements
#212 opened Sep 26, 2024 by revbucket Loading…
DNM: Patch FT Tagger
#210 opened Sep 25, 2024 by undfined Contributor • Draft
Allow specifying different bins for visualization and computation.
#190 opened Aug 27, 2024 by soldni Contributor Loading…
New Progress Bar, Backoff, Batching
#165 opened May 23, 2024 by soldni Contributor Loading…
14
Warc Backoff
#160 opened May 10, 2024 by soldni Contributor Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.