pretraining-dynamics

Here is 1 public repository matching this topic...

hematteo / learning-to-read-out

Code for "Learning to Read Out: Unembedding Dynamics in Language Model Pretraining" — parameter-trajectory crosscoders on the unembedding matrix W_U. Pretrained crosscoders: hf.co/hematteo/parameter-trajectory-crosscoders

language-models pythia sparse-autoencoders interpretability mechanistic-interpretability crosscoders pretraining-dynamics

Updated Jun 14, 2026
Python

Improve this page

Add a description, image, and links to the pretraining-dynamics topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pretraining-dynamics topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

pretraining-dynamics

Here is 1 public repository matching this topic...

hematteo / learning-to-read-out

Improve this page

Add this topic to your repo