[ICLR 2021 Spotlight] "CPT: Efficient Deep Neural Network Training via Cyclic Precision" by Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yining Ding, Vikas Chandra, and Yingyan (Celine) Lin.
-
Updated
Mar 2, 2024 - Python
#
low-precision-training
Here are 7 public repositories matching this topic...
Unit Scaling demo and experimentation code
-
Updated
Mar 12, 2024 - Jupyter Notebook
[NeurIPS 2020] "FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training" by Yonggan Fu, Haoran You, Yang Zhao, Yue Wang, Chaojian Li, Kailash Gopalakrishnan, Zhangyang Wang, Yingyan Lin
-
Updated
Feb 13, 2022 - Python
Official Code for the paper ELMO : Efficiency via Low-precision and Peak Memory Optimization in Large Output Spaces (in ICML 2025)
chunking multi-label-classification extreme-classification low-precision-training large-output-space float8 triton-kernels gradient-fusion
-
Updated
Feb 27, 2026 - Python
Research artifact for One QK Channel, Many Sources (arXiv:2608.02091)
machine-learning transformers pytorch attention mixed-precision low-precision-training research-artifact
-
Updated
Aug 4, 2026 - Python
StoSignSGD: Unbiased Structural Stochasticity Fixes SignSGD for Training Large Language Models
-
Updated
Aug 31, 2026 - HTML
ALTO: Advanced Low-precision Training and Optimization
-
Updated
Aug 31, 2026 - Python
Add this topic to your repo
To associate your repository with the low-precision-training topic, visit your repo's landing page and select "manage topics."