PyTorch Transformer implementation with positional encoding, multi-head attention, encoder-decoder layers, and masking.
-
Updated
Sep 19, 2026 - Jupyter Notebook
PyTorch Transformer implementation with positional encoding, multi-head attention, encoder-decoder layers, and masking.
The minimum implementation of chatbot using popular LLM model rewrite from ground up with simplicity in mind
Deliver enhanced transformer models with improved performance and features based on the x-transformers architecture for flexible deep learning applications
A hypothesis of depth-indexed state regimes in pre-RMSNorm language models.
A research-driven journey to understand and build Large Language Models from scratch—from first principles to production-ready AI systems.
MRI‑style 3D visualization of cluster formation across Qwen transformer layers.
Mini Transformer (Implemented From Scratch) A from-scratch implementation of a Transformer in Python using only NumPy. This repository is designed for educational purposes to understand the inner workings of the Transformer architecture, including positional encoding, attention mechanisms, and basic decoding — without relying on frameworks like Py
To associate your repository with the transformers-architecture topic, visit your repo's landing page and select "manage topics."