Skip to content

About

Mini Transformer (Implemented From Scratch) A from-scratch implementation of a Transformer in Python using only NumPy. This repository is designed for educational purposes to understand the inner workings of the Transformer architecture, including positional encoding, attention mechanisms, and basic decoding — without relying on frameworks like Py

Topics

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

About

Mini Transformer (Implemented From Scratch) A from-scratch implementation of a Transformer in Python using only NumPy. This repository is designed for educational purposes to understand the inner workings of the Transformer architecture, including positional encoding, attention mechanisms, and basic decoding — without relying on frameworks like Py

Topics

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages