Skip to content

Transformer from scratch

A from-scratch implementation of the Transformer architecture.

Transformer from scratch

Illustrative cover: dvgodoy · CC BY 4.0 · Resized and converted to WebP.

A Transformer implemented from scratch, part of the algorithmic and computational project work of ADHAYAN co-founder Pitambar Lamichhane.

Stated interests behind the work: neural networks, optimization and AI research.

Contributors

  • Pitambar Lamichhane