Pytorch transformer
Attention is all you need implementation
YouTube video with full step-by-step implementation: https://www.youtube.com/watch?v=ISNdQcPhsts The project is written primarily in Jupyter Notebook, first published in 2023. It has gained significant community traction with 1,226 stars and 397 forks on GitHub. Key topics include: attention-is-all-you-need, paper-implementations, pytorch, transformer.
pytorch-transformer
Attention is all you need implementation
YouTube video with full step-by-step implementation: https://www.youtube.com/watch?v=ISNdQcPhsts
Contributors
Showing top 3 contributors by commit count.
Related Repositories
jadore801120/attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Kyubyong/transformer
A TensorFlow Implementation of the Transformer: Attention Is All You Need
linto-ai/whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
awslabs/sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
gordicaleksa/pytorch-original-transformer
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
amitshekhariitbhu/llm-internals
Learn LLM internals step by step - from tokenization to attention to inference optimization.