Repository · GitHub

gordicaleksa/pytorch-original-transformer

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

View on GitHubReport an issue

Owner	gordicaleksa
License (as declared)	MIT
Stars	1,117
Forks	188
Main language	Jupyter Notebook
Created	19 October 2020
Last updated at source	27 December 2020

jupyter notebookattentionattention-is-all-you-needattention-mechanismdeep-learningdeeplearningjupyteroriginal-transformerpythonpytorchpytorch-transformerpytorch-transformerstransformertransformer-tutorialtransformers

Embed this entry

<iframe src="https://silytics.si/embed/item/180b57db-c31a-47b8-a517-8952181e6f2d" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from gordicaleksa

pytorch-GATRepository

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.