From RNNs to Transformers: The Complete Neural Machine Translation Journey

This course is a comprehensive journey through the evolution of sequence models and neural machine translation (NMT). It blends historical breakthroughs, architectural innovations, mathematical insights, and hands-on PyTorch replications of landmark papers that shaped modern NLP and AI. The course features: - A detailed narrative tracing the history and breakthroughs of RNNs, LSTMs, GRUs, Seq2Seq, Attention, GNMT, and Multilingual NMT. - Replications of 7 landmark NMT papers in PyTorch, so learners can code along and rebuild history step by step. - Explanations of the math behind RNNs, LSTMs, GRUs, and Transformers. - Conceptual clarity with architectural comparisons, visual explanations, and interactive demos like the Transformer Playground. 🌐 Atlas Page: https://programming-ocean.com/knowledge-hub/neural-machine-translation-atlas.php 💻 Code Source on Github: https://github.com/MOHAMMEDFAHD/Pytorch-Collections/tree/main/Neural-Machine-Translation ❤️ Support for this channel comes from our friends at Scrimba – the coding platform that's reinvented interactive learning: https://scrimba.com/freecodecamp ⭐️ Chapters ⭐️ – 0:01:06 Welcome – 0:04:27 Intro to Atlas – 0:09:25 Evolution of RNN – 0:15:08 Evolution of Machine Translation – 0:26:56 Machine Translation Techniques – 0:34:28 Long Short-Term Memory (Overview) – 0:52:36 Learning Phrase Representation using RNN (Encoder–Decoder for SMT) – 1:00:46 Learning Phrase Representation (PyTorch Lab – Replicating Cho et al., 2014) – 1:23:45 Seq2Seq Learning with Neural Networks – 1:45:06 Seq2Seq (PyTorch Lab – Replicating Sutskever et al., 2014) – 2:01:45 NMT by Jointly Learning to Align (Bahdanau et al., 2015) – 2:32:36 NMT by Jointly Learning to Align & Translate (PyTorch Lab – Replicating Bahdanau et al., 2015) – 2:42:45 On Using Very Large Target Vocabulary – 3:03:45 Large Vocabulary NMT (PyTorch Lab – Replicating Jean et al., 2015) – 3:24:56 Effective Approaches to Attention (Luong et al., 2015) – 3:44:06 Attention Approaches (PyTorch Lab – Replicating Luong et al., 2015) – 4:03:17 Long Short-Term Memory Network (Deep Explanation) – 4:28:13 Attention Is All You Need (Vaswani et al., 2017) – 4:47:46 Google Neural Machine Translation System (GNMT – Wu et al., 2016) – 5:12:38 GNMT (PyTorch Lab – Replicating Wu et al., 2016) – 5:29:46 Google’s Multilingual NMT (Johnson et al., 2017) – 6:00:46 Multilingual NMT (PyTorch Lab – Replicating Johnson et al., 2017) – 6:15:49 Transformer vs GPT vs BERT Architectures – 6:36:38 Transformer Playground (Tool Demo) – 6:38:31 Seq2Seq Idea from Google Translate Tool – 6:49:31 RNN, LSTM, GRU Architectures (Comparisons) – 7:01:08 LSTM & GRU Equations 🎉 Thanks to our Champion and Sponsor supporters: 👾 Drake Milly 👾 Ulises Moralez 👾 Goddard Tan 👾 David MG 👾 Matthew Springman 👾 Claudio 👾 Oscar R. 👾 jedi-or-sith 👾 Nattira Maneerat 👾 Justin Hual -- Learn to code for free and get a developer job: https://www.freecodecamp.org Read hundreds of articles on programming: https://freecodecamp.org/news