Transformer Architecture Turns Five — Every Modern LLM Owes It

The 2017 Transformer paper passes five years old. Every state-of-the-art LLM — GPT, BERT, T5, PaLM, LLaMA — is a Transformer descendant.