AINews Portal

AI Glossary

What is Transformer?

Introduced in the 2017 paper "Attention Is All You Need", the transformer processes all tokens in parallel and uses attention to decide which earlier tokens matter for predicting the next one. Its scalability on GPUs is the reason the current AI wave exists; nearly every frontier model is a transformer variant.

← All terms