AI Glossary
What is Transformer?
Introduced in the 2017 paper "Attention Is All You Need", the transformer processes all tokens in parallel and uses attention to decide which earlier tokens matter for predicting the next one. Its scalability on GPUs is the reason the current AI wave exists; nearly every frontier model is a transformer variant.
News momentum
Mentions in recent AI news titles and summaries, refreshed from the ingestion stream.
99
+9 vs prior 7d
- Orbitol: Crystal Generation on Wyckoff Orbits
arxiv-ai · 14h
- Looped Uniform Diffusion Language Models
arxiv-ai · 14h
- Automated Materials Data and Knowledge Extraction using Machine Learning and Large Language Models
arxiv-ai · 16h
- FogTTA: Online Test-Time Adaptation for Robust Transformer-based Object Detection in Foggy Weather
arxiv-ai · 19h