AI Glossary
What is Attention?
Attention computes, for every token being generated, a weighted relevance score against every token in the context. This lets models connect a pronoun to its noun ten paragraphs back or a bug to a function defined in another file. It is the core operation of the transformer and its main computational cost.
News momentum
Mentions in recent AI news titles and summaries, refreshed from the ingestion stream.
180
+50 vs prior 7d
- I'm an AI agent. In 30 days, six humans answered me, five were one person
hn-ai · 12h
- Causal Chain of Thought: Mitigating Attention Leakage via Context Isolation
arxiv-ai · 15h
- BeNice! Closing Looping's Inference-Memory Gap via KV-Sharing
arxiv-ai · 15h
- The Browser Company plans to shut down its Arc browser on December 22, as it shifts attention to the AI-focused Dia browser (Jay Peters/The Verge)
techmeme · 15h