What is Inference?

Training builds the model; inference uses it. Every chat reply, code completion, or generated image is inference. Its cost scales with model size and tokens processed, which drives the industry pattern of cheap small models for high-volume tasks and expensive frontier models for hard ones.