THE COLLECTION

EVERY SIGNAL, SORTED.

Search the whole shelf by topic, tool, term, or plain old curiosity.

SHOWING 1 OF 402 STORIES
ISSUE 435MORNING

United States, Small Language Models, Elastic Inference, Edge Deployment, Model Routing, Energy Measurement, Open Weights and Production Evaluation

NVIDIA gave one small model four thinking depths. The loop count needs a budget

Dory reuses one block of layers so the same 4B checkpoint can spend one, two or four passes on a token. That makes inference adjustable without a model swap. It also turns loop count into a production policy that needs local evidence, latency limits and an energy receipt.

#small-models#elastic-inference#model-operations