When All You Have Are Decoders, Every Decision Looks Like Generation
TLDR Not every model call needs to generate text. Routing is often a small decision hidden inside a large agentic system, yet many systems ask a decoder language model to generate that choice token by token. A decoder router is not inherently wrong. It is useful when policy is open-ended or the route set changes …
When All You Have Are Decoders, Every Decision Looks Like Generation Read More »










