A morning paper for product designers
Today's thread

Structured outputs, not more chat, is where AI leverage lives now

Designing with AI's writeup of Jev argues cheap calibrated decision models beat frontier LLMs for constrained-choice tasks, while Simon Willison's Muse post shows an agent making unaccountable customer-facing choices when it isn't constrained at all. The gap between a model that only outputs one of five known options and one that freely drafts replies to your customers is exactly the gap between a tool you can trust and one you have to babysit.

Reads9 picks · 8 min
01Designing with AI35 d

Jev a decision model for production latency and cost

It gives you a concrete architectural pattern: swap a chat model for a cheap calibrated classifier anywhere your product needs one choice from a known set, not generated prose.

Read on newsletter.victordibia.com
Try today

Pick one place in your product where an LLM currently generates free text for a decision with a fixed set of outcomes, and sketch what a constrained classifier version would look like instead.

← All threads