Discussion about this post

User's avatar
Alec Pritzos's avatar

The discover-then-freeze sequence is the part most agent demos skip. Letting the model own routing, retries, and scheduling looks clean in a prototype because you can't yet see the failure modes, but recurring work needs steps that fail the same way every time, not creatively. The useful test is whether a step's output should ever surprise you. If not, it belongs in code, and the model's job is the ambiguous middle. Teams that draw that line early spend their tokens on judgment instead of re-deciding solved problems on every run.

No posts

Ready for more?