Evaluating Trajectories, Not Just Outcomes
← Back to Blog & Articles An agent can reach the right answer through a dangerous path, or fail after doing most things right. […]
← Back to Blog & Articles An agent can reach the right answer through a dangerous path, or fail after doing most things right. […]
← Back to Blog & Articles Giving an agent broad credentials is convenient and dangerous. Capability-based access grants only what a specific task needs, […]
← Back to Blog & Articles Prompt injection is the leading security problem for agents that read untrusted text. It happens when content tries […]
← Back to Blog & Articles An agent task may involve several steps across different systems. If a later step fails, you cannot roll […]
← Back to Blog & Articles Agents depend on slow, unreliable services, including the model itself. A few resilience patterns keep one failure from […]
← Back to Blog & Articles Networks fail, and agents retry. If a retried action runs twice, the result can be a duplicate payment […]
← Back to Blog & Articles Agents need to remember, but not everything in the same way. Borrowing categories from cognitive science helps organize […]
← Back to Blog & Articles A model's context window is finite, and every token costs money and latency. Production agents manage context deliberately […]
← Back to Blog & Articles Not every LLM application should be an agent. A key design decision is how much freedom the model […]
← Back to Blog & Articles A single call to a language model is stateless: text goes in, text comes out. A production agent […]