"Agent" has become a marketing word slapped on anything that touches AI. Almost every prospect who calls us says they want "an AI agent," and about half the time what actually solves their problem is a workflow, which is simpler, cheaper and more reliable. Knowing the difference before you scope a project saves money and, more importantly, saves you from an agent that behaves unpredictably where it shouldn't.
The core distinction
A workflow is a predetermined sequence of steps. You define the path in advance: step one happens, then step two, then step three, and an LLM might handle the reasoning inside one or two of those steps, but the overall route through the system is fixed by the code, not by the model.
An agent is different in kind, not just in name. The model itself decides what to do next, based on what it observes as it goes: it can call a tool, look at the result, decide that result changes the plan, and adjust. The loop continues until the model determines the task is done. Nobody wrote the exact sequence of steps in advance because the sequence depends on what happens along the way.
A workflow follows a map you drew. An agent draws its own map as it walks.
A concrete example
Take "respond to a customer support message":
- As a workflow: classify the message into a category, look up the matching canned response, fill in the customer's name and order number, send it. Every step is predictable and the same category always produces the same shape of response.
- As an agent: read the message, decide it needs the customer's order history, pull it from the CRM, notice the order is delayed, check the shipping API for a real status, decide whether that warrants a refund offer based on your policy, and either resolve it or escalate to a human with full context attached.
Both are "AI-powered." Only one of them is actually an agent, because only one of them involves the model deciding its own next step rather than following a script.
When a workflow is the right call
Choose a workflow when the task is genuinely repeatable and the steps rarely change:
- Formatting a report the same way every time.
- Routing a form submission to the right inbox based on a fixed set of categories.
- Generating a follow-up email from a template with a few personalized fields filled in.
Workflows are cheaper to run, faster to build, easier to test and far more predictable, because there's a finite number of paths through the system and you can verify every one of them before launch.
When an agent earns its cost
Agents make sense when the task is open-ended enough that you genuinely can't write the decision tree in advance:
- Qualifying a property lead whose questions, budget and objections can't be fully anticipated.
- Investigating why a customer's order is late, which could involve three different systems depending on the specific case.
- Researching a topic across multiple sources and synthesizing an answer that depends on what it finds.
The tradeoff is real: agents cost more to run (more model calls, more tool calls), are harder to test exhaustively, and can behave in ways you didn't fully anticipate. That's the price of handling genuine open-endedness, and it's worth paying only when the task actually requires it.
The mistake we see most often
Businesses ask for "an agent" when a workflow would do the job for a fraction of the cost, and end up paying for flexibility they don't need. The opposite mistake happens too: forcing a genuinely open-ended task, like real-time negotiation or complex diagnosis, into a rigid decision tree that breaks the moment a customer says something the flowchart didn't anticipate.
The right question to ask before scoping anything isn't "should this be an agent?" It's: how much of this task can be specified in advance, and how much depends on information that only shows up once the task is already underway? The answer tells you which one to build, and it's the same question Anthropic itself uses to frame the decision.
A hybrid is often the real answer
In practice, most systems we build are neither pure workflow nor pure agent. A typical setup: a workflow handles the predictable 80% of cases (routing, formatting, standard replies), and hands off to an agent only for the ambiguous 20% that actually needs judgment. That combination keeps costs down where predictability is possible and reserves agentic flexibility for where it's genuinely earned.
The bottom line
Don't buy "an agent" because it sounds more advanced. Buy the thing that matches how predictable your task actually is. Sometimes that's a tight, testable workflow. Sometimes it's a model that gets to decide its own next move. The businesses that get the most value from AI are the ones that know which one they need before they start building, not after the invoice arrives.