"Agent" has become the most over-applied word in enterprise AI, attached to everything from a scripted chatbot to a genuinely autonomous system. The distinction is not marketing: it decides how much can go wrong unsupervised, and how much governance the thing needs around it.
This article explains what an agent is and how one works. It assumes the model underneath is familiar — see inside large language models — and it deliberately does not re-cover two neighbours: the security risk map for agentic AI, or running agents as managed enterprise services.
What makes an agent an agent
Four properties, together, separate an agent from a very good chatbot:
- Goal-directed — you give it an objective ("reconcile these invoices"), not a script of steps.
- Autonomous planning — it decides the sequence of actions itself, and revises the plan when reality differs from expectation.
- Tool use — it can call things outside the model: APIs, databases, search, code execution, other systems. This is what turns text generation into action.
- Iteration with feedback — it observes the result of each action and loops, rather than producing one answer and stopping.
Remove tool use and you have a reasoning chatbot. Remove autonomous planning and you have workflow automation with an AI step in it. Both are useful; neither is an agent, and calling them one inflates expectations and understates the controls required.
The plan-act-observe loop
Nearly every agent framework implements the same cycle, whatever it calls the parts:
- Goal — the objective arrives, with context and constraints.
- Plan — the model reasons about what to do first, often decomposing the goal into steps.
- Act — it selects a tool and calls it with arguments it generates (commonly via function calling, where the model emits a structured call the runtime executes).
- Observe — the tool's result comes back into the context, including errors.
- Repeat or stop — it re-plans with the new information and iterates until the goal is met, a limit is hit, or it escalates to a human.
Tools, memory and orchestration
Three supporting pieces turn the loop into a working system:
- Tools — the actions available to the agent, each with a described interface the model can reason about. In practice these are your APIs, and an agent is only as capable — and as dangerous — as the tools you hand it.
- Memory — short-term (the working context of this task) and long-term (what it should recall across sessions). Retrieval is how long-term memory is usually implemented; see RAG, which grounds an agent's knowledge in your data.
- Orchestration — the runtime that executes tool calls, enforces limits, handles failures and retries, logs every step, and decides when a human must approve before an action proceeds.
Agent vs chatbot vs workflow automation
The comparison that settles most "do we need an agent?" conversations:
| Chatbot / assistant | Workflow automation | AI agent | |
|---|---|---|---|
| Who decides the steps | No steps — it responds | You do, in advance | The agent, at run time |
| Acts on other systems | Rarely; usually answers only | Yes, exactly as scripted | Yes, choosing which tools to call |
| Handles the unexpected | Poorly | Fails or stops — paths are fixed | Re-plans and adapts |
| Predictability | High | Very high | Lower — same input can take different paths |
| Best for | Q&A, drafting, summarising | Well-understood, repeatable processes | Open-ended tasks with variable steps |
The honest guidance: if the process is stable and well understood, conventional automation is cheaper, faster and far more predictable. Agents earn their complexity when the path genuinely varies — triage, research, reconciliation, investigation — and when adaptation is worth more than determinism.
Multi-agent systems
Rather than one agent doing everything, a multi-agent design splits work across specialists — a planner delegating to a researcher, a coder and a reviewer, for example — coordinated by an orchestrator. The appeal is separation of concerns: narrower tools per agent, clearer prompts, and reviewable hand-offs. The cost is real: more model calls, harder debugging, and failure modes where agents loop between each other or confidently propagate one another's mistakes. Start with one well-bounded agent; add more only when a single agent's tool list or prompt has become unmanageable.
Where agents fail
The recurring failure patterns, worth knowing before a pilot:
- Compounding errors — a wrong step early becomes the input to every later step. Long chains amplify small mistakes.
- Unbounded loops — an agent that cannot tell it is stuck will keep trying, burning tokens and time.
- Over-broad permissions — an agent given a powerful API key can do anything that key allows, including things nobody intended. Scope credentials to the task, not to convenience.
- Automation bias — humans nominally "in the loop" rubber-stamping agent output they have stopped genuinely reviewing.
- Silent drift — behaviour changing as the underlying model, prompts or tools change, with no regression tests to catch it.
The adversarial dimension — prompt injection, malicious tool responses and the wider risk map — is covered in depth in AI agents and cybersecurity.
Governing agents in Singapore
Singapore moved early and specifically on this. On 22 January 2026, IMDA launched the Model AI Governance Framework for Agentic AI — the first governance framework anywhere aimed squarely at agentic systems — announced at the World Economic Forum, and updated on 20 May 2026 with industry feedback, case studies and guidance on multi-agent systems, third-party agents and automation bias.[1]
It is built on four dimensions that double as a practical deployment checklist: assess and bound the risks, ensure meaningful human accountability, implement technical controls and processes, and enable end-user responsibility. It applies whether you build agents in-house or adopt third-party agentic products.
It builds on IMDA's earlier Model AI Governance Framework for Generative AI (May 2024), which covers the underlying model risks — hallucination, provenance and security — that an agent inherits from the model it runs on.[2]
Deploying agents sensibly
A sequence that keeps the upside and bounds the downside:
- Check an agent is the right tool. If the steps are fixed, use workflow automation — it is cheaper and predictable.
- Start read-only. Let the agent research, draft and recommend before it is allowed to write, pay, send or delete.
- Scope the tools and credentials tightly — least privilege per agent, with its own identity rather than a shared admin key. See IAM.
- Put a human at the irreversible steps. Approval gates belong on actions that move money, touch customers or cannot be undone — and design against rubber-stamping.
- Bound everything — iteration limits, timeouts, spend caps, explicit stop conditions.
- Log every step and evaluate continuously. Full traces of plans, tool calls and results, plus a regression set so model or prompt changes cannot silently alter behaviour.
- Map it to the framework. Walk IMDA's four dimensions before go-live; they are a good audit of your own design.
Piloting AI agents?
Agents succeed on tool design, permissions and governance — not model choice. Compare Singapore AI and system-integration partners who build, secure and operate agentic systems.
Browse AI & Systems Integrators in Singapore
Frequently asked questions
What's the difference between an AI agent and a chatbot?
A chatbot responds to what you ask; an agent pursues a goal. Given an objective, an agent plans the steps itself, calls real tools and APIs to carry them out, observes the results and iterates until it is done. Tool use and autonomous planning are the dividing line — remove them and you have an assistant, not an agent.
Do we need an agent, or is workflow automation enough?
If the process is stable and the steps are known in advance, conventional workflow automation is cheaper, faster and far more predictable — and you should use it. Agents earn their complexity when the path genuinely varies from case to case, such as triage, research, reconciliation or investigation, where adapting matters more than determinism.
How do AI agents actually work?
Through a loop: a goal arrives, the model plans a first step, it calls a tool (commonly via function calling, where it emits a structured call the runtime executes), the result comes back into context, and it re-plans with that new information — repeating until the goal is met, a limit is hit, or it escalates to a human. Tools, memory and an orchestration layer that enforces limits and logging make it a working system.
What are the main risks of agentic AI?
Compounding errors down long chains, unbounded loops that burn time and tokens, over-broad permissions letting an agent do anything its credentials allow, automation bias where human reviewers rubber-stamp output, and silent behavioural drift when models or prompts change. The adversarial risks — prompt injection, malicious tool responses — are covered in our AI agents and cybersecurity article.
What does Singapore's agentic AI framework require?
IMDA launched the Model AI Governance Framework for Agentic AI on 22 January 2026 — the first of its kind globally — and updated it in May 2026. It is organised around four dimensions: assess and bound the risks, ensure meaningful human accountability, implement technical controls and processes, and enable end-user responsibility. It applies whether you build agents in-house or deploy third-party agentic products.
If an agent makes a mistake, who is responsible?
Your organisation. IMDA's framework is voluntary, but organisations remain legally accountable for their agents' behaviour and actions — "the agent decided" is not a defence. Existing obligations continue to apply: the PDPA governs personal data the agent reads or writes, sector regulators still expect their controls to hold, and contracts bind regardless of which system executed the action. That is why human approval on irreversible steps and complete logs matter.
Sources
- Launch of a new Model AI Governance Framework for Agentic AI — IMDA — official checked 2026-09-01
- Model AI Governance Framework for Generative AI — IMDA and AI Verify Foundation — official checked 2026-09-01
- Overview of the PDPA — Personal Data Protection Commission (PDPC) — official checked 2026-09-01
Related resources
Go deeper on this topic
Knowledge base
- Inside Large Language Models: How the Engines Behind ChatGPT, Claude, and Gemini Actually Work
- AI Agents and Cybersecurity: Agentic AI Risks and Controls
- ITSM for Agentic AI: How to Manage AI Agents as Enterprise Services
- Retrieval-Augmented Generation (RAG) Explained
- APIs Explained: How Software Talks to Software
Vendor directories
Research cluster
Related analysis
Recent TechDirectory Insights coverage from the same research cluster.