Skip to content
Technology transformation expertise firm · ARDIANE Group Innovate, secure, succeed

Artificial intelligence

AI agents: designing, governing and supervising autonomous agents

An agent does not just write, it acts in your applications. Our consultants help your teams design it starting from what it is allowed to do, what must remain validated by a human and what must be traced.

Our principles

  • The lowest level of autonomy that delivers the service
  • Guardrails built into the system
  • A complete trace of every action
In brief

AI agents are systems that use a language model to pursue a goal by chaining actions in applications, by means of tools. Management Square consultants contribute to their design within their clients' teams: level of autonomy, definition of tools and permissions, technical guardrails, human oversight and traceability of every action.

Scope

How we contribute

  1. Qualifying candidate processes

    Analysis of the tasks under consideration: frequency, whether the result can be checked, severity and reversibility of an error. We set aside processes that nobody can describe.

  2. Choosing the level of autonomy

    Trade-off between an orchestrated workflow, a tool-using agent and a multi-agent system, according to how variable the task is and the level of control expected.

  3. Designing tools and permissions

    Definition of the tools exposed to the agent, separation of read and write, a dedicated technical identity and rights limited to the task.

  4. Technical guardrails

    Lists of authorised actions, amount and volume caps, step and budget limits, isolated execution, filtering of the content the agent reads.

  5. Human oversight arrangements

    Definition, action by action, of what requires prior approval, sample checks or escalation, and design of the supervision workstation.

  6. Testing, traceability and operation

    Test scenarios in a simulated environment, including hijacking attempts, a complete log of decisions and a shutdown procedure.

Page contents

An agent that acts does not fail like an assistant that answers

AI agents carry high expectations: entrusting a system no longer with a question, but with a goal. Handling a request end to end, reconciling invoices with purchase orders, preparing a file by querying several applications. The promise is real. The step to climb is higher than it looks.

An assistant that makes a mistake produces incorrect text, which a person can reread before using it. An agent that makes a mistake executes: it sends a message, modifies a record, triggers an order. The error has taken effect in the information system before anyone has seen it.

Three properties make the subject difficult. Errors accumulate: a ten-step task, each step of which usually succeeds, fails far more often than a one-step task. Behaviour is not deterministic: the same goal can be handled by two different paths. Finally, the agent reads content you do not control (emails, web pages, attachments), and that content may contain instructions intended to hijack it.

Loop, tools, memory: what makes an agent, and how far to let it decide

An AI agent is a language model placed in a loop. It receives a goal, decides on an action, calls a tool (a programming interface, a database query, a search), observes the result, then decides on the next action. The loop stops when the goal is achieved or a stopping condition is triggered. Tools define what the agent can do. Memory defines what it retains from one step or session to the next.

So-called “agentic” systems do not all have the same level of autonomy. This choice is the first design decision.

Form Who decides the sequence Typical use Level of control
Orchestrated workflow The code: the steps are fixed, the model handles each one Stable, well-described process High, predictable behaviour
Tool-using agent The model chooses the tools and their order, within a bounded scope Variable tasks, cases impossible to list in advance Depends on the guardrails
Multi-agent system An orchestrator distributes the work among specialised agents Long tasks combining several skills Harder to test and trace

Our rule is to choose the lowest level of autonomy that delivers the expected service. Many needs presented as agent projects are better handled by an orchestrated workflow, which is simpler to test. And when the need is to answer from documents, without acting, a generative AI assistant is enough.

Designing AI agents starting from their permissions

Our consultants work within your teams; decisions remain yours.

Choosing a suitable process. A good candidate is a frequent task whose result can be checked and whose errors can be corrected. A process that nobody can describe will not be carried out any better by an agent.

Defining tools as contracts. Each tool exposed to the agent has a precise description, typed parameters and explicit error messages. We separate read tools from write tools. The agent has its own technical identity and rights limited to its task: it does not borrow a user’s account. This assumes that your applications expose clean interfaces, which brings us back to information system architecture. Open protocols such as the Model Context Protocol (MCP) standardise this connection between agents and tools.

Building guardrails into the system, not into the instruction. Asking a model to “never” do something is not a control. The limits are technical: a closed list of authorised actions, amount and volume caps, a maximum number of steps, a budget per task, code execution in an isolated environment, filtering of incoming content.

Grading human oversight. Three regimes coexist. Prior approval: the agent prepares, a person approves before any irreversible action. After-the-fact checking: the agent acts, a person checks a sample. Escalation: the agent hands back control as soon as it leaves its scope or a doubt rule is triggered. The regime is chosen action by action, according to the severity of an error.

Tracing and testing trajectories. Every decision, every tool call and every result is logged, so that what the agent did, and in what order, can be explained afterwards. Tests focus on the final state obtained in a simulated environment, and not only on the text produced. They include hijacking attempts by instruction injection.

When the agent constitutes a high-risk AI system within the meaning of Article 6 of Regulation (EU) 2024/1689, human oversight is a requirement of the text (Article 14). The oversight arrangements then form part of your AI governance.

What derails an agent project

  • Starting with several agents. A multi-agent system multiplies the exchanges to trace and the causes of failure. It is justified after a single agent has been stabilised, rarely before.
  • Granting broad rights “so that it works”. An agent that can do everything can damage everything. Each additional right is justified by a specific step of the task.
  • Removing human approval too early. Autonomy is extended on the basis of measurements, for example the share of the agent’s proposals accepted without modification, and not on an impression.
  • Going live without a shutdown procedure. An agent must be able to be suspended immediately, and its recent actions must be retrievable.
  • Forgetting those whose work changes. Supervising an agent is not the same job as carrying out the task. Validation criteria, the checking workload and responsibilities are defined with the teams concerned.

Success indicators for an agent in operation

An agent is managed like a service, with measurements taken continuously:

  • the share of tasks completed without human intervention, and whose result is correct;
  • the frequency of escalations and their reasons, to distinguish useful caution from blockage;
  • the share of actions corrected or cancelled by a supervisor;
  • the number of steps and the cost per task, which signal loops and drift;
  • attempts at out-of-scope actions blocked by the guardrails;
  • end-to-end processing time, compared with that of the previous process.

Reading these measurements together guides decisions. A high completion rate accompanied by many after-the-fact corrections indicates an agent too autonomous for its actual reliability. Very frequent escalations indicate a poorly defined scope or inadequate tools.

Typical work

What our consultants contribute to

Process qualification sheet

Target task, expected result, possible errors and the level of autonomy chosen, with its justification.

Tools and permissions matrix

List of tools, associated rights, caps and the oversight regime applicable to each action.

Test campaign

Nominal scenarios, edge cases and attack scenarios, with the expected final state and the results obtained.

Operations file

Indicators monitored, log format, suspension procedure and roles of the supervisors.

Insights

Further reading

All insights

Management Square in figures

300+
projects completed
43+
clients supported
Since2015
serving our clients
  • Allianz
  • Euler Hermes
  • Groupe BPCE
  • ODDO BHF
  • Candriam
  • Ledger
  • Saur
  • Veolia
  • Voltalia
  • emeis
  • Bonpoint
  • Legal Suite

FAQ

Frequently asked questions

Another question? Ask us

What is an AI agent?

An AI agent is a system that uses a language model to achieve a goal in several steps. It decides on an action, calls a tool (an application interface, a database, a search engine), observes the result and chooses the next step. It differs from a conversational assistant in its ability to act on applications, and not merely to produce text.

What is the difference between an AI agent and a chatbot?

A chatbot answers a message with text, and the user decides what to do with it. An AI agent receives a goal and itself carries out a sequence of actions to achieve it, for example looking up a file, updating a record and then notifying a contact. The consequence of an error is therefore not the same: incorrect text can be reread, a wrong action has already taken effect.

Which processes should be entrusted to AI agents?

Good candidates are frequent tasks whose result can be checked objectively and whose errors can be corrected: preparing files, reconciliations, sorting and routing requests, gathering information across several applications. Decisions with serious consequences for a person, or that are hard to reverse, require at the very least human approval before action.

How do you prevent an AI agent from carrying out an unwanted action?

By placing the limits in the system and not in the instruction given to the model. The agent only has the tools and rights needed for its task, irreversible actions go through human approval, caps limit amounts, volumes and the number of steps, and every tool call is logged. A shutdown procedure makes it possible to suspend the agent immediately.

Do you need a multi-agent system?

Not to start with. A multi-agent system splits a task between several specialised agents coordinated by an orchestrator, which makes it harder to test and trace. It is justified when the task is long and combines distinct skills. In many cases, an orchestrated workflow or a single agent equipped with a few tools delivers the same service with fewer risks.

A project to bring to completion?

A first conversation is enough to understand your challenge, identify the right people and tell you frankly what we can bring.