omninoun.
FREN

05 / THE AI AGENTS HANDBOOK

From the answer
to the system.

Understand agents, their tools, orchestration and limitations. A handbook to explore at your own pace.

Transition edition. The existing guide has been preserved. Historical product names and recommendations are not current endorsements; assess the principles against your own constraints.

THE COMMON THREAD

Model → tool → agent → governed system.

A model generates. A tool acts within a defined scope. An agent combines instructions and tools to pursue a mission. The system defines contracts, supervises actions and retains evidence.

Useful autonomy includes boundaries, the ability to abstain and stopping criteria. Explore the ten OEP principles.

01 — THE AI AGENTS & ORCHESTRATORS HANDBOOK

1. 🚀 Introduction & Vision: The Age of Execution

Artificial intelligence is no longer just a chatbot answering questions like ChatGPT or Claude. We are entering the age of execution.

AI becomes operational.

It no longer just advises, it acts. We develop systems capable of making decisions, executing complex tasks, and learning from their errors.

The goal is to free humans from repetitive tasks to focus on strategy and creation.

2. 🔍 Market Reality: Breaking Out of Isolated AI

Most companies use AI in isolation: an employee copies-pastes text into an LLM, retrieves the result, and processes it manually. This is a waste of time and efficiency.

User
➡
LLM (Manual)
➡
Isolated Result
⚡ VS ⚡
Connected Workflow
🔗
AI Orchestration
🔗
Real ROI

The true ROI of AI lies in global orchestration and automation of processes via connected workflows.

3. 🏗️ Technical Pillars: Interconnection

Our approach is based on the interconnection of four major technological pillars:

LLMs

Strategic thinking and decision-making engines.

🔌
n8n

Workflow orchestration and data flow.

RAG

Long-term memory and targeted business context.

APIs

Connection to business tools (CRM, ERP, Slack).

4. Our solutions & actions

We deploy concrete solutions to accompany this transformation:

AI & agent training

Help managers and teams develop the skills to integrate AI into their daily operations.

Advanced prompt builder

An internal tool to structure perfect instructions and obtain optimal results without hallucination, ensuring output reliability.

The engineering manifesto

Our philosophy: technical rigor, rejection of superficial jargon, and implementation of robust architectures (Docker, Controlled Cloud, Sovereignty).

5. 🔄 Expected Transformation: The Augmented Company

Moving from a reactive approach to an AI-augmented company.

💎 Core Values
  • ✅ Transparency
  • ✅ Security
  • ✅ Auditability
  • ✅ Scalability

02 — UNDERSTANDING THE LANDSCAPE

Before choosing a model, understand there is no universal best model. There are profiles adapted to specific use cases. Here's the taxonomy structuring this guide.

The 6 AI Model Profiles

1. UI-first — Visual creators

These models excel at generating interfaces: React components, Tailwind, animations, landing pages and clean HTML/CSS. They have a good sense of visual rhythm and quickly produce usable frontend code.

Strengths
Speed, visual quality, React/Tailwind, responsive design.
Limitations
Less reliable on backend architecture, sometimes generic on designs.
Typical Examples
Gemini Flash, Kimi K2.5

2. Reasoning-first — The Architects

These models think before acting. They break down problems, identify edge cases and propose solid structures. Excellent for complex debugging, refactoring and architecture decisions.

Strengths
Logic, debugging, architecture, coherence on long contexts.
Limitations
Sometimes slower, more verbose, less creative on frontend.
Typical Examples
Claude Sonnet, GPT-5, GLM-5

3. Agent-first — Autonomous Workers

These models are optimised for agentic workflows: tool calling, execution loops and task chains. They can use tools, correct themselves and progress through multiple steps without constant supervision.

Strengths
Tool calling, orchestration, pipelines, autonomy.
Limitations
Sometimes less nuanced on creative tasks or isolated deep-reasoning problems.
Typical Examples
DeepSeek V4, Claude (via API), Qwen with agents

4. Coding-first — Reliable Developers

These models have been extensively trained on code. They understand framework nuances, produce correct and consistent code and handle multi-file projects well.

Strengths
Full-stack, backend APIs, APIs, TypeScript, React Native.
Typical Examples
Gemini Flash, Qwen 3.6 Plus, Claude Sonnet

5. Low-cost — Economic Workers

These models offer strong value for money. Suitable for repetitive tasks, high-volume pipelines, secondary agents and data preprocessing.

Strengths
Very low cost, speed, good general level.
Typical Examples
DeepSeek, Gemini Flash, Claude Haiku

6. Long-context — Document Readers

These models handle contexts of hundreds of thousands of tokens. Useful for analysing large codebases, long documents or maintaining consistency over extended sessions.

Strengths
Extended context, coherence on long sessions.
Typical Examples
Gemini (1M tokens), Claude (200k tokens)

How to Evaluate a Model: The 5 Axes

For each model or use case, evaluate it on these 5 axes:

Axis What it measures Questions to ask
Speed Generation speed Do I need immediate results?
Depth Reasoning quality Is the problem complex or simple?
Cost Price per token/request What is the usage frequency
Autonomy Agentic capability Should it act alone or just respond
Creativity Originality of outputs Is this creative or technical work

The 3 Classic Traps

1. One model for everything

Using the same model for everything because it is simple or familiar is the most common trap. It can also become costly and inefficient over time.

Using GPT-5 to generate simple CSS is like taking a taxi to fetch bread.

2. The Blind Benchmark Trap

Benchmarks measure performance under controlled conditions. They do not measure what matters most: quality on your specific task, in your context, with your constraints. The best model is the one that finishes your work quickly and cleanly, with few retries.

3. “More expensive means better”

False. Modern low-cost models (Gemini Flash, DeepSeek, Haiku) can perform 80% of a premium model’s work for 10% of the price. The real skill is knowing when to pay for capability and when to save.

03 — AI agents & ecosystems directory

A structured technical overview of tools, environments and protocols used in software engineering and automation with autonomous agents.

1. Development AI agents

Autonomous execution systems interacting directly with the code lifecycle: IDEs, CLIs, sandbox environments and Git.

Agent Technical description Official link
Claude Code Anthropic’s native CLI agent, running locally in the terminal. It can read codebases, run tests, manage Git and use MCP servers. Visit website
OpenAI Codex CLI A command-line interface using Codex/GPT models to translate natural-language instructions into executable scripts. Visit website
Gemini CLI A command-line tool for interacting directly with the Gemini API for refactoring and large-context code analysis. Visit website
Cursor Agent An advanced agent mode integrated into the Cursor IDE, capable of planning and applying multi-file changes autonomously. Visit website
Windsurf An agent-native IDE coordinating real-time collaborative workflows between the developer and the agent (Cascade). Visit website
Aider A Git-focused command-line coding assistant for editing existing repositories with commit tracking. Visit website
Goose A model-agnostic open-source agent (Block/Agentic AI Foundation). Runs directly on the machine through CLI or desktop to automate build and refactoring recipes without requiring Docker. Visit website
OpenHands Successor to OpenDevin. An open-source platform allowing autonomous software agents to modify code and execute commands in a secured Docker sandbox. Visit website
Amp A coding agent developed by Sourcegraph, using its code intelligence engine and semantic repository indexing. Visit website
Freebuff An open-source community alternative focused on modifying local codebases. Visit website
Codebuff An assistant specialising in navigating, refactoring and rewriting large software projects. Visit website
Pi Coding Agent A recent autonomous agent designed to resolve complex architecture tickets and generate unit tests. Visit website

2. AI work environments

Workspaces and cloud IDEs where agents collaborate with users synchronously or asynchronously.

  • Claude Cowork : Anthropic’s collaborative workspace designed to align multiple model instances around shared business or technical objectives. → Link
  • Microsoft 365 Copilot : Microsoft’s agent ecosystem integrated into the enterprise Graph to automate document and communication workflows. → Link
  • ChatGPT (Agent mode) : Advanced asynchronous processing and system tool-calling capabilities in OpenAI’s interface. → Link
  • Perplexity Labs : An experimentation and evaluation environment for real-time information research and data grounding. → Link
  • Manus : A general-purpose interface agent that can browse the web, interact with third-party applications and deliver end-to-end projects in the background. → Link
  • Lovable : A full-stack application builder (vibe coding) generating code, interfaces and infrastructure from natural-language descriptions. → Link
  • Bolt.new : A browser-based development sandbox for designing, running and deploying full-stack applications based on Vite and Node. → Link
  • Replit : A cloud platform with native editing and deployment agents to move from a prompt to a production application. → Link

3. Agent orchestrators

High-level frameworks managing task distribution, memory and multi-agent collaboration.

  • OpenClaw : An open-source orchestration solution for deploying, configuring and connecting autonomous agents to third-party channels such as Telegram and REST APIs. → Link
  • Hermes Agent : An advanced processing agent focused on autonomous background tasks and standardised tool interaction. → Link
  • CrewAI : A role-based orchestration framework built around agents, tasks and tools to model engineering or operational teams. → Link
  • LangGraph : A LangChain extension modelling agent flows as cyclic graphs for complex iterative behaviour. → Link
  • AutoGen : Microsoft’s framework for developing multi-agent systems that converse to solve problems. → Link
  • Semantic Kernel : Microsoft’s open-source SDK for integrating LLMs with conventional languages such as C#, Python and Java. → Link
  • PydanticAI : A type-safe application framework for production agents, with strict data-structure validation through Pydantic. → Link
  • Smolagents : A lightweight Hugging Face framework focused on simplicity and agent-written native Python code for executing actions. → Link

4. Web agents

Agents specialising in DOM interaction, browsing and automating web processes on behalf of a person.

  • OpenAI Operator : An autonomous agent designed to operate a browser or system and execute complex workflows on request. → Link
  • Browser Use : A Python framework connecting an LLM to a Chromium browser for semantic interaction with web page elements. → Link
  • Skyvern : A solution using computer vision and LLMs to automate workflows on complex websites or sites without APIs. → Link
  • Stagehand : An open-source browser automation framework built on Playwright, optimised for robust AI-guided actions. → Link
  • Browserbase : A cloud infrastructure platform for running, managing and monitoring fleets of headless browsers for AI agents. → Link
  • Steel Browser : A managed cloud browser optimised for AI agents, with integrated browser fingerprint and proxy management. → Link

5. Automation & workflows

Integration platforms connecting LLMs and agents to databases and third-party APIs through pipeline architectures.

  • n8n : A low-code/native-code workflow automation platform with advanced AI nodes. Used to connect PostgreSQL, vector databases and asynchronous data-processing architectures. → Link
  • Make : A visual automation tool for building API integration scenarios and text-data routing. → Link
  • Zapier : A mainstream solution for quickly connecting SaaS applications with basic agent-calling features. → Link
  • Flowise : A low-code interface for designing and hosting applications based on LangChain and RAG architectures. → Link
  • Dify : A unified LLM application development platform combining prompt management, retrieval-augmented generation and operational orchestration. → Link
  • Langflow : A visual rapid-prototyping environment for AI architectures using reusable modular components. → Link

6. Agent development frameworks

Core libraries and SDKs for developing custom cognitive architectures.

  • LangChain : A pioneering framework for assembling AI components, processing chains and tool connectors. → Link
  • LlamaIndex : A framework specialising in ingesting, indexing and querying heterogeneous data structures with LLMs. → Link
  • DSPy : A declarative programming framework replacing manual prompt engineering with algorithmic optimisation of prompts and model weights. → Link
  • Haystack : A modular open-source AI orchestration framework for building custom RAG and semantic search systems. → Link
  • Agno : An agent development framework with native state management and multi-model support. → Link
  • Mastra : A modern TypeScript/JavaScript framework for integrating agentic features and workflow management into Node.js and frontend applications. → Link
  • Atomic Agents : A modular, atomic development approach for predictable, reusable tools and sub-agents. → Link

7. Interoperability protocols

The standardised layer for structured communication between agents, servers and clients.

Protocol Technical role Importance / maturity
MCP (Model Context Protocol) An open standard developed by Anthropic connecting models to secured data sources (GitHub, Slack, SQL databases and Docker environments) through a unified API. ⭐⭐⭐⭐⭐
A2A (Agent-to-Agent) An emerging specification for message routing, subtask delegation and context negotiation between separate autonomous systems. ⭐⭐⭐⭐⭐
ACP (Agent Communication Protocol) An open inter-agent messaging standard supporting consistent formatting and integrity across distributed communications. ⭐⭐⭐⭐
OpenAPI Specification A formal description of REST API endpoints, allowing agents to generate HTTP requests dynamically without human intervention. ⭐⭐⭐⭐
JSON Schema Strict definitions of input/output data structures. Essential for constraining model Structured Output and avoiding type-parsing errors. ⭐⭐⭐⭐
OAuth 2.0 An authorisation delegation framework allowing agents to access third-party resources securely on the user’s behalf. ⭐⭐⭐⭐
SSE (Server-Sent Events) A one-way streaming protocol for receiving token streams in real time (token streaming) and agent execution logs. ⭐⭐⭐
WebSocket A persistent bidirectional communication channel for real-time state synchronisation and synchronous multi-agent collaboration. ⭐⭐⭐

8. Useful resources

  • Prompts : Collections of system-context configurations and structured optimisation techniques, such as decomposition and diagnostic approaches.
  • Templates : Preconfigured code skeletons for quickly starting multi-agent architectures or MCP servers.
  • llms.txt : A configuration file at a website’s root intended to provide clean semantic context for AI agent crawlers.
  • Benchmarks : Test protocols and performance metrics (SWE-bench, GAIA) evaluating agents’ ability to solve real problems.
  • Tutorials : Technical documentation and implementation guides for data-process automation and engineering pipelines.

04 — AGENTIC THINKING

What is an Agent? (Not the Marketing Definition)

The word "agent" is everywhere. It's often misused. Here's the definition that matters operationally:

An AI agent is a model that can take actions in the real world: call APIs, read files, write code, browse the web and send messages, chaining those actions autonomously to pursue a goal.

What distinguishes an agent from a simple chatbot:

  • It has access to tools (tools / function calling)
  • It can act over several steps without human intervention at every step
  • It can self-correct based on intermediate results
  • It maintains state and memory over the duration of a task

An agent doesn't respond — it does.

Orchestration vs Execution: The Fundamental Distinction

The most common confusion in AI projects is mixing two roles that must remain separate:

Orchestration Execution
Decides what to do Does what is decided
Chooses the right agent for each task Executes a specific task
Handles errors and redirects Reports errors
Maintains global vision Maintains local focus
Models: Claude Sonnet, GPT-5 Models: DeepSeek, Haiku, Gemini Flash

Classic error: using a powerful and expensive model for executing simple tasks. Result: exploding bill, unnecessary latency, no quality gain.

The right approach: lightweight model for execution, intelligent model for orchestration — and human for final supervision.

The new agentic work flows

Workflow 1 — Task decomposition

Before launching anything, you decompose. Practical example:

Objective: Create a user profile page with photo, bio, and activity history

  1. Design the data structure (backend API model) → Qwen
  2. Create the API endpoints → Qwen
  3. Generate main React component Gemini Flash
  4. Create sub-components (photo, bio, history) Gemini Flash
  5. Integrate and test consistency → GLM-5 or Claude Sonnet

Each step is clear, assignable, verifiable. That's agentic decomposition.

Flow 2 — Intelligent Routing

Routing is the real-time decision: For this specific task, which model?

Routing criteria:

  • Task complexity (simple → Haiku/Flash; complex → Sonnet)
  • Task type (UI → Kimi/Gemini; backend → Qwen; debugging → GLM-5)
  • Acceptable cost (repetitive task → low-cost; critical task → premium)
  • Required speed (real time → Flash; reflection → Sonnet)

A good routing system can automate these decisions. But even manually, developing this reflex changes everything.

Flow 3 — Feedback Loop

Agents don't do everything right the first time. The strength is in the loop:

  1. The agent produces a result
  2. You (or another agent) evaluate the result
  3. If satisfactory: move to next step
  4. If unsatisfactory: fix prompt, retry, or change model

This loop short-circuits the mental model I send a prompt and hope. It replaces hope with control.

Workflow 4 — Context memory

A major problem with agents: they forget. Most models don't have persistent memory between sessions.

Practical solutions:

  • Provide relevant context on every call (“here is where we are”)
  • Maintain a state file the agent can read and update
  • Use memory tools such as vector databases and automatic summaries
  • Structure short sessions with explicit checkpoints

The Human in the Loop: When to Supervise, When to Let Go

Human supervision has a cost: your time and attention. It must be reserved for moments when it adds value.

Supervise actively Let run
Irreversible decisions Repetitive, tested tasks
First execution of a workflow Stable pipelines with logs
Public or client outputs Internal preprocessing
Large amounts / sensitive data Classification / low-value extraction
New agents / tools Agents already validated on hundreds of cases

The golden rule: supervise until you have confidence. Let go once you have reliable quality metrics.

Agentic Anti-Patterns: Mistakes to Avoid

Anti-pattern 1 — Too Much Autonomy Too Early

Giving an agent access to critical systems before validating its behavior on simple cases. Result: badly executed irreversible actions.

Rule: always start in read-only mode, then grant permissions progressively.

Anti-pattern 2 — Poor context management

Launching an agent on a long task without passing relevant history. It forgets the beginning, produces incoherent outputs.

Rule: Always include the minimum necessary context: neither too much (context pollution) nor too little (loss of consistency).

Anti-pattern 3 — Runaway cost

Using a premium model for all pipeline steps, including the simplest. Result: bill x10 with no quality gain.

Rule: profile each step, assign the cheapest model that does the job well.

Anti-pattern 4 — Too Vague Prompt

“Do something interesting with this data.” Agents handle ambiguity less well than people. The result: unpredictable outputs and repeated retries.

Rule: Be as precise as you would with a junior colleague: expected format, constraints and examples where possible.

Anti-pattern 5 — No Error Handling

A pipeline that doesn't anticipate what happens when an agent fails. It crashes, nothing continues.

Rule: Always plan a fallback: another model, a reduced output or a human alert.

05 — AGENTIC THINKING

Moving from theory to production involves implementing agentic thinking on your machine (through configuration files such as CLAUDE.md or .clauderc) using a six-step protocol. This workflow is intended to turn a simple chatbot into a reliable autonomous software engineer.

1. Planning by default

Before any changes, the agent enters a planning phase. It maps the directory structure, inspects dependencies and lists affected files. A written action plan is submitted for approval before execution.

Before writing or changing code, begin a planning phase. Analyse the existing directory structure, read the necessary files and write a structured action plan. Wait for my explicit approval before execution.

2. Sub-agent strategy

To avoid context overload, the main agent delegates to specialised sub-agents. Each handles a focused task such as tests, parsing or UI, supporting precision and modularity.

For complex tasks involving more than three files or different technologies, such as frontend and backend, act as an orchestrator. Break down the work and generate focused micro-prompts for your sub-agents or your own future iterations.

3. Improvement loop

The agent reviews and critiques its own code before submission. It checks for security issues, duplication, unnecessary complexity and missing types. Corrections are applied within this short loop.

After writing code, critically review it before presenting it. Check for security flaws, duplication (DRY), unnecessary complexity (KISS) and missing types. Correct your own errors during this phase.

4. Verification before delivery

A task is validated only after unit tests and the production build succeed. Otherwise, it remains open.

Do not declare a task complete or ask me to test it unless you have run the project’s tests and production build in the terminal. Successful execution of these commands is the acceptance criterion.

5. Keep it simple

Code should remain simple, robust and readable. Avoid over-engineering or heavy frameworks when a native solution is sufficient. Prefer elegance to unnecessary complexity.

Seek architectural simplicity. Do not propose over-engineering or heavy frameworks when a simple native solution is suitable. Keep code minimal, modern, readable and documented to explain why it exists.

6. Autonomous error correction

When tests or builds fail, the agent analyses logs, isolates the bug and proposes a correction. It repeats the edit loop without involving a person unless the blocker persists.

If a test or build command fails at step 4, do not interrupt execution to ask for help. Analyse the logs, locate the failing line, form a new hypothesis and correct the issue autonomously.

06 — READING LEVELS

This guide is designed to be read and re-read as you progress. Here's how to approach it based on your current level.

Beginner Level — Where to Start

You're discovering AI models or just started using them in your workflow.

What to remember

  • There is no single “best model”: there are models suited to different uses
  • Start with Gemini 2.5 Flash for most of your coding tasks
  • Add Qwen 3.6 Plus as soon as you work on Python/Django backend
  • Use Claude Sonnet when you're stuck on something really difficult

The minimum setup to get started

  • Gemini Flash → your default everyday model
  • Qwen → your backend model
  • A premium model (Claude Sonnet or GPT-5) → your safety net

What You Don't Need to Understand Yet

  • Multi-agent orchestration can come later
  • Start with manual routing before automating it
  • Validate simple cases before building complex pipelines

Intermediate Level — Combining Models

You already use several models but intuitively, not yet systematically.

What to incorporate

  • Develop the reflex which model for this specific task before each session
  • Apply stack patterns (IV) rather than choosing case by case
  • Start decomposing large tasks into assignable sub-tasks
  • Set up short feedback loops

Key skills to develop

  • Write precise prompts with context, expected format and constraints
  • Recognise when to switch models (disappointing results → try another model)
  • Manage context manually between sessions

Your first agent to build

A simple agent that takes a React component specification, breaks it into steps and generates each part with an appropriate model. Keep it simple, while learning to think in workflows.

Advanced Level — Orchestration & Architectures

You master the basics and want to build robust agentic systems.

What to build

  • Automatic routing based on task type and complexity
  • Pipelines with error handling, fallbacks and logs
  • A persistent memory layer, using a vector database or structured state file
  • Automated quality metrics for evaluating agent outputs

Architectures to explore

  • Hierarchical agents: an orchestrator + specialized workers
  • Parallel agents: several agents on independent sub-tasks simultaneously
  • Self-correcting agents: validation loop integrated in each agent
  • Human-in-the-loop: supervision points automatically triggered on uncertain cases

The central question at this level

How do you build a system that remains reliable as its autonomy increases? Through tests, metrics, logs and progressively adjusted supervision.

Progression table

Level Core skill Typical setup Next step
Beginner Choose the right model for each use Gemini + Qwen + 1 premium Apply a stack pattern
Intermediate Combine models, decompose tasks SaaS or Low-cost Stack Build a first simple agent
Advanced Orchestration, routing and robust pipelines Budget elite setup Multi-agent architecture with metrics

07 — APPENDICES

A. Glossary

Key terms of this guide, defined without unnecessary jargon.

AI Agent
An AI model capable of taking actions autonomously using tools, following multiple steps and correcting itself.
Context Window
The maximum amount of text a model can process at once. A 1M-token context can analyse an entire novel in one pass. Relevant to long projects.
Fine-tuning
Additional training on specific data to improve a model’s performance in a particular domain.
Hallucination
When a model confidently produces false information. Common with specific facts, dates and names. Always verify critical content.
Orchestration
Coordinating multiple agents or models to complete a complex task. The orchestrator decides who does what and in which order.
RAG (Retrieval-Augmented Generation)
A technique that lets a model retrieve information from a database before responding. It can reduce hallucinations and support access to recent data.
Routing
Choosing a model for a task based on its characteristics. Routing can be manual (you decide) or automatic (a system decides).
System Prompt
An instruction given before the conversation to define the model’s role, tone and constraints. Useful for customising behaviour.
Temperature
A parameter controlling the model’s randomness. Lower values tend towards more predictable results; higher values produce more varied outputs. Use a low value for code and a higher value for creative exploration.
Token
The basic unit processed by models. In French, a token is roughly 0.75 words. Model usage costs are calculated in tokens: 1,000 tokens is approximately 750 words.
Tool Calling (Function Calling)
A model’s ability to call external functions or APIs: searching the web, reading a file or sending an email. A fundamental building block for agents.

B. Quick Decision Matrix

To quickly choose the right model according to the situation:

Situation Recommended model Reason
Standard React/frontend framework component Gemini Flash Speed + frontend quality
Complex backend API model Qwen 3.6 Plus Excellent Python/ORM
Inexplicable bug GLM-5 or Claude Sonnet Deep reasoning
Creative landing page Kimi K2.5 Visual creativity
Automated pipeline DeepSeek V4 Very low cost, tool calling
Small CSS correction Claude Haiku Fast and cheap
Critical system architecture Claude Sonnet / GPT-5 Maximum intelligence
Long session (100k+ tokens) Gemini or Claude Large context
Massive multi-file refactoring Claude Sonnet Coherence on large context
High-volume testing/classification DeepSeek or Haiku Volume + cost

C. This Guide is Living

The AI model market changes quickly. A model recommended today may be surpassed in six months. New competitors can emerge overnight.

This guide needs regular updates. Principles such as agentic thinking, orchestration, routing and stack patterns remain useful, while recommendations for specific models evolve.

Treat it as a living system: record your observations, add your use cases and challenge anything that no longer fits your reality.

The best guide is the one you adapt to your reality.