07 Deterministic vs Autonomous Behavior (NEW, COMPACT)

What you'll learn


Two types of agent behavior:

Deterministic: Agent follows predefined rules

  • Example: IF price > £100 THEN require manager approval
  • Predictable, auditable, compliant
  • No surprises

Autonomous: Agent makes decisions based on context

  • Example: Agent decides whether to escalate based on conversation flow
  • Flexible, adaptive, intelligent
  • Can surprise users

Key insight:"Autonomy ≠ danger. Determinism ≠ dumb.

The art is combining them appropriately:

  • Discovery: High autonomy (explore broadly)
  • Evaluation: Medium autonomy (suggest options)
  • Commit: Low autonomy (follow rules, require approval)
  • Fulfilment: Medium autonomy (handle expected issues)
  • Support: Escalate to human (high-stakes decisions)"

Includes four-quadrant chart:

High Autonomy, High Risk = DANGEROUS (avoid at commit)
High Autonomy, Low Risk = HELPFUL (great for discovery)
Low Autonomy, High Risk = SAFE (required at commit)
Low Autonomy, Low Risk = RIGID (unnecessary constraints)

Visibility & Transparency Rules

What the user must see, what must stay hidden, and how to design trust in multi-agent systems

Visibility and transparency are not about showing everything your system does.

They are about:

  • showing the right things

  • at the right time

  • in the right level of detail

  • for the right user action

In multi-agent systems, transparency is a design discipline, not a data dump.

1. Transparency ≠ Full Disclosure

A common mistake:

“If the system is complex, just show everything it’s doing.”

This destroys trust.

Users do not want to see:

  • tool calls

  • agent names

  • debug logs

  • JSON errors

  • confidence graphs

  • chain-of-thought reasoning

They want:

  • understanding

  • predictability

  • control

Not complexity.

UX rule:

Reveal purpose, hide mechanics.

2. The Three Layers of Visibility

Multi-agent systems require three distinct transparency layers:

Layer 1 — Intent Transparency

What the system is trying to do

Users must always understand:

  • why the system is acting

  • what goal it is pursuing

  • whether it aligns with their intent

Example:

“Comparing your flight options…”
“Drafting three variations…”

This prevents fear and uncertainty.

Layer 2 — Process Transparency

Where the system is in the workflow

Users must know:

  • whether to wait

  • whether to continue

  • whether the system is stuck

  • what step comes next

Good signals:

“Checking availability…”
“Coordinating with payment…”
“Reviewing your preferences…”
Progress indicators
Clear phases

Avoid:

✘ “Calling booking agent…”
✘ “Retry count: 3”
✘ “Worker 4 failed”

Layer 3 — Control Transparency

What the user can do now

Users must always know:

  • can they stop?

  • can they undo?

  • can they modify?

  • can they override?

  • can they continue?

This is where AI safety meets UX.

Required controls:

Cancel
Undo
Edit
Approve
Reject
“Start over”

UX rule:

Transparency without control is anxiety.
Control without transparency is confusion.

Both must co-exist.

3. When to Surface Transparency

Always show transparency when:

  • an action takes more than 1–2 seconds

  • context changes

  • irreversible operations are about to occur

  • human input is required

  • the system deviates from the expected flow

Do NOT surface transparency when:

  • the system is retrying internally

  • agents are coordinating backstage

  • low-level errors occur

  • partial computations have no user implication

4. Irreversible Action Transparency

Before any action that cannot be undone:

Users must see:

  • what is happening

  • why it’s happening

  • what the consequences are

  • who is responsible (the system vs the user)

Example:

“Are you sure you want to confirm this purchase for €329?”
“This will overwrite your previous file. Continue?”

This is non-negotiable.

5. Transparency for Multi-Agent Systems

Multi-agent orchestration introduces unique transparency needs:

Required transparency points:

  • when agents hand off context

  • when a task shifts phases

  • when a decision requires human validation

  • when an optional interpretation was chosen (“I assumed you meant…”)

  • when memory influenced behavior

Avoid:

Mentioning specific agents
Mentioning backstage architecture
Mentioning retries, parallel operations

Users shouldn't know:

“Three agents just interacted.”

They should know:

“Your plan is ready. Here are three options.”

6. Transparency for Errors and Recovery

If something breaks:

  • be brief

  • explain the effect, not the cause

  • provide actionable steps

  • offer alternative paths

Bad:

✘ “ToolError: 502 Bad Gateway from API.”

Good:

“I wasn’t able to complete that. Would you like to try again or choose another option?”

Visibility must be:

  • human-centered

  • non-technical

  • action-oriented

7. Transparency for Memory-Influenced Behavior

If the system uses memory:

  • users must know

  • users must control it

Required transparency:

“I used your previous preference (window seat). Want to change it?”
“I remembered your writing style. Should I keep using it?”

This prevents “creepy” surprises.

8. Transparency in Voice, Screen, and Multimodal Agents

Voice

Must use explicit spoken cues:

  • “Let me check…”

  • “One moment…”

  • “I’m coordinating this for you…”

Screen

Use:

  • progress bars

  • cards

  • status messages

  • optional detail reveals

Multimodal

Transitions must be clear:

  • “I’ve placed the results on your screen.”

  • “Tap to continue.”

9. The Transparency Triangle (Use This in Slides)

Users need three things at all times:

1. What is happening?

(intent + phase)

2. Why is it happening?

(meaning + context)

3. What can I do now?

(control options)

If any corner is missing:

  • users feel lost

  • trust collapses

  • perceived intelligence drops

Summary

A transparent system is not one that reveals everything.
It is one that reveals exactly what the user needs to stay confident, safe, and in control.

Design transparency deliberately — not as an afterthought.

Comments are closed.

{"email":"Email address invalid","url":"Website address invalid","required":"Required field missing"}
Scroll to Top