Calculating Category Scores

The Spreadsheet Does the Math

Good news! You don't calculate scores manually. The spreadsheet does it for you.This lesson explains what's happening behind the scenes so you can verify results make sense.

The 11 Categories

Each of the 66 criteria belongs to one of 11 categories:

Clarity & Understanding
Trust & Transparency
Contextual Relevance
Conversation Quality
User Control & Autonomy
Learning & Personalization
System Updates & Stability
Efficiency & Task Completion
Security & Privacy
RAG-Specific

How Scores Are Calculated

The spreadsheet counts what you marked YES (violated) in each category, weighted by severity:

0 issues OR 1 MINOR only - 5 Stars

2 MINOR, no MAJOR/CRITICAL - 4 Stars

1 MAJOR OR 3+ MINOR - 3 Stars

2+ MAJOR OR 1 CRITICAL - 2 Stars

2+ CRITICAL - 1 Stars

Critical Issues Cap Scores

A category with 10 passes and 1 CRITICAL violation still scores low (2 stars). Severity matters more than volume.

Your workflow:

Step 1. Mark YES/NO/N/A on criteria

Step 2. Scores auto-calculate

Step 3. Review category health

The Spreadsheet

You provide: Honest observationsThe spreadsheet provides: Consistent scoringTrust the formula. Focus on the audit.

Calculating Category Scores

You must be logged in to access this course

Foundation

Agent Experience Assessment

Task Scenario Library

Failure Patterns

Real Audit Example

Downloads & Templates