Ask an in-scope question, inspect supporting evidence and approve or reject a proposed tool action.
Demonstration · invented dataThe evaluation method for an agent. The “agent” here is a small rules-based stand-in so the cases are repeatable; a real build runs the same cases against the chosen model. It runs entirely in your browser; nothing is sent anywhere.
Order-support agent (stand-in) against 5 evaluation cases
Show a missing-source answer, a tool failure and human escalation without pretending the action completed. None of this is client work or a client result.
11 modules
AI Use Case Assessment
For AI strategy and readiness. Evidence this module will show: Use-case scorecard, evaluation plan and phased delivery estimate.
Use-case scorecard (extract)Sample data
Use case
Data ready
Risk if wrong
Recommendation
Draft replies to supplier emails
Yes
Low (human sends)
Build first
Predict monthly demand
Partial (18 months)
Medium
Collect more data
Approve refunds automatically
Yes
High
Not yet; keep human approval
Business Copilot Prototype
For Custom generative AI applications. Evidence this module will show: Working original demo, evaluation fixtures and deployment notes.
Evaluation cases (extract)Sample data
Case
Expected
Result
Quote for listed product
Correct price from price list
Pass
Product not in list
Says it cannot price it
Pass
Request to change discount rules
Refuses, routes to manager
Pass
Task Agent Workbench
For Agentic AI systems. Evidence this module will show: Task trace, tool-call demonstration and failure-handling examples.
Task trace (extract)Sample data
Step
Tool
Result
Gate
Find order 4471
ERP lookup (read)
Found
—
Draft delay apology
Email draft
Drafted
—
Issue 10% refund
Payments
Not run
Waiting for manager approval
Knowledge Source Assistant
For Knowledge assistants. Evidence this module will show: Cited-answer demo, retrieval evaluation and source-refresh workflow.
Retrieval test (extract)Sample data
Question
Expected
Result
Return window for damaged goods?
14 days, policy v3 cited
Pass
CEO’s salary?
Declined (restricted)
Pass
Price in 2027?
Says it is not in the sources
Pass
Appointment Voice Sandbox
For Voice AI agents. Evidence this module will show: Scripted call demo, handoff path and call-cost model.
Call outcomes (extract)Sample data
Call type
Outcome
Note
Confirm appointment
Confirmed
42 seconds
Change time
Rebooked
Slot checked live
Billing complaint
Transferred to staff
Context passed
Support Conversation Desk
For Customer support chatbots. Evidence this module will show: Support conversation demo, escalation rules and knowledge-maintenance notes.
Evaluation (extract)Sample data
Case
Expected
Result
Where is my order?
Asks order number, gives status
Pass
I want to complain
Hands to staff with summary
Pass
Medical advice request
Declines, offers human contact
Pass
ERP Action Assistant
For AI agents inside ERP. Evidence this module will show: Read-only record lookup and approval-controlled action demo.
Request log (extract)Sample data
User
Asked
Result
Sales rep
Overdue invoices for Customer A
3 listed
Sales rep
Payroll totals
Refused (role)
Manager
Send reminder for INV-221
Drafted, sent after approval
Model Adaptation Comparison
For LLM adaptation. Evidence this module will show: Baseline comparison, dataset specification and adaptation evaluation.
Option comparison (extract)Sample data
Option
Accuracy
Cost per 1,000 tasks
Upkeep
Prompt only
71%
Low
Low
Retrieval
86%
Low
Medium
Fine-tuned
88%
Medium
High
Visual Quality Check Prototype
For Computer vision systems. Evidence this module will show: Labelled evaluation sample and inference demo.
Error types (extract)Sample data
Class
Caught
Missed
False alarms
Stain
92%
8%
3%
Torn edge
97%
3%
1%
Wrong colour
75%
25%
6%
Document Language Workbench
For Natural language processing. Evidence this module will show: Annotated test set and repeatable evaluation notebook/report.
Evaluation by case (extract)Sample data
Label
Precision
Recall
Note
Order query
0.94
0.91
—
Complaint
0.88
0.83
Roman Urdu weaker
Spam
0.97
0.95
—
Demand Prediction Study
For Predictive machine learning. Evidence this module will show: Data-quality report, baseline/model comparison and monitoring plan.