{"slug":"strategy/product-strategy/ai-workbench-spec","title":"IntegrateWise — AI Workbench Specification","section":"strategy","sectionLabel":"Strategy","status":"unclassified","type":"document","path":"strategy/product-strategy/ai-workbench-spec.mdx","bytes":67841,"description":null,"updated":null,"source":"integratewise/Integratewise-docs-wiki","content":"\n> **Version:** 1.0.0 | **Date:** 2026-07-03 | **Status:** Human-First AI Management Surface  \n> **Philosophy:** The AI Workbench is where humans manage the AI's work. It is separate from the human workbench. It is organized. It is human-controlled.\n\n---\n\n## Table of Contents\n\n1. [What the AI Workbench Is](#what-the-ai-workbench-is)\n2. [What the AI Workbench Is NOT](#what-the-ai-workbench-is-not)\n3. [The Seven AI Workbench Panels](#the-seven-ai-workbench-panels)\n4. [Navigation & Access](#navigation--access)\n5. [Human Control Model](#human-control-model)\n6. [Data Flow](#data-flow)\n7. [States & Interactions](#states--interactions)\n8. [Accessibility](#accessibility)\n9. [TypeScript Interfaces](#typescript-interfaces)\n10. [Appendix: Difference from Audit Logs](#appendix-difference-from-audit-logs)\n\n---\n\n## What the AI Workbench Is\n\nThe AI Workbench is a **dedicated management surface** where humans can:\n\n- **Review** all AI proposals in one place, organized and filterable\n- **Organize** AI actions into categories, projects, or workflows\n- **Monitor** AI performance — accuracy, acceptance rates, outcomes\n- **Explore** AI memory — what the AI knows, how it learned it, confidence levels\n- **Adjust** AI behavior — thresholds, scope and review-priority rules\n- **Audit** AI decisions in context, not just as a raw log\n- **Manage** AI workflows — what the AI is running, what it will run, what it completed\n\nThe AI Workbench is **the human's window into the AI's operations**. It is not the AI's window into itself. The AI does not \"use\" this interface. Humans use it to manage the AI.\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  HUMAN WORKBENCH          │  AI WORKBENCH (separate tab)       │\n│  ─────────────────        │  ─────────────────────────────     │\n│  Entity list              │  Proposals Queue                   │\n│  Detail pane              │  AI Actions History                │\n│  Human actions            │  AI Memory Explorer                │\n│  Timeline                 │  AI Workflow Monitor               │\n│  Search                   │  AI Performance Dashboard          │\n│  Projections              │  AI Governance Settings            │\n│                           │  AI Model Management               │\n│  → Human does work here   │  → Human manages AI here           │\n│  → AI is subtle, ambient  │  → AI operations are surfaced     │\n│  → AI helps when asked    │  → Human controls and organizes   │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n---\n\n## What the AI Workbench Is NOT\n\n| NOT This           | Because                                                                                                       |\n| ------------------ | ------------------------------------------------------------------------------------------------------------- |\n| **AI Home / Chat** | The AI Home is for conversation. The AI Workbench is for management.                                          |\n| **Audit Logs**     | Audit Logs are passive historical records. The AI Workbench is active operational control.                    |\n| **AI Dashboard**   | The AI does not own this. The human does. It is not \"AI's dashboard\" — it is \"human's AI management surface.\" |\n| **Default View**   | The human workbench is the default. The AI Workbench is a secondary, opt-in surface.                          |\n| **Auto-Executing** | Nothing in the AI Workbench auto-executes. Every action requires human approval.                              |\n| **AI-Proposed UI** | The AI does not redesign this interface. Humans configure it.                                                 |\n\n---\n\n## The Seven AI Workbench Panels\n\n### Panel 1: Proposals Queue\n\n**Purpose:** All AI proposals, organized and actionable.\n\n**Layout:**\n\n```\n┌──────────────────────────────────────────────────────────────┐\n│  Proposals Queue                                  [Filter ▼] │\n│  ─────────────────────────────────────────────────────────── │\n│  ┌─────────────────────────────────────────────────────────┐│\n│  │ [○] All   [○] Pending   [○] Approved   [○] Rejected   [○]││\n│  │     Executed                                              ││\n│  └─────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ ⚠️  PENDING (3)                                          ││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Acme Corp health dropped to 62. Escalate to VP?       │││\n│  │ │ Confidence: 82%  │  Source: Twin  │  Time: 2h ago      │││\n│  │ │ [View Context]  [Approve]  [Modify]  [Dismiss]        │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Schedule QBR with Northwind for next week?              │││\n│  │ │ Confidence: 91%  │  Source: Twin  │  Time: 5h ago       │││\n│  │ │ [View Context]  [Approve]  [Modify]  [Dismiss]        │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Draft follow-up email to Meridian's champion?         │││\n│  │ │ Confidence: 76%  │  Source: Twin  │  Time: 1d ago       │││\n│  │ │ [View Context]  [Approve]  [Modify]  [Dismiss]        │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ ✅  APPROVED (12 today)                                    ││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Escalated Acme Corp to VP CS — executed 2h ago        │││\n│  │ │ Confidence: 82%  │  Approved by: Sarah  │  Outcome: ✓   │││\n│  │ │ [View Details]                                          │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Scheduled Northwind QBR — executed 5h ago             │││\n│  │ │ Confidence: 91%  │  Approved by: Sarah  │  Outcome: ✓   │││\n│  │ │ [View Details]                                          │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  └──────────────────────────────────────────────────────────┘│\n└──────────────────────────────────────────────────────────────┘\n```\n\n**Key Features:**\n\n- **Filter tabs:** All / Pending / Approved / Rejected / Executed\n- **Batch actions:** Select multiple proposals → Approve All / Dismiss All / Modify All\n- **Context view:** Click \"View Context\" → see Entity360 + reasoning trace + evidence\n- **Confidence visible:** But not dominant. Small badge, not large score.\n- **Time-ordered:** Most recent first. Human scans quickly.\n- **No auto-execute:** Every proposal requires human action. No \"auto-approve after X hours.\"\n\n**States:**\n\n- Empty: \"No pending proposals. The AI is watching.\"\n- Loading: Skeleton cards for proposals.\n- Error: \"Could not load proposals. Retry.\"\n- Success: Proposal list with actions.\n\n---\n\n### Panel 2: AI Actions History\n\n**Purpose:** What the AI did, when, why, and the outcome.\n\n**Layout:**\n\n```\n┌──────────────────────────────────────────────────────────────┐\n│  AI Actions History                               [Filter ▼] │\n│  ─────────────────────────────────────────────────────────── │\n│                                                              │\n│  ┌─────────────────────────────────────────────────────────┐│\n│  │ [○] All Actions  [○] Proposals  [○] Executions  [○]    ││\n│  │     Enrichments  [○] Memory Updates  [○] Tool Calls  ││\n│  └─────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Timeline                                                   ││\n│  │                                                            ││\n│  │  Today                                                     ││\n│  │  ───────────────────────────────────────────────────────── ││\n│  │  09:14 AM  ├─ Escalated Acme Corp to VP CS                ││\n│  │            │  Confidence: 82%  │  Approved by: Sarah      ││\n│  │            │  [View Details]  [View Entity360]            ││\n│  │                                                            ││\n│  │  07:30 AM  ├─ Scheduled Northwind QBR for 2026-07-10     ││\n│  │            │  Confidence: 91%  │  Approved by: Sarah      ││\n│  │            │  [View Details]  [View Entity360]            ││\n│  │                                                            ││\n│  │  Yesterday                                                 ││\n│  │  ───────────────────────────────────────────────────────── ││\n│  │  04:22 PM  ├─ Enriched Acme Corp entity with 3 new      ││\n│  │            │  contacts from LinkedIn                      ││\n│  │            │  Confidence: 88%  │  Auto-approved (enrich) ││\n│  │            │  [View Details]  [View Entity360]            ││\n│  │                                                            ││\n│  │  02:15 PM  ├─ Twin analyzed Q2 churn pattern             ││\n│  │            │  Confidence: 95%  │  Read-only (no action)  ││\n│  │            │  [View Details]  [View Report]               ││\n│  │                                                            ││\n│  └──────────────────────────────────────────────────────────┘│\n└──────────────────────────────────────────────────────────────┘\n```\n\n**Key Features:**\n\n- **Timeline view:** Chronological, grouped by day.\n- **Action types:** Proposal (human-approved), Execution (AI performed), Enrichment (data added), Memory Update (pattern learned), Tool Call (external API), Read-only (analysis only).\n- **Context links:** Every action links to the entity, the proposal, the reasoning trace.\n- **Outcome tracking:** Did the action succeed? What was the result?\n- **Filter by type:** Human can see only \"executions\" or only \"proposals\" or only \"enrichments.\"\n\n**Difference from Audit Logs:**\n\n- Audit Logs = passive compliance record (what happened for legal reasons)\n- AI Actions History = active operational record (what the AI did for operational understanding)\n\n---\n\n### Panel 3: AI Memory Explorer\n\n**Purpose:** What the AI knows, how it learned it, and how confident it is.\n\n**Layout:**\n\n```\n┌──────────────────────────────────────────────────────────────┐\n│  AI Memory Explorer                               [Search...]  │\n│  ─────────────────────────────────────────────────────────── │\n│                                                              │\n│  ┌─────────────────────────────────────────────────────────┐│\n│  │ [○] All Memories  [○] Personal  [○] Work  [○] Org     ││\n│  │     [○] AI Patterns                                      ││\n│  └─────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Memory Graph (visual network)                              ││\n│  │                                                            ││\n│  │           ┌──────────┐                                    ││\n│  │           │ Acme Corp│                                    ││\n│  │           │ (entity) │                                    ││\n│  │           └────┬─────┘                                    ││\n│  │                │                                          ││\n│  │    ┌───────────┼───────────┐                               ││\n│  │    │           │           │                               ││\n│  │    ▼           ▼           ▼                               ││\n│  │ ┌────────┐ ┌────────┐ ┌────────┐                            ││\n│  │ │Champion│ │ Health │ │ Risk   │                            ││\n│  │ │John S. │ │ Score  │ │ Level  │                            ││\n│  │ └────────┘ └────────┘ └────────┘                            ││\n│  │                                                            ││\n│  │ [Zoom In]  [Zoom Out]  [Reset View]                        ││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Memory List                                                  ││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Acme Corp's CEO prefers phone calls over email        │││\n│  │ │ Confidence: 95%  │  Source: user input  │  Permanent  │││\n│  │ │ Learned: 2026-01-15  │  Last reinforced: 2026-07-01 │││\n│  │ │ [Reinforce]  [Challenge]  [Delete]                      │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Health drops for Acme correlate with unresolved bugs  │││\n│  │ │ Confidence: 89%  │  Source: AI pattern  │  Active       │││\n│  │ │ Learned: 2026-05-20  │  Repetitions: 7  │  Decay: 23d   │││\n│  │ │ [Reinforce]  [Challenge]  [Delete]                      │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Q1 churn pattern: health < 60 at renewal = 73% churn  │││\n│  │ │ Confidence: 92%  │  Source: AI pattern  │  Cold       │││\n│  │ │ Learned: 2026-04-01  │  Repetitions: 12  │  Decay: 67d  │││\n│  │ │ [Reinforce]  [Challenge]  [Delete]                      │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  └──────────────────────────────────────────────────────────┘│\n└──────────────────────────────────────────────────────────────┘\n```\n\n**Key Features:**\n\n- **Memory Graph:** Visual network of entities, relationships, and knowledge nodes. Human can explore connections.\n- **Memory List:** Text list with confidence, source, tier, decay status.\n- **Human actions:** Reinforce (strengthen), Challenge (reduce confidence), Delete (remove).\n- **Source attribution:** Every memory shows where it came from (user input, AI pattern, external data).\n- **Tier indicators:** Active (hot), Warm, Cold, Permanent — color-coded.\n- **Decay visibility:** Human sees when memories will fade, can choose to reinforce.\n\n**The Human Controls the AI's Memory:**\n\n- The human can delete memories the AI got wrong.\n- The human can reinforce memories that are important.\n- The human can challenge memories that seem questionable.\n- The AI does not delete or modify its own memory without human oversight.\n\n---\n\n### Panel 4: AI Workflow Monitor\n\n**Purpose:** What AI workflows are running, scheduled, or completed.\n\n**Layout:**\n\n```\n┌──────────────────────────────────────────────────────────────┐\n│  AI Workflow Monitor                              [Filter ▼] │\n│  ─────────────────────────────────────────────────────────── │\n│                                                              │\n│  ┌─────────────────────────────────────────────────────────┐│\n│  │ [○] Running  [○] Scheduled  [○] Completed  [○] Failed  ││\n│  └─────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ RUNNING (2)                                                ││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Daily Standup Summary                                  │││\n│  │ │ Trigger: Cron (daily 8:00 AM)                        │││\n│  │ │ Status: ● Running  │  Progress: 3/5 steps            │││\n│  │ │ Next: Send Slack summary to #standups                 │││\n│  │ │ [Pause]  [Stop]  [View Details]                        │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Health Score Update                                    │││\n│  │ │ Trigger: Event (Salesforce update)                    │││\n│  │ │ Status: ● Running  │  Progress: 2/4 steps            │││\n│  │ │ Next: Write updated score to Spine                    │││\n│  │ │ [Pause]  [Stop]  [View Details]                        │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ SCHEDULED (5)                                              ││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Weekly Churn Analysis                                  │││\n│  │ │ Trigger: Cron (weekly, Monday 6:00 AM)                │││\n│  │ │ Next run: 2026-07-07 06:00 AM                         │││\n│  │ │ [Run Now]  [Edit]  [Delete]                            │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  └──────────────────────────────────────────────────────────┘│\n└──────────────────────────────────────────────────────────────┘\n```\n\n**Key Features:**\n\n- **Running workflows:** Real-time progress, step-by-step, human can pause/stop.\n- **Scheduled workflows:** Cron or event-driven triggers, human can run now/edit/delete.\n- **Completed workflows:** History with outcomes, success/failure, logs.\n- **Failed workflows:** Error details, retry options, human investigation.\n- **Human control:** Pause, stop, run now, edit, delete. The human is the operator.\n\n---\n\n### Panel 5: AI Performance Dashboard\n\n**Purpose:** How accurate is the AI? How often are its proposals accepted?\n\n**Layout:**\n\n```\n┌──────────────────────────────────────────────────────────────┐\n│  AI Performance Dashboard                         [Date ▼]   │\n│  ─────────────────────────────────────────────────────────── │\n│                                                              │\n│  ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐       │\n│  │ Proposal │ │ Accepted │ │ Rejected │ │ Accuracy │       │\n│  │  47      │ │  38      │ │  9       │ │  81%     │       │\n│  │ this week│ │ 81%      │ │ 19%      │ │ ↑ 5%     │       │\n│  └──────────┘ └──────────┘ └──────────┘ └──────────┘       │\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Acceptance Rate Over Time                                  ││\n│  │                                                            ││\n│  │  100% │                                                    ││\n│  │   80% │    ██                                              ││\n│  │   60% │    ██  ██                                          ││\n│  │   40% │    ██  ██  ██                                      ││\n│  │   20% │    ██  ██  ██  ██  ██  ██  ██  ██  ██             ││\n│  │    0% └──────────────────────────────────────────────────  ││\n│  │         W1  W2  W3  W4  W5  W6  W7  W8  W9  W10  W11      ││\n│  │                                                            ││\n│  │ [View Details]                                             ││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Top Performing Capabilities                                ││\n│  │                                                            ││\n│  │ Capability          │ Proposals │ Accepted │ Accuracy     ││\n│  │ ────────────────────┼───────────┼──────────┼──────────────││\n│  │ Health Scoring      │     12    │    11    │    92%  ↑    ││\n│  │ QBR Scheduling      │      8    │     7    │    88%  ↑    ││\n│  │ Churn Prediction    │     15    │    11    │    73%  ↓    ││\n│  │ Email Drafting      │     12    │     9    │    75%  →    ││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Recent Failures                                            ││\n│  │                                                            ││\n│  │ ┌────────────────────────────────────────────────────────┐││\n│  │ │ Churn prediction for Dataway was wrong (predicted      │││\n│  │ │ churn, but they renewed). Confidence was 89%.         │││\n│  │ │ [Investigate]  [Retrain Model]  [Adjust Threshold]    │││\n│  │ └────────────────────────────────────────────────────────┘││\n│  └──────────────────────────────────────────────────────────┘│\n└──────────────────────────────────────────────────────────────┘\n```\n\n**Key Features:**\n\n- **Summary cards:** Proposals, accepted, rejected, accuracy.\n- **Trends:** Acceptance rate over time, accuracy changes.\n- **Capability breakdown:** Which AI capabilities perform well, which need tuning.\n- **Failure analysis:** What went wrong, why, how to fix.\n- **Human actions:** Investigate, retrain model, adjust threshold, disable capability.\n\n---\n\n### Panel 6: AI Governance Settings\n\n**Purpose:** Human controls AI thresholds, scope and review-priority rules.\n\n**Layout:**\n\n```\n┌──────────────────────────────────────────────────────────────┐\n│  AI Governance Settings                                      │\n│  ─────────────────────────────────────────────────────────── │\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Confidence Thresholds                                      ││\n│  │                                                            ││\n│  │ Auto-approve proposals with confidence ≥ [85%]  [─●────] ││\n│  │ Queue for review: 70% ─────────────────────── 85%         ││\n│  │ Discard proposals with confidence < [70%]  [────●──]     ││\n│  │                                                            ││\n│  │ [Save Changes]                                             ││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ AI Scope (What the AI Can Do)                              ││\n│  │                                                            ││\n│  │ ☑ Read entity data                                         ││\n│  │ ☑ Propose actions                                          ││\n│  │ ☑ Send notifications                                       ││\n│  │ ☐ Execute actions without approval (DANGER)             ││\n│  │ ☑ Prepare entity enrichment proposal (approval required) ││\n│  │ ☐ Access sensitive data (PII, financials)                ││\n│  │ ☐ Delete entity data                                       ││\n│  │                                                            ││\n│  │ [Save Changes]                                             ││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Per-Capability Settings                                    ││\n│  │                                                            ││\n│  │ Capability          │ Threshold │ Auto-Approve │ Enabled  ││\n│  │ ────────────────────┼───────────┼──────────────┼──────────││\n│  │ Health Scoring      │    85%    │      Yes     │    ☑    ││\n│  │ QBR Scheduling      │    85%    │      Yes     │    ☑    ││\n│  │ Churn Prediction    │    80%    │      No      │    ☑    ││\n│  │ Email Drafting      │    90%    │      No      │    ☑    ││\n│  │ Escalation Routing  │    95%    │      No      │    ☑    ││\n│  │ Budget Adjustment   │    99%    │      No      │    ☐    ││\n│  │                                                            ││\n│  │ [Save Changes]                                             ││\n│  └──────────────────────────────────────────────────────────┘│\n└──────────────────────────────────────────────────────────────┘\n```\n\n**Key Features:**\n\n- **Confidence sliders:** Human adjusts thresholds. Real-time preview of what would happen.\n- **Scope toggles:** What the AI can and cannot do. Explicit opt-in for dangerous actions.\n- **Per-capability settings:** Different thresholds for different capabilities.\n- **Save changes:** Changes are versioned, audited, reversible.\n- **Danger warnings:** Red highlights for high-risk settings.\n\n---\n\n### Panel 7: AI Model Management\n\n**Purpose:** Which AI models are used, per-capability, cost tracking.\n\n**Layout:**\n\n```\n┌──────────────────────────────────────────────────────────────┐\n│  AI Model Management                                         │\n│  ─────────────────────────────────────────────────────────── │\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Default Model                                              ││\n│  │                                                            ││\n│  │ Model: GPT-4o Mini (via OpenRouter)                      ││\n│  │ Provider: OpenRouter                                       ││\n│  │ Cost: $0.15 / 1M tokens                                   ││\n│  │ [Change Model]                                             ││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Per-Capability Model Assignment                            ││\n│  │                                                            ││\n│  │ Capability          │ Model        │ Cost (week) │ Status ││\n│  │ ────────────────────┼──────────────┼─────────────┼────────││\n│  │ Health Scoring      │ GPT-4o Mini  │    $0.02    │   ●   ││\n│  │ QBR Scheduling      │ GPT-4o Mini  │    $0.01    │   ●   ││\n│  │ Churn Prediction    │ Claude 3.5   │    $0.12    │   ●   ││\n│  │ Email Drafting      │ GPT-4o Mini  │    $0.03    │   ●   ││\n│  │ Escalation Routing  │ GPT-4o Mini  │    $0.01    │   ●   ││\n│  │                                                            ││\n│  │ [Reassign]  [View Usage]  [Test Model]                   ││\n│  └──────────────────────────────────────────────────────────┘│\n│                                                              │\n│  ┌──────────────────────────────────────────────────────────┐│\n│  │ Model Usage This Month                                     ││\n│  │                                                            ││\n│  │ Total tokens: 2.3M                                       ││\n│  │ Total cost: $0.34                                         ││\n│  │                                                            ││\n│  │ [View Breakdown]                                           ││\n│  └──────────────────────────────────────────────────────────┘│\n└──────────────────────────────────────────────────────────────┘\n```\n\n**Key Features:**\n\n- **Default model:** Change the global model.\n- **Per-capability assignment:** Use cheap models for simple tasks, strong models for complex ones.\n- **Cost tracking:** See how much each capability costs.\n- **Usage breakdown:** Token usage, cost per capability, trends.\n- **Model testing:** Test a model on a sample before assigning it.\n\n---\n\n## Navigation & Access\n\n### How the Human Reaches the AI Workbench\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  [IntegrateWise Logo]  [Workbench]  [AI Workbench]  [Settings]  │\n│                         ▲            ↑                           │\n│                         │            │                           │\n│              Default (human)    Secondary (AI management)        │\n│                                                                 │\n│  Clicking \"AI Workbench\" opens the AI management surface.        │\n│  Clicking \"Workbench\" returns to the human workbench.            │\n│                                                                 │\n│  The AI Workbench is NEVER the default. The human must choose.  │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n### Sub-Navigation Within AI Workbench\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  [AI Workbench]                                                 │\n│  [Proposals] [History] [Memory] [Workflows] [Performance]      │\n│  [Governance] [Models]                                          │\n│                                                                 │\n│  ← Sub-navigation tabs, one per panel                          │\n│  ← Default tab: Proposals Queue                                │\n│  ← Human switches between panels                               │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n---\n\n## Human Control Model\n\nEvery action in the AI Workbench follows this model:\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  HUMAN CONTROL MODEL                                            │\n│                                                                 │\n│  1. OBSERVE  → Human sees AI operations surfaced               │\n│  2. REVIEW   → Human evaluates proposals, memory, performance  │\n│  3. DECIDE   → Human approves, rejects, modifies, deletes     │\n│  4. EXECUTE  → Human triggers action (or confirms AI action)   │\n│  5. VERIFY   → Human checks outcome, provides feedback        │\n│  6. ADJUST   → Human tunes thresholds, scope, models          │\n│                                                                 │\n│  The AI never executes without human confirmation.             │\n│  The AI never modifies its own settings.                       │\n│  The AI never deletes its own memory without human approval.   │\n│  The AI never changes governance thresholds.                   │\n│                                                                 │\n│  The human is the operator. The AI is the tool.                │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n---\n\n## Data Flow\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  AI WORKBENCH DATA FLOW                                         │\n│                                                                 │\n│  Spine (source of truth)                                        │\n│     │                                                           │\n│     ├──→ Proposals Queue  ←── action_proposals table (D1)     │\n│     │      │                                                    │\n│     │      └──→ Human reviews → approves/rejects/modifies      │\n│     │                                                           │\n│     ├──→ AI Actions History  ←── spine_audit_log (D1)           │\n│     │      │                                                    │\n│     │      └──→ Human explores → filters → investigates          │\n│     │                                                           │\n│     ├──→ AI Memory Explorer  ←── memory table (D1)              │\n│     │      │                                                    │\n│     │      └──→ Human reinforces/challenges/deletes            │\n│     │                                                           │\n│     ├──→ AI Workflow Monitor  ←── workflow state (DO)         │\n│     │      │                                                    │\n│     │      └──→ Human pauses/stops/edits                       │\n│     │                                                           │\n│     ├──→ AI Performance Dashboard  ←── metrics (KV)           │\n│     │      │                                                    │\n│     │      └──→ Human tunes thresholds/models                  │\n│     │                                                           │\n│     ├──→ AI Governance Settings  ←── policy_registry (D1)     │\n│     │      │                                                    │\n│     │      └──→ Human adjusts scope/thresholds                 │\n│     │                                                           │\n│     └──→ AI Model Management  ←── model config (KV)           │\n│            │                                                    │\n│            └──→ Human reassigns models                         │\n│                                                                 │\n│  All writes go through the Pipeline (§5.2, §6.6).               │\n│  All changes are audited (§11.4).                               │\n│  All changes require human authorization (§6.3).                │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n---\n\n## States & Interactions\n\n### Empty State\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  Proposals Queue                                                │\n│                                                                 │\n│  ┌──────────────────────────────────────────────────────────┐   │\n│  │                                                          │   │\n│  │              📭 No pending proposals                     │   │\n│  │                                                          │   │\n│  │     The AI is watching your workbench and learning.      │   │\n│  │     When it has a suggestion, it will appear here.       │   │\n│  │                                                          │   │\n│  │     [Go to Workbench]                                    │   │\n│  │                                                          │   │\n│  └──────────────────────────────────────────────────────────┘   │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n### Loading State\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  Proposals Queue                                                │\n│                                                                 │\n│  ┌──────────────────────────────────────────────────────────┐   │\n│  │  ┌──────────────┐                                        │   │\n│  │  │ ██████░░░░░░ │  Loading proposals...                   │   │\n│  │  └──────────────┘                                        │   │\n│  └──────────────────────────────────────────────────────────┘   │\n│                                                                 │\n│  ┌──────────────────────────────────────────────────────────┐   │\n│  │  ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░    │   │\n│  │  ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░    │   │\n│  │  ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░    │   │\n│  └──────────────────────────────────────────────────────────┘   │\n│                                                                 │\n│  ┌──────────────────────────────────────────────────────────┐   │\n│  │  ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░    │   │\n│  │  ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░    │   │\n│  │  ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░    │   │\n│  └──────────────────────────────────────────────────────────┘   │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n### Error State\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  Proposals Queue                                                │\n│                                                                 │\n│  ┌──────────────────────────────────────────────────────────┐   │\n│  │                                                          │   │\n│  │              ⚠️  Could not load proposals                │   │\n│  │                                                          │   │\n│  │     The AI management service is temporarily unavailable.  │   │\n│  │     Your workbench and data are not affected.            │   │\n│  │                                                          │   │\n│  │     [Retry]  [Contact Support]                           │   │\n│  │                                                          │   │\n│  └──────────────────────────────────────────────────────────┘   │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n---\n\n## Accessibility\n\n### Screen Reader Experience\n\n```\n\"AI Workbench. Proposals Queue. 3 pending proposals. First proposal:\nAcme Corp health dropped to 62. Escalate to VP? Confidence 82 percent.\nActions: View Context, Approve, Modify, Dismiss.\"\n\n[User presses Tab]\n\"View Context button.\"\n\n[User presses Tab]\n\"Approve button.\"\n\n[User presses Enter]\n\"Proposal approved. Acme Corp escalation queued for execution.\"\n```\n\n### Keyboard Navigation\n\n| Key                    | Action                                  |\n| ---------------------- | --------------------------------------- |\n| `Tab`                  | Navigate between proposals and actions  |\n| `Enter`                | Activate button (Approve, Reject, View) |\n| `Shift + D`            | Dismiss selected proposal               |\n| `Shift + A`            | Approve selected proposal               |\n| `Shift + M`            | Modify selected proposal                |\n| `Shift + V`            | View context of selected proposal       |\n| `Esc`                  | Close detail panel / return to list     |\n| `Cmd/Ctrl + Shift + A` | Open AI Workbench from human workbench  |\n| `Cmd/Ctrl + Shift + W` | Return to human workbench               |\n\n### Focus Management\n\n- When switching to AI Workbench, focus lands on first proposal card.\n- When a proposal is approved, focus moves to next proposal.\n- When detail panel opens, focus traps inside panel until closed.\n- When empty state, focus lands on \"Go to Workbench\" button.\n\n---\n\n## TypeScript Interfaces\n\n```typescript\n// AI Workbench Panel\ninterface AIWorkbenchProps {\n  activePanel: AIWorkbenchPanel;\n  tenantId: string;\n  userId: string;\n  onClose: () => void; // Returns to human workbench\n}\n\ntype AIWorkbenchPanel =\n  | \"proposals\"\n  | \"history\"\n  | \"memory\"\n  | \"workflows\"\n  | \"performance\"\n  | \"governance\"\n  | \"models\";\n\n// Proposal Queue\ninterface ProposalQueueProps {\n  proposals: AIProposal[];\n  filter: ProposalFilter;\n  onApprove: (proposalId: string) => void;\n  onReject: (proposalId: string) => void;\n  onModify: (proposalId: string, modification: string) => void;\n  onDismiss: (proposalId: string) => void;\n  onViewContext: (proposalId: string) => void;\n  onBatchApprove: (proposalIds: string[]) => void;\n  onBatchDismiss: (proposalIds: string[]) => void;\n}\n\ntype ProposalFilter = \"all\" | \"pending\" | \"approved\" | \"rejected\" | \"executed\";\n\ninterface AIProposal {\n  id: string;\n  entityId: string;\n  entityName: string;\n  capability: string;\n  description: string;\n  confidence: number; // 0.0–1.0\n  source: \"twin\" | \"workflow\" | \"user\";\n  status: \"pending\" | \"approved\" | \"rejected\" | \"executed\" | \"expired\";\n  createdAt: Date;\n  expiresAt: Date;\n  context: Entity360; // Full context for human review\n  reasoningTrace: ReasoningTrace;\n  humanAction?: HumanAction; // What the human did\n}\n\n// AI Actions History\ninterface AIActionsHistoryProps {\n  actions: AIAction[];\n  filter: ActionFilter;\n  onViewDetails: (actionId: string) => void;\n  onViewEntity360: (entityId: string) => void;\n}\n\ntype ActionFilter =\n  | \"all\"\n  | \"proposal\"\n  | \"execution\"\n  | \"enrichment\"\n  | \"memory\"\n  | \"tool_call\"\n  | \"read_only\";\n\ninterface AIAction {\n  id: string;\n  type: ActionType;\n  entityId: string;\n  entityName: string;\n  capability: string;\n  description: string;\n  confidence: number;\n  source: \"twin\" | \"workflow\" | \"user\";\n  status: \"success\" | \"failure\" | \"pending\";\n  outcome?: string; // What happened\n  createdAt: Date;\n  humanApprover?: string; // Who approved it\n  reasoningTrace?: ReasoningTrace;\n}\n\ntype ActionType =\n  | \"proposal\"\n  | \"execution\"\n  | \"enrichment\"\n  | \"memory_update\"\n  | \"tool_call\"\n  | \"read_only\";\n\n// AI Memory Explorer\ninterface AIMemoryExplorerProps {\n  memories: AIMemory[];\n  filter: MemoryFilter;\n  onReinforce: (memoryId: string) => void;\n  onChallenge: (memoryId: string) => void;\n  onDelete: (memoryId: string) => void;\n  onViewGraph: (entityId: string) => void;\n}\n\ntype MemoryFilter = \"all\" | \"personal\" | \"work\" | \"organization\" | \"ai_pattern\";\n\ninterface AIMemory {\n  id: string;\n  entityId: string;\n  entityName: string;\n  content: string;\n  confidence: number;\n  source: \"user_input\" | \"ai_pattern\" | \"external_data\";\n  tier: \"active\" | \"warm\" | \"cold\" | \"permanent\";\n  repetitions: number;\n  decayDays: number; // Days until decay\n  createdAt: Date;\n  lastReinforcedAt: Date;\n  relationships: EntityRelationship[];\n}\n\n// AI Workflow Monitor\ninterface AIWorkflowMonitorProps {\n  workflows: AIWorkflow[];\n  filter: WorkflowFilter;\n  onPause: (workflowId: string) => void;\n  onStop: (workflowId: string) => void;\n  onRunNow: (workflowId: string) => void;\n  onEdit: (workflowId: string) => void;\n  onDelete: (workflowId: string) => void;\n  onViewDetails: (workflowId: string) => void;\n}\n\ntype WorkflowFilter = \"running\" | \"scheduled\" | \"completed\" | \"failed\";\n\ninterface AIWorkflow {\n  id: string;\n  name: string;\n  description: string;\n  trigger: WorkflowTrigger;\n  status: \"running\" | \"scheduled\" | \"completed\" | \"failed\" | \"paused\";\n  progress?: { current: number; total: number }; // For running workflows\n  nextRunAt?: Date; // For scheduled workflows\n  lastRunAt?: Date;\n  lastRunOutcome?: \"success\" | \"failure\";\n  steps: WorkflowStep[];\n  createdBy: string;\n  createdAt: Date;\n}\n\ninterface WorkflowTrigger {\n  type: \"cron\" | \"event\" | \"manual\" | \"ai_proposed\";\n  config: string; // Cron expression or event filter\n}\n\ninterface WorkflowStep {\n  id: string;\n  name: string;\n  status: \"pending\" | \"running\" | \"completed\" | \"failed\";\n  output?: string;\n  error?: string;\n}\n\n// AI Performance Dashboard\ninterface AIPerformanceDashboardProps {\n  metrics: AIPerformanceMetrics;\n  dateRange: DateRange;\n  onViewDetails: (capability: string) => void;\n  onInvestigate: (failureId: string) => void;\n  onRetrainModel: (capability: string) => void;\n  onAdjustThreshold: (capability: string) => void;\n}\n\ninterface AIPerformanceMetrics {\n  totalProposals: number;\n  acceptedProposals: number;\n  rejectedProposals: number;\n  accuracy: number; // 0.0–1.0\n  acceptanceRate: number; // 0.0–1.0\n  trend: \"up\" | \"down\" | \"stable\";\n  capabilityBreakdown: CapabilityMetric[];\n  recentFailures: AIFailure[];\n}\n\ninterface CapabilityMetric {\n  capability: string;\n  totalProposals: number;\n  acceptedProposals: number;\n  accuracy: number;\n  trend: \"up\" | \"down\" | \"stable\";\n}\n\ninterface AIFailure {\n  id: string;\n  capability: string;\n  description: string;\n  expected: string;\n  actual: string;\n  confidence: number;\n  createdAt: Date;\n}\n\n// AI Governance Settings\ninterface AIGovernanceSettingsProps {\n  settings: AIGovernanceConfig;\n  onSave: (settings: AIGovernanceConfig) => void;\n  onPreview: (settings: AIGovernanceConfig) => void;\n}\n\ninterface AIGovernanceConfig {\n  autoApproveThreshold: number; // 0.0–1.0\n  queueThreshold: number; // 0.0–1.0\n  discardThreshold: number; // 0.0–1.0\n  scope: AIAllowedScope;\n  perCapability: Record<string, CapabilityGovernance>;\n}\n\ninterface AIAllowedScope {\n  readEntity: boolean;\n  proposeAction: boolean;\n  sendNotification: boolean;\n  executeWithoutApproval: boolean;\n  enrichData: boolean;\n  accessSensitiveData: boolean;\n  deleteEntity: boolean;\n}\n\ninterface CapabilityGovernance {\n  threshold: number;\n  autoApprove: boolean;\n  enabled: boolean;\n}\n\n// AI Model Management\ninterface AIModelManagementProps {\n  defaultModel: AIModelConfig;\n  perCapabilityModels: Record<string, AIModelConfig>;\n  usage: AIModelUsage;\n  onChangeDefaultModel: (model: AIModelConfig) => void;\n  onReassignModel: (capability: string, model: AIModelConfig) => void;\n  onTestModel: (model: AIModelConfig, sample: string) => void;\n}\n\ninterface AIModelConfig {\n  model: string; // e.g., \"gpt-4o-mini\"\n  provider: string; // e.g., \"openrouter\"\n  costPerMillionTokens: number;\n}\n\ninterface AIModelUsage {\n  totalTokens: number;\n  totalCost: number;\n  breakdown: Record<string, number>; // capability → cost\n}\n```\n\n---\n\n## Appendix: Difference from Audit Logs\n\n| Aspect            | AI Workbench                              | Audit Logs                              |\n| ----------------- | ----------------------------------------- | --------------------------------------- |\n| **Purpose**       | Human manages AI operations               | Compliance and legal record             |\n| **Audience**      | Human operators, AI managers              | Auditors, compliance officers, legal    |\n| **Content**       | Proposals, memory, workflows, performance | All system events, data access, changes |\n| **Interaction**   | Active — human takes action               | Passive — human reviews                 |\n| **UI**            | Rich interactive panels                   | Simple timeline/filter table            |\n| **Actions**       | Approve, reject, modify, delete, adjust   | Read, export, search                    |\n| **Mutability**    | Human can change AI behavior              | Immutable, append-only                  |\n| **Scope**         | AI operations only                        | All operations (human + AI)             |\n| **Location**      | Secondary tab in app                      | Admin section or external tool          |\n| **Default view**  | Proposals Queue                           | Full event timeline                     |\n| **Human control** | High — human adjusts AI settings          | None — read-only compliance             |\n\n**The AI Workbench is the human's control panel for the AI.  \nThe Audit Logs are the legal record of everything that happened.**\n\n---\n\n## The Human-First AI Workbench Philosophy\n\n```\n┌─────────────────────────────────────────────────────────────────┐\n│  THE HUMAN-FIRST AI WORKBENCH                                   │\n│                                                                 │\n│  The AI Workbench is not where the AI lives.                    │\n│  It is where the human controls the AI.                         │\n│                                                                 │\n│  The AI lives in the Capability Layer, watching the Spine.      │\n│  The human lives in the Workbench, doing their work.          │\n│  When the human wants to manage the AI, they open the AI        │\n│  Workbench — a separate, organized, human-controlled surface.   │\n│                                                                 │\n│  The AI does not own this interface.                            │\n│  The human does.                                                │\n│  The AI does not use this interface.                            │\n│  The human uses it to manage the AI.                            │\n│                                                                 │\n│  Every AI proposal is a request, not a command.                 │\n│  Every AI memory is a suggestion, not a fact.                   │\n│  Every AI workflow is a tool, not an autonomous agent.        │\n│  Every AI setting is a human decision, not a system default.    │\n│                                                                 │\n│  The human is the operator.                                     │\n│  The AI is the tool.                                            │\n│  The AI Workbench is the human's control panel.                 │\n│  The Workbench is the human's workspace.                        │\n│                                                                 │\n│  Two separate surfaces.                                         │\n│  One human protagonist.                                         │\n│  One AI supporting character.                                   │\n│                                                                 │\n│  That is the human-first AI Workbench.                        │\n└─────────────────────────────────────────────────────────────────┘\n```\n\n---\n\n**END OF DOCUMENT**\n\n_IntegrateWise AI Workbench Specification v1.0.0. Human-first. AI-managed. Separated. Organized._\n"}