Skip to main content

Monitoring SME Activity

Track and analyze Specialist Agent invocations, executions, and performance across your organization.

SME Activity Dashboard​

Navigate to Governance > Activity History > SME Activity to view the dedicated SME monitoring interface.

Dashboard Overview​

The dashboard provides:

  • Active Invocations: Currently running SME tasks
  • Pending Queue: Tasks waiting to be processed
  • Recent Completions: Successfully finished tasks
  • Failed/Timeout: Tasks that encountered issues

Key Metrics​

MetricDescription
Total InvocationsCount of SME invocations in selected period
Success RatePercentage of invocations that completed successfully
Average DurationMean time from invocation to completion
Escalation RatePercentage of invocations requiring human input

Viewing SME Invocations​

Invocation List​

The main view shows all SME invocations with:

ColumnDescription
StatusRunning, completed, failed, timeout, cancelled
SMEWhich Specialist Agent was invoked
Called ByThe agent that invoked the SME
TaskBrief description of the task
DurationExecution time (or elapsed time if running)
CreatedWhen the invocation was created

Filtering Options​

Filter invocations by:

  • Status: All, Running, Completed, Failed, Timeout
  • SME: Select specific Specialist Agent
  • Calling Agent: Filter by which agent made the invocation
  • Time Range: Last hour, 24 hours, 7 days, custom

Status Indicators​

StatusIconDescription
PendingYellowWaiting to start
RunningBlueCurrently executing
CompletedGreenFinished successfully
FailedRedEncountered an error
TimeoutOrangeExceeded time limit
CancelledGrayManually stopped

Invocation Details​

Click on any invocation to view detailed information:

Summary Panel​

SME Invocation Details
----------------------

Status: Completed
SME: Research SME
Called By: Executive Assistant
Nesting Depth: 1

Timing:
  Created: 2024-01-15 10:30:00
  Started: 2024-01-15 10:30:02
  Completed: 2024-01-15 10:42:36
  Duration: 12 minutes 34 seconds

Task Information​

View the original task prompt and context:

Task Prompt:
Research the current state of electric vehicle adoption worldwide.
Include:
1. Global EV sales statistics for 2024
2. Top 5 markets by adoption rate
3. Major challenges facing EV adoption
4. Projected growth over next 5 years

Task Context:
{
    "client": "AutoCorp Industries",
    "purpose": "Strategic planning presentation"
}

Result Section​

For completed invocations, view the result:

Result:
# Electric Vehicle Adoption Report 2024

## Global EV Sales Statistics
Global electric vehicle sales reached 14.2 million units in 2024...

## Top 5 Markets
1. China - 8.1 million units (57%)
2. Europe - 3.2 million units (23%)
...

Error Information​

For failed invocations:

Error Type: Timeout
Error Message: SME execution exceeded 3600 second limit
Partial Result: Research partially completed...

Parent Execution Context​

SME invocations are always triggered by another agent. View the relationship:

From Invocation Detail​

Click View Parent Execution to see:

  • The email or chat that triggered the workflow
  • Why the calling agent decided to invoke the SME
  • What happened after the SME completed

From the Run View​

Open a run in Governance > Activity History > Agent Runs and follow its trace:

  • Expand sub-run phases to review the SME work visible to you
  • Select a step to inspect its input, output and raw log entries
  • Review issues and the likely fix when a step fails

Nested Invocations​

SMEs can invoke other SMEs. Track the chain:

Email received
  |
  +-- Executive Assistant
        |
        +-- Research SME (Depth: 1)
              |
              +-- Data Analysis SME (Depth: 2)

The invocation detail shows:

  • Nesting Depth: How deep in the SME chain
  • Parent Invocation: Link to the invoking SME (if any)
  • Child Invocations: SMEs invoked by this SME

Performance Analytics​

SME Performance Report​

Navigate to Governance > Activity History > SME Activity > Analytics for:

By SME​

SMEInvocationsSuccess RateAvg DurationCost
Research SME15694%8m 32s$12.45
Accounting SME8998%4m 15s$6.78
Marketing SME6791%12m 48s$18.90

By Calling Agent​

See which agents most frequently use SMEs:

AgentSME InvocationsTop SME Used
Executive Assistant234Research SME
Support Agent78HR SME

Time Analysis​

  • Peak invocation hours
  • Average wait time in queue
  • Duration trends over time

Alerts and Notifications​

Configure Alerts​

Set up alerts for SME activity:

  1. Navigate to Administration > Account > Settings
  2. Find SME Activity Alerts
  3. Configure thresholds:
    • SME failure rate exceeds X%
    • Average duration exceeds X minutes
    • Queue depth exceeds X invocations

Alert Types​

AlertTriggerAction
High Failure Rate>10% failures in 1 hourEmail notification
Long Queue>5 pending invocationsDashboard warning
Slow SMEAvg duration >2x normalPerformance review

Troubleshooting from Activity View​

Common Issues​

SME Stuck in Running State​

  1. Check SME execution logs for errors
  2. Verify tool availability (APIs, knowledge base)
  3. Review for infinite loops in SME logic
  4. Consider manual cancellation if stuck

High Failure Rate​

  1. Review error messages in failed invocations
  2. Check SME configuration for issues
  3. Verify external dependencies are available
  4. Review recent changes to SME instructions

Slow Performance​

  1. Analyze invocation durations
  2. Check for complex tasks taking too long
  3. Review LLM model selection (use faster models)
  4. Consider breaking large tasks into smaller pieces

Cancelling Invocations​

For stuck or runaway invocations:

  1. Find the invocation in the list
  2. Click Cancel (only for pending or running)
  3. Confirm cancellation

The calling agent will be notified of the cancellation.

Exporting Data​

Export Options​

Export SME activity data for analysis:

  1. Apply desired filters
  2. Click Export
  3. Choose format: CSV or JSON
  4. Download the report

Export Contents​

Exported data includes:

  • Invocation ID and timestamps
  • SME and calling agent information
  • Status and duration
  • Task prompt (truncated)
  • Error messages (if any)

Integration with Agent Runs​

SME activity integrates with the main execution monitoring:

Unified View​

Go to Governance > Activity History > Agent Runs, set Source to Agents, and use the Agent control to select an SME or leave it unfiltered to see the agents you supervise. Platform Admins can see all runs.

Run Trace​

In the run view's trace, expand sub-run phases to see when SME work occurred relative to other actions:

10:30:00 - Email received
10:30:05 - Agent started processing
10:30:15 - Agent invoked Research SME
10:30:15 - Waiting for SME...
10:42:36 - SME completed
10:42:40 - Agent continued processing
10:43:00 - Response sent

Best Practices​

Regular Monitoring​

  1. Daily checks: Review failed invocations and address issues
  2. Weekly reports: Analyze performance trends
  3. Monthly reviews: Evaluate SME effectiveness and utilization

Performance Optimization​

  1. Set appropriate timeouts: Balance thoroughness with efficiency
  2. Monitor queue depth: Ensure SMEs aren't overwhelmed
  3. Review nested calls: Deep nesting may indicate design issues

Documentation​

  1. Track patterns: Note common invocation patterns
  2. Document failures: Record root causes and solutions
  3. Share insights: Help team understand SME behavior