Skip to main content

Conversation Analysis

Conversation Analysis uses AI to generate insights from your agent’s conversations, helping you understand patterns, identify issues, and optimize performance. Analyze up to 250 conversations at once with intelligent filtering by date range and users.
Conversation analysis results are estimates generated by AI and may vary between different analysis runs. The maximum number of conversations to analyze is 250.

What is Conversation Analysis?

Conversation Analysis is an AI-powered feature in the Analytics dashboard that examines your conversations and generates actionable insights:

AI-Powered Insights

Automatically identify patterns, trends, and issues using AI

Smart Filtering

Analyze specific time periods or users with flexible filters

250 Conversation Limit

Process up to 250 conversations per analysis for optimal performance

Secure Storage

Analysis results are stored securely for future reference

How to Run an Analysis

1

Access Analytics Dashboard

Navigate to your agent’s Analytics section
2

Ensure Live Mode is OFF

Toggle Live Mode to OFF to enable historical analysis
3

Configure Filters

Set your analysis criteria:
  • Date Range: Select the time period to analyze
  • User Filter: Choose “All Users” or specific user
Click Filter to apply your selection
4

Navigate to Conversations Tab

Make sure you’re on the Conversations tab (not Executions)
5

Configure Custom Keywords (Optional)

Click Advanced Settings dropdown to specify custom keywords separated by commasExample: inteligencia artificial, accesibilidad, eLearning, aprendizaje
6

Run New Analysis

Click the “Run New Analysis” button to start processing
7

Review Results

View the comprehensive AI-generated report with insights and metrics

Advanced Settings: Custom Keywords

Custom Keywords allow you to track specific terms in addition to automatically discovered keywords. The analyzer searches for these keywords in both user messages (INPUT) and agent responses (OUTPUT).
How to use:
  1. Click the “Advanced Settings” dropdown
  2. Enter keywords separated by commas
  3. Example: inteligencia artificial, accesibilidad, I&D, eLearning, aprendizaje
Results include:
  • Occurrence count: Total times the keyword appeared
  • Relevance percentage: Proportion of conversations where keyword appears

Saved Analytics Reports

All conversation analyses are automatically saved for future reference.

Accessing Saved Reports

The “Analytics Reports” section displays all your saved reports in a table format:
ColumnDescription
Report NameAuto-generated timestamp (e.g., “Report 1/28/2026, 7:38:08 AM”)
ConversationsNumber of conversations analyzed (e.g., 17, 20)
Date RangePeriod analyzed with calendar icon
LoadButton to view the report results
ActionsMenu (⋮) for managing the report

Managing Reports

Load Reports

Click “Load” to open any saved report and review historical insights

Delete Reports

Use the actions menu (⋮) to delete old reports and free up storage
Compare reports from different time periods to track improvements and identify trends over time.

Analysis Results

When you run a conversation analysis, the system generates a comprehensive Results report:

Analysis Summary

Total Conversations

Total count with success/failure indicators

Processing Metrics

Average processing time, duration, and satisfaction rate
Key metrics displayed:
  • Avg Messages: Message count per conversation
  • Resolution Rate: Percentage of conversations resolved
  • Avg Duration: Time per conversation
  • Satisfaction: User satisfaction percentage

Sentiment Distribution

Visual breakdown showing:
  • Positive: Percentage of positive sentiment (green indicator)
  • Neutral: Percentage of neutral sentiment (gray indicator)
  • Negative: Percentage of negative sentiment (red indicator)

Top Input Keywords

Most common keywords in user messages, automatically identified by the AI: Example keywords:
  • equipo de Actúa
  • Articulate 360
  • IA
  • equipo
  • formación digital
Each keyword shows occurrence count and a visual bar chart.

Top Output Keywords

Most common keywords in agent responses: Example keywords:
  • variables
  • eLearning
  • inteligencia artificial
  • personajes
  • Storyline 360

Input/Output Custom Keywords

If you specified custom keywords in Advanced Settings, they appear here with detailed metrics.
Custom keywords display format: Occurrences | Relevance % Example:
  • inteligencia artificial: 5 | 100%
  • accesibilidad: 3 | 85%
  • eLearning: 7 | 35%

Understanding Relevance Percentage

Relevance is a normalized value (0-100%) indicating in what proportion of total conversations a keyword appears. Formula: relevance = (count / totalConversations) × 100 Where:
  • count = Number of conversations containing the keyword
  • totalConversations = Total conversations analyzed
Example: If you analyzed 100 conversations:
  • Keyword “servicios” appears in 25 conversations → Relevance = 25%
  • Keyword “soporte” appears in 60 conversations → Relevance = 60%
Why relevance matters:
  1. Fair Comparison: Compare keyword importance independently of total volume
  2. Relative Perspective: Understand how common a keyword is in your dataset
  3. Intuitive Visualization: Percentage format (0-100%) is easy to interpret
  4. Scalability: Works consistently with any number of conversations
Interpreting results:
  • High relevance (> 50%): Widely discussed topic across conversations
  • Medium relevance (20-50%): Moderately common topic
  • Low relevance (< 20%): Niche topic in specific conversations

Main Topics

High-level conversation themes identified by AI: Example topics:
  • company information
  • technical support
  • product training
  • product information
  • eLearning Content Creation
Each topic shows relevance percentage.

Top Intents

User intent classification showing what users want to accomplish: Example intents:
  • request information
  • provide information
  • request information about team
  • request information about courses

Issues Detected

The analyzer detects potential issues in conversations that may need attention.
Issues include:
  • information unavailability (with severity level)
  • Error patterns
  • Failed tool executions
  • Misunderstood queries
  • Incomplete responses

Using Custom Keywords Effectively

Best Practices:Strategic Selection:
  • Track brand-specific terminology
  • Monitor compliance keywords
  • Measure feature discussion frequency
  • Analyze product mentions
  • Track technical terms
Analysis Approach:
  • High count + high relevance = Core topics requiring continued focus
  • High count + low relevance = Concentrated in few conversations
  • Low count + high relevance = Emerging topic spreading across conversations

Filtering for Better Analysis

Date Range Filtering

Last 7-30 days - Best for current performance monitoring and quick health checks

User Filtering

Filter OptionUse CaseBest For
All UsersOrganization-wide analysisGeneral performance, broad trends
Specific UserIndividual user trackingSupport cases, VIP customers
User CohortsGroup behavior analysisBeta testers, user segments
Start with “All Users” to get the big picture, then create focused analyses for specific users where you notice interesting patterns.

Working with the 250 Conversation Limit

If your filters match more than 250 conversations, only the most recent 250 will be analyzed.

Strategies for Large Datasets

Time-Based Segmentation: Break into smaller time periods (e.g., analyze week by week), then compare insights across periods. User-Based Segmentation: Run separate analyses for different user groups, then compare results. Priority-Based Approach: Filter for the most important conversations (e.g., failed conversations, high-value users, specific issues).

Use Cases

Quality Assurance

  • Review AI-identified problematic conversations
  • Spot response quality issues
  • Validate agent behavior
  • Check guardrail effectiveness

Performance Optimization

  • Find bottlenecks and inefficiencies
  • Optimize response strategies
  • Identify successful patterns
  • Reduce error rates

User Research

  • Discover common needs and questions
  • Map user journeys
  • Identify pain points
  • Track feature usage

Compliance & Auditing

  • Audit conversation handling
  • Verify policy adherence
  • Generate compliance reports
  • Track data handling

Next Steps

Frequently Asked Questions

Analysis typically completes in 30-60 seconds depending on the number of conversations and their complexity.
You should wait for one analysis to complete before starting another. However, you can view previous analysis results at any time.
Yes, all analysis results are automatically stored and can be accessed from the Analytics Reports section.
AI analysis provides estimates that can vary between runs as the AI interprets conversations from slightly different perspectives. Focus on consistent patterns across multiple analyses.
The analysis will process all available conversations that match your filters. The 250 limit is a maximum, not a minimum.
Yes, analysis results can be exported in various formats for sharing with team members or further processing.
No, conversation analysis requires Live Mode to be OFF to ensure you’re analyzing a stable dataset.
Custom keywords are specific terms you define in Advanced Settings. The analyzer tracks these keywords in both user messages and agent responses, showing occurrence count and relevance percentage.