AI Insights

The AI Insights page provides AI-powered analysis and reporting for your healthcare education program. Generate comprehensive insights about program performance, curriculum mapping, competency achievement, and accreditation readiness.

Overview

AI Insights uses advanced AI to analyze your program data and generate detailed reports covering:

• Overall program performance and health
• Curriculum structure and mapping quality
• Competency-level achievement and gaps
• Course objective performance
• Program outcome effectiveness

Key Features:

• 5 Insight Report Types: Each focused on different aspects of your program
• Interactive Charts: Visual data representations for better understanding
• Cohort Filtering: Analyze specific student cohorts
• Template Filtering: Focus on specific curriculum, CO, or PO templates
• Course Filtering: Analyze specific courses (for competency analysis)
• DOCX Export: Download reports as formatted Word documents
• 7-Day Cooldown: Reports can be regenerated once every 7 days
• Pro Plan Required: Available only for Pro plan institutions

Getting Started

Access Requirements

Pro Plan Required:

• AI Insights is only available for institutions on the Pro plan
• Free Trial and non-Pro plans will see an upgrade message
• Navigate to Billing to upgrade if needed

Navigation

1. Go to AI Insights in the main navigation
2. You'll see 5 insight report cards on the left
3. The chat interface on the right shows generated reports
4. Click any insight card to generate or view a report

Insight Report Types

Generating Reports

First-Time Generation

1. Click on an insight report card (left side)
2. A dialog opens for scope selection:
   • Cohorts: Select student cohorts to analyze
   • Templates: Select relevant templates (varies by insight type)
3. Click "Generate Report"
4. Report generation begins (you can navigate away)
5. You'll be notified when the report is ready
6. The report appears in the chat interface

Viewing Existing Reports

• If a report exists for an insight type, clicking the card shows the existing report
• Reports are saved and persist across sessions
• Most recent report for each type is displayed

Regenerating Reports

7-Day Cooldown:

• Reports can be regenerated once every 7 days
• A regenerate button (sparkles icon) appears when a report is stale (7+ days old)
• Click to regenerate with updated data

When to Regenerate:

• After significant data changes
• Before important meetings
• Quarterly or monthly reviews
• After curriculum updates

Filtering and Scope Selection

Cohort Filtering

Available For:

• Performance Overview
• Competency Analysis
• Course Objectives Analysis
• Program Outcomes Analysis

How It Works:

• Select one or more student cohorts
• Analysis includes only students in selected cohorts
• Multiple cohorts enable trend comparison
• Default: Latest cohort (if available)

Cohort Filter Options:

• Select All: Choose all available cohorts
• Clear: Deselect all cohorts
• Individual Selection: Click to toggle each cohort

Template Filtering

Competency Templates:

• Used for: Competency Analysis, Curriculum Mapping
• Filters which competencies are included in analysis
• Shows only non-archived templates

Course Objective Templates:

• Used for: Course Objectives Analysis, Curriculum Mapping
• Filters which COs are included in analysis
• Shows only non-archived templates

Program Outcome Templates:

• Used for: Program Outcomes Analysis, Curriculum Mapping
• Filters which POs are included in analysis
• Shows only non-archived templates

Template Selection:

• Checkboxes to select/deselect templates
• Shows count of selected templates
• At least one template required for curriculum mapping

Course Filtering

Available For:

• Competency Analysis only

How It Works:

• Select specific courses to filter competency data
• Courses grouped by assignment template
• Ungrouped courses shown separately
• Default: All courses selected

Course Filter Options:

• Select All: Choose all available courses
• Clear: Deselect all courses
• Grouped by Template: Courses organized by assignment template

Charts and Visualizations

Curriculum Mapping Charts

Radar Charts:

• Domain Level: Shows domain coverage and mapping strength
• CO Level: Shows course objective mapping quality
• PO Level: Shows program outcome coverage

KPI Cards:

• Competency Coverage: Percentage of competencies mapped
• Domain Coverage: Percentage of domains with clinical links
• CO Coverage: Average competency-to-CO mapping percentage
• PO Coverage: Average outcome support score

Unmapped Items Tables:

• Competencies Tab: Competencies without CO links
• COs Tab: Course objectives missing required links
• POs Tab: Program outcomes without CO links
• Shows up to 200 items per tab

Competency Analysis Chart

Combined Curriculum Performance Chart:

• Shows three data sources:
  • Evaluations: Evaluation-based competency coverage
  • Skills: Skills practice-based coverage
  • Assignments: Assignment-based coverage
• Interactive: Hover for details
• Color-coded performance indicators
• Last updated timestamp

Course Objectives Chart

Combined CO Performance Chart:

• Aggregates competency data to CO level
• Shows evaluations, skills, and assignments coverage
• Performance metrics per CO
• Supporting competencies listed

Program Outcomes Chart

Combined PO Performance Chart:

• Aggregates data from COs to PO level
• Shows evaluations, skills, and assignments coverage
• Performance metrics per PO
• Supporting course objectives listed

Report Features

Report Content

Each report includes:

• Markdown Formatting: Headers, bullet points, emphasis
• Structured Sections: Organized by topic
• Data-Driven Insights: Based on actual program data
• Actionable Recommendations: Specific next steps
• Strategic Focus: High-level program insights

Report Timestamp

• Each report shows generation date and time
• Reports are saved with timestamps
• Used to determine if regeneration is needed

Downloading Reports

DOCX Export:

1. Click the Download button (top right or bottom of report)
2. Report downloads as a Word document (.docx)
3. Includes:
   • Formatted title and date
   • Chart images (for applicable insights)
   • Full markdown content converted to Word format
   • Professional formatting

File Naming:

• Format: ai_insights_[category]_[date].docx
• Example: ai_insights_performance_overview_2024-01-15.docx

Data Sources

Precomputed Coverage Tables

Purpose: Pre-aggregated data for faster analysis

Tables Used:

• curriculum_coverage_course: Course-level competency coverage by cohort
• co_coverage_course: Course-level CO coverage
• po_coverage_course: Course-level PO coverage

Benefits:

• Faster report generation
• Consistent data aggregation
• Cohort-scoped analysis

Raw Program Data

Data Fetched:

• Student profiles and analytics
• Clinical logs and hours
• Skills progress and completion
• Evaluations and responses
• Evaluation templates and questions
• Location performance
• Curriculum objective links

Filtering:

• By selected cohorts
• By institution (data siloing)
• Archived status (varies by insight type)

Cohort Breakdowns

When Multiple Cohorts Selected:

• Preserves cohort-level granularity
• Enables trend analysis
• Shows comparative performance
• Identifies cohort-specific patterns

Best Practices

When to Generate Reports

1. Regular Reviews: Monthly or quarterly program reviews
2. Before Meetings: Prepare for leadership or board meetings
3. After Data Updates: When significant data changes occur
4. Accreditation Prep: Before site visits or reviews
5. Strategic Planning: Annual planning sessions

Selecting Scope

Cohorts:

• Start with current/latest cohort for current program health
• Include multiple cohorts for trend analysis
• Use archived cohorts for historical comparison

Templates:

• Select all active templates for comprehensive analysis
• Focus on specific templates for targeted insights
• Ensure templates are properly linked (for mapping analysis)

Courses:

• Select all courses for program-wide competency analysis
• Focus on specific courses for course-level deep dives

Interpreting Results

1. Read the Full Report: AI provides comprehensive analysis
2. Review Charts: Visual data complements written insights
3. Check Unmapped Items: Identify gaps in curriculum structure
4. Focus on Recommendations: Prioritize actionable items
5. Compare Cohorts: Look for trends when multiple cohorts selected

Using Reports

1. Share with Leadership: Export DOCX for presentations
2. Track Progress: Regenerate reports to see improvements
3. Document Decisions: Use reports to document program changes
4. Accreditation Evidence: Include in accreditation documentation
5. Strategic Planning: Use insights for resource allocation

Troubleshooting

Report Not Generating

Possible Causes:

• No cohorts selected (for insights requiring cohorts)
• No templates selected (for curriculum mapping)
• Insufficient data in selected scope
• Network or server issues

Solutions:

• Ensure at least one cohort is selected
• Verify templates are selected (for mapping)
• Check that data exists for selected scope
• Try again or contact support

Charts Not Loading

Possible Causes:

• No data for selected scope
• Precomputed coverage not available
• Filtering too restrictive

Solutions:

• Expand cohort or template selection
• Check that courses have coverage data
• Verify precomputed tables are up to date

Missing Data in Reports

Possible Causes:

• Selected scope has no data
• Data not yet computed
• Filters too restrictive

Solutions:

• Select broader scope (more cohorts/templates)
• Check that students have completed activities
• Verify data exists in the system

Can't Regenerate Report

Possible Causes:

• Report is less than 7 days old
• Report generation in progress
• System error

Solutions:

• Wait until 7 days have passed
• Check if generation is in progress
• Try again later or contact support

Export Not Working

Possible Causes:

• Browser download restrictions
• File size too large
• Chart capture failed

Solutions:

• Check browser download settings
• Try a different browser
• Report will export without chart if capture fails

Related Features

• Accreditation Suite: Use insights for accreditation documentation
• Curriculum Mapping: Insights complement mapping tools
• Reports: Other reporting features in the system
• Templates: Manage templates used in insights
• Classrooms: Data source for insights
• Evaluations: Evaluation data feeds into insights
• Skills Checkoffs: Skills data feeds into insights

Technical Notes

Data Aggregation

• Competency Level: Raw data from evaluations, skills, assignments
• CO Level: Aggregated from competencies
• PO Level: Aggregated from COs
• Precomputed: Stored in coverage tables for performance

Report Generation

• AI Processing: Uses Gemini AI for analysis
• Token Limit: 16,384 tokens for comprehensive responses
• Generation Time: Typically 30-60 seconds
• Background Processing: Can navigate away during generation

Data Freshness

• Precomputed Coverage: Updated by background functions
• Raw Data: Fetched in real-time during report generation
• Report Timestamp: Shows when data was analyzed
• Regeneration: Updates with latest data

Limitations

1. Pro Plan Only: Feature requires Pro plan subscription
2. 7-Day Cooldown: Reports can only be regenerated weekly
3. Data Scope: Analysis limited to selected cohorts/templates
4. Precomputed Dependency: Some insights require precomputed coverage
5. AI Interpretation: Insights are AI-generated and should be reviewed

Support

If you encounter issues or have questions:

1. Check this documentation
2. Review troubleshooting section
3. Verify Pro plan status
4. Contact support with specific error messages
5. Include report type and selected scope in support requests