error_outline

API Errors Occurred During Calculation

  • [[ err ]]
warning_amber

Phantom Tools Referenced in Evaluations (Not declared in tools/)

  • [[ file ]] references: [[ p ]]
Tool Coverage extension
[[ data.metrics.tool_coverage_percent | number:1 ]]%
[[ data.metrics.covered_tools ]] / [[ data.metrics.total_tools ]] tools covered
Instruction Coverage notes
[[ data.metrics.instruction_segment_coverage_percent | number:1 ]]%
[[ data.metrics.covered_segments ]] / [[ data.metrics.total_segments ]] segments covered
Callback Coverage settings_ethernet
[[ data.metrics.callback_coverage_percent | number:1 ]]%
[[ data.metrics.covered_callbacks ]] / [[ data.metrics.total_callbacks ]] callbacks covered
Transfer Coverage swap_horiz
[[ data.metrics.transfer_coverage_percent | number:1 ]]%
[[ data.metrics.covered_transfers ]] / [[ data.metrics.total_transfers ]] transfers covered
pie_chart Instruction Category Breakdown
Category Total Covered Coverage %
[[ cat ]] [[ data.metrics.category_counts[cat] ]] [[ data.metrics.category_covered_counts[cat] || 0 ]]
[[ ( (data.metrics.category_covered_counts[cat] || 0) / data.metrics.category_counts[cat] * 100 ) | number:1 ]]%
folder_open Scanned Workspace Assets

Instruction Files ([[ data.scanned_files.instructions.length ]])

  • description [[ f ]]

Evaluation Files Scanned ([[ data.scanned_files.evaluations.length ]])

  • flaky [[ f ]]
  • No evaluation files discovered.
warning Unused Evaluations

The following evaluation test cases were not found to cover any instruction segments or agent transfers.

Unused Evals ([[ data.unused_evals.length ]])

  • highlight_off [[ ev ]]
  • All evaluations are utilized.
format_list_bulleted Instruction Segment Details & Mapping
search
# Agent Category Instruction Quote / Directive Covered? Covering Eval(s)
[[ $index + 1 ]] [[ s.agent ]] [[ s.category ]]
[[ s.directive ]] [[ s.quote ]]
[[ s.covered ]]
[[ ev ]]
None
find_in_page No instruction segments match the current filters.
build Tool Coverage Breakdown
search
[[ t.name ]] [[ t.covered ? 'Covered' : 'Uncovered' ]]
search_off No tools match the filters.
settings_ethernet Callback Coverage Breakdown
search
[[ cb.name ]] [[ cb.covered ? 'Covered' : 'Uncovered' ]]
search_off No callbacks match the filters.
swap_horiz Sub-Agent Transfers Coverage

This shows the transition matrix of conversations moving between sub-agents. Desired transfers represent configured transitions, whereas Tested transfers have active test cases mapping to them.

search
# From Agent To Agent Desired? Tested? Covering Evaluation(s)
[[ $index + 1 ]] [[ t.from_agent ]] [[ t.to_agent ]] [[ t.is_desired ? 'Yes' : 'No' ]] [[ t.is_tested ? 'Yes' : 'No' ]]
[[ ev ]]
None
swap_calls No sub-agent transfers match the current filters.

Segment Detail Info

Agent: [[ selectedSegment.agent ]] Category: [[ selectedSegment.category ]] Covered: [[ selectedSegment.covered ]]

Directive Title

[[ selectedSegment.directive ]]

Full Instruction Text

[[ selectedSegment.full_text ]]

Associated Evaluation Files

[[ ev ]]