bench · label v1-fulltext · split selection · code 29933681bc47
corpus: 183 records from 12 seed packs (sha 271b057d54d6) · queries queries.jsonl sha 97ecbcb5d681 · nulls 550 (sha 6e100bad522c)
arm: decision floor · hybrid off · rerank off · limit 12 · common-word share 0.05 · interests none · triggers on 0 lessons

register       n         recall (briefed)  hit@1  hit@3  hit@12    MRR briefed/q
bug-report    83    84.3% [75.9%, 91.6%]  54.2%  73.5%   85.5%  0.652      12.0
paraphrase    83    63.9% [54.2%, 73.5%]  32.5%  47.0%   67.5%  0.431      11.6
ticket        83    77.1% [67.5%, 85.5%]  48.2%  63.9%   77.1%  0.573      11.8
all          249    75.1% [69.1%, 80.7%]  45.0%  61.4%   76.7%  0.552      11.8

null prompts briefed nothing: 238 of 550 (43.3%, 95% [39.2%, 47.4%]) · the rest got 5.1 lessons on average
  calibration half (sets the calibrated line): briefed anything 163 of 282 (57.8%, 95% [52.0%, 63.4%])
  unseen half (sets the calibrated line: never seen by it): briefed anything 149 of 268 (55.6%, 95% [49.6%, 61.4%])
latency per check: median 7 ms · p95 24 ms · 799 checks

per query: id register lesson rank briefed count
dec_sixth_surface:ticket ticket seed:dotnet-canon:dec_sixth_surface 1 yes 12
dec_sixth_surface:paraphrase paraphrase seed:dotnet-canon:dec_sixth_surface 15 MISS 12
dec_sixth_surface:bug-report bug-report seed:dotnet-canon:dec_sixth_surface 20 MISS 12
r_202_long_running:ticket ticket seed:dotnet-canon:r_202_long_running - MISS 9
r_202_long_running:paraphrase paraphrase seed:dotnet-canon:r_202_long_running 1 yes 10
r_202_long_running:bug-report bug-report seed:dotnet-canon:r_202_long_running 26 MISS 12
r_aaa_narrative:ticket ticket seed:dotnet-canon:r_aaa_narrative 48 MISS 12
r_aaa_narrative:paraphrase paraphrase seed:dotnet-canon:r_aaa_narrative 24 MISS 12
r_aaa_narrative:bug-report bug-report seed:dotnet-canon:r_aaa_narrative 3 yes 12
r_arch_enforcement_ladder:ticket ticket seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 12
r_arch_enforcement_ladder:paraphrase paraphrase seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 12
r_arch_enforcement_ladder:bug-report bug-report seed:dotnet-canon:r_arch_enforcement_ladder 5 yes 12
r_aspire_azure_fallback:ticket ticket seed:dotnet-canon:r_aspire_azure_fallback 1 yes 10
r_aspire_azure_fallback:paraphrase paraphrase seed:dotnet-canon:r_aspire_azure_fallback 73 MISS 12
r_aspire_azure_fallback:bug-report bug-report seed:dotnet-canon:r_aspire_azure_fallback 1 yes 12
r_aspire_versions:ticket ticket seed:dotnet-canon:r_aspire_versions 1 yes 12
r_aspire_versions:paraphrase paraphrase seed:dotnet-canon:r_aspire_versions 10 yes 12
r_aspire_versions:bug-report bug-report seed:dotnet-canon:r_aspire_versions 1 yes 12
r_aspire_waitfor:ticket ticket seed:dotnet-canon:r_aspire_waitfor 1 yes 12
r_aspire_waitfor:paraphrase paraphrase seed:dotnet-canon:r_aspire_waitfor 21 MISS 12
r_aspire_waitfor:bug-report bug-report seed:dotnet-canon:r_aspire_waitfor 1 yes 12
r_bulk_ops:ticket ticket seed:dotnet-canon:r_bulk_ops - MISS 12
r_bulk_ops:paraphrase paraphrase seed:dotnet-canon:r_bulk_ops - MISS 12
r_bulk_ops:bug-report bug-report seed:dotnet-canon:r_bulk_ops 31 MISS 12
r_comments_durable_docs:ticket ticket seed:dotnet-canon:r_comments_durable_docs 1 yes 12
r_comments_durable_docs:paraphrase paraphrase seed:dotnet-canon:r_comments_durable_docs 16 MISS 12
r_comments_durable_docs:bug-report bug-report seed:dotnet-canon:r_comments_durable_docs 1 yes 12
r_docs_review_surface:ticket ticket seed:dotnet-canon:r_docs_review_surface 17 MISS 12
r_docs_review_surface:paraphrase paraphrase seed:dotnet-canon:r_docs_review_surface - MISS 12
r_docs_review_surface:bug-report bug-report seed:dotnet-canon:r_docs_review_surface 1 yes 12
r_durability_not_replay:ticket ticket seed:dotnet-canon:r_durability_not_replay 1 yes 12
r_durability_not_replay:paraphrase paraphrase seed:dotnet-canon:r_durability_not_replay 2 yes 12
r_durability_not_replay:bug-report bug-report seed:dotnet-canon:r_durability_not_replay 2 yes 12
r_encoding_loop:ticket ticket seed:dotnet-canon:r_encoding_loop 1 yes 12
r_encoding_loop:paraphrase paraphrase seed:dotnet-canon:r_encoding_loop 2 yes 12
r_encoding_loop:bug-report bug-report seed:dotnet-canon:r_encoding_loop 1 yes 12
r_exceptions_canon:ticket ticket seed:dotnet-canon:r_exceptions_canon 31 MISS 12
r_exceptions_canon:paraphrase paraphrase seed:dotnet-canon:r_exceptions_canon 12 yes 12
r_exceptions_canon:bug-report bug-report seed:dotnet-canon:r_exceptions_canon 8 yes 12
r_experiment_sunset:ticket ticket seed:dotnet-canon:r_experiment_sunset 3 yes 12
r_experiment_sunset:paraphrase paraphrase seed:dotnet-canon:r_experiment_sunset 1 yes 12
r_experiment_sunset:bug-report bug-report seed:dotnet-canon:r_experiment_sunset 17 MISS 12
r_grep_to_zero:ticket ticket seed:dotnet-canon:r_grep_to_zero 9 yes 12
r_grep_to_zero:paraphrase paraphrase seed:dotnet-canon:r_grep_to_zero 4 yes 12
r_grep_to_zero:bug-report bug-report seed:dotnet-canon:r_grep_to_zero 3 yes 12
r_idp_policy_pinned:ticket ticket seed:dotnet-canon:r_idp_policy_pinned 3 yes 12
r_idp_policy_pinned:paraphrase paraphrase seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_idp_policy_pinned:bug-report bug-report seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_middleware_order:ticket ticket seed:dotnet-canon:r_middleware_order 2 yes 12
r_middleware_order:paraphrase paraphrase seed:dotnet-canon:r_middleware_order 2 yes 12
r_middleware_order:bug-report bug-report seed:dotnet-canon:r_middleware_order 1 yes 12
r_migrations_immutable:ticket ticket seed:dotnet-canon:r_migrations_immutable 1 yes 9
r_migrations_immutable:paraphrase paraphrase seed:dotnet-canon:r_migrations_immutable 1 yes 12
r_migrations_immutable:bug-report bug-report seed:dotnet-canon:r_migrations_immutable 3 yes 12
r_pagination_cap:ticket ticket seed:dotnet-canon:r_pagination_cap - MISS 12
r_pagination_cap:paraphrase paraphrase seed:dotnet-canon:r_pagination_cap 29 MISS 12
r_pagination_cap:bug-report bug-report seed:dotnet-canon:r_pagination_cap 17 MISS 12
r_rate_limiter_scaleout:ticket ticket seed:dotnet-canon:r_rate_limiter_scaleout 3 yes 12
r_rate_limiter_scaleout:paraphrase paraphrase seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 12
r_rate_limiter_scaleout:bug-report bug-report seed:dotnet-canon:r_rate_limiter_scaleout 3 yes 12
r_request_naming:ticket ticket seed:dotnet-canon:r_request_naming 1 yes 12
r_request_naming:paraphrase paraphrase seed:dotnet-canon:r_request_naming 1 yes 12
r_request_naming:bug-report bug-report seed:dotnet-canon:r_request_naming 2 yes 12
r_rich_domain_when_observed:ticket ticket seed:dotnet-canon:r_rich_domain_when_observed 3 yes 12
r_rich_domain_when_observed:paraphrase paraphrase seed:dotnet-canon:r_rich_domain_when_observed 2 yes 12
r_rich_domain_when_observed:bug-report bug-report seed:dotnet-canon:r_rich_domain_when_observed 1 yes 12
r_sargable:ticket ticket seed:dotnet-canon:r_sargable 1 yes 11
r_sargable:paraphrase paraphrase seed:dotnet-canon:r_sargable 23 MISS 12
r_sargable:bug-report bug-report seed:dotnet-canon:r_sargable 1 yes 12
r_surprise_in_writing:ticket ticket seed:dotnet-canon:r_surprise_in_writing 31 MISS 12
r_surprise_in_writing:paraphrase paraphrase seed:dotnet-canon:r_surprise_in_writing 1 yes 10
r_surprise_in_writing:bug-report bug-report seed:dotnet-canon:r_surprise_in_writing 1 yes 12
r_wolverine_lockstep:ticket ticket seed:dotnet-canon:r_wolverine_lockstep 32 MISS 12
r_wolverine_lockstep:paraphrase paraphrase seed:dotnet-canon:r_wolverine_lockstep 1 yes 12
r_wolverine_lockstep:bug-report bug-report seed:dotnet-canon:r_wolverine_lockstep 1 yes 12
pd_authz_adapts_at_endpoint_boundary:ticket ticket seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary - MISS 12
pd_authz_adapts_at_endpoint_boundary:paraphrase paraphrase seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 6 yes 12
pd_authz_adapts_at_endpoint_boundary:bug-report bug-report seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 25 MISS 12
pd_central_package_management:ticket ticket seed:dotnet-decisions:pd_central_package_management 18 MISS 12
pd_central_package_management:paraphrase paraphrase seed:dotnet-decisions:pd_central_package_management 1 yes 12
pd_central_package_management:bug-report bug-report seed:dotnet-decisions:pd_central_package_management 2 yes 12
pd_established_idp_never_handroll_auth:ticket ticket seed:dotnet-decisions:pd_established_idp_never_handroll_auth 26 MISS 9
pd_established_idp_never_handroll_auth:paraphrase paraphrase seed:dotnet-decisions:pd_established_idp_never_handroll_auth 77 MISS 12
pd_established_idp_never_handroll_auth:bug-report bug-report seed:dotnet-decisions:pd_established_idp_never_handroll_auth 2 yes 12
pd_license_driven_test_lib_forks:ticket ticket seed:dotnet-decisions:pd_license_driven_test_lib_forks 6 yes 12
pd_license_driven_test_lib_forks:paraphrase paraphrase seed:dotnet-decisions:pd_license_driven_test_lib_forks 1 yes 12
pd_license_driven_test_lib_forks:bug-report bug-report seed:dotnet-decisions:pd_license_driven_test_lib_forks 32 MISS 12
pd_nonhandler_outbox_idbcontextoutbox:ticket ticket seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 1 yes 12
pd_nonhandler_outbox_idbcontextoutbox:paraphrase paraphrase seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 23 MISS 12
pd_nonhandler_outbox_idbcontextoutbox:bug-report bug-report seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 5 yes 12
pd_openapi_dev_only:ticket ticket seed:dotnet-decisions:pd_openapi_dev_only 3 yes 12
pd_openapi_dev_only:paraphrase paraphrase seed:dotnet-decisions:pd_openapi_dev_only 5 MISS 5
pd_openapi_dev_only:bug-report bug-report seed:dotnet-decisions:pd_openapi_dev_only 1 yes 12
pd_rate_limit_expensive_endpoints:ticket ticket seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 5 yes 12
pd_rate_limit_expensive_endpoints:paraphrase paraphrase seed:dotnet-decisions:pd_rate_limit_expensive_endpoints - MISS 6
pd_rate_limit_expensive_endpoints:bug-report bug-report seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 2 yes 12
pd_require_explicit_api_version:ticket ticket seed:dotnet-decisions:pd_require_explicit_api_version 1 yes 12
pd_require_explicit_api_version:paraphrase paraphrase seed:dotnet-decisions:pd_require_explicit_api_version - MISS 12
pd_require_explicit_api_version:bug-report bug-report seed:dotnet-decisions:pd_require_explicit_api_version 4 MISS 12
pd_standard_resilience_handler:ticket ticket seed:dotnet-decisions:pd_standard_resilience_handler 1 yes 10
pd_standard_resilience_handler:paraphrase paraphrase seed:dotnet-decisions:pd_standard_resilience_handler 2 yes 12
pd_standard_resilience_handler:bug-report bug-report seed:dotnet-decisions:pd_standard_resilience_handler - MISS 12
pd_three_validation_layers:ticket ticket seed:dotnet-decisions:pd_three_validation_layers 17 MISS 12
pd_three_validation_layers:paraphrase paraphrase seed:dotnet-decisions:pd_three_validation_layers 6 yes 12
pd_three_validation_layers:bug-report bug-report seed:dotnet-decisions:pd_three_validation_layers 21 MISS 12
pd_transport_decision_tree:ticket ticket seed:dotnet-decisions:pd_transport_decision_tree 1 yes 12
pd_transport_decision_tree:paraphrase paraphrase seed:dotnet-decisions:pd_transport_decision_tree 2 yes 10
pd_transport_decision_tree:bug-report bug-report seed:dotnet-decisions:pd_transport_decision_tree 1 yes 12
pd_url_segment_versioning:ticket ticket seed:dotnet-decisions:pd_url_segment_versioning 3 yes 12
pd_url_segment_versioning:paraphrase paraphrase seed:dotnet-decisions:pd_url_segment_versioning - MISS 12
pd_url_segment_versioning:bug-report bug-report seed:dotnet-decisions:pd_url_segment_versioning 1 yes 12
pd_wolverine_middleware_order:ticket ticket seed:dotnet-decisions:pd_wolverine_middleware_order 1 yes 12
pd_wolverine_middleware_order:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_middleware_order 75 MISS 12
pd_wolverine_middleware_order:bug-report bug-report seed:dotnet-decisions:pd_wolverine_middleware_order 1 yes 12
pd_wolverine_over_mediatr_masstransit:ticket ticket seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 12
pd_wolverine_over_mediatr_masstransit:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 4 yes 12
pd_wolverine_over_mediatr_masstransit:bug-report bug-report seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 5 yes 12
pd_zero_warning_build:ticket ticket seed:dotnet-decisions:pd_zero_warning_build 19 MISS 12
pd_zero_warning_build:paraphrase paraphrase seed:dotnet-decisions:pd_zero_warning_build 1 yes 12
pd_zero_warning_build:bug-report bug-report seed:dotnet-decisions:pd_zero_warning_build 1 yes 12
g_tombstones_nc:ticket ticket seed:dotnet-defects:g_tombstones_nc 1 yes 12
g_tombstones_nc:paraphrase paraphrase seed:dotnet-defects:g_tombstones_nc 20 MISS 12
g_tombstones_nc:bug-report bug-report seed:dotnet-defects:g_tombstones_nc 1 yes 12
nc_arch_reviewer:ticket ticket seed:dotnet-defects:nc_arch_reviewer 7 yes 12
nc_arch_reviewer:paraphrase paraphrase seed:dotnet-defects:nc_arch_reviewer 3 yes 12
nc_arch_reviewer:bug-report bug-report seed:dotnet-defects:nc_arch_reviewer 1 yes 12
nc_idor:ticket ticket seed:dotnet-defects:nc_idor 2 yes 12
nc_idor:paraphrase paraphrase seed:dotnet-defects:nc_idor 4 yes 12
nc_idor:bug-report bug-report seed:dotnet-defects:nc_idor 1 yes 12
nc_jwt_clockskew:ticket ticket seed:dotnet-defects:nc_jwt_clockskew 1 yes 12
nc_jwt_clockskew:paraphrase paraphrase seed:dotnet-defects:nc_jwt_clockskew 3 yes 12
nc_jwt_clockskew:bug-report bug-report seed:dotnet-defects:nc_jwt_clockskew 1 yes 12
nc_speculative_interface:ticket ticket seed:dotnet-defects:nc_speculative_interface 21 MISS 12
nc_speculative_interface:paraphrase paraphrase seed:dotnet-defects:nc_speculative_interface 2 yes 12
nc_speculative_interface:bug-report bug-report seed:dotnet-defects:nc_speculative_interface 1 yes 12
rs_event_carries_recipient_id:ticket ticket seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_event_carries_recipient_id:paraphrase paraphrase seed:dotnet-review-surfaces:rs_event_carries_recipient_id 5 yes 12
rs_event_carries_recipient_id:bug-report bug-report seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_integration_tests_default:ticket ticket seed:dotnet-review-surfaces:rs_integration_tests_default 23 MISS 12
rs_integration_tests_default:paraphrase paraphrase seed:dotnet-review-surfaces:rs_integration_tests_default 16 MISS 12
rs_integration_tests_default:bug-report bug-report seed:dotnet-review-surfaces:rs_integration_tests_default - MISS 12
rs_keyed_services_over_factories:ticket ticket seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 12
rs_keyed_services_over_factories:paraphrase paraphrase seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 12
rs_keyed_services_over_factories:bug-report bug-report seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 12
rs_meter_wildcard_registration:ticket ticket seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 12
rs_meter_wildcard_registration:paraphrase paraphrase seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 12
rs_meter_wildcard_registration:bug-report bug-report seed:dotnet-review-surfaces:rs_meter_wildcard_registration 5 yes 12
rs_sweeper_hygiene:ticket ticket seed:dotnet-review-surfaces:rs_sweeper_hygiene 2 yes 12
rs_sweeper_hygiene:paraphrase paraphrase seed:dotnet-review-surfaces:rs_sweeper_hygiene 4 yes 12
rs_sweeper_hygiene:bug-report bug-report seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_transport_removal_orphans:ticket ticket seed:dotnet-review-surfaces:rs_transport_removal_orphans 7 yes 12
rs_transport_removal_orphans:paraphrase paraphrase seed:dotnet-review-surfaces:rs_transport_removal_orphans 4 yes 12
rs_transport_removal_orphans:bug-report bug-report seed:dotnet-review-surfaces:rs_transport_removal_orphans 2 yes 12
rs_workflow_hardening_baseline:ticket ticket seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rs_workflow_hardening_baseline:paraphrase paraphrase seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rs_workflow_hardening_baseline:bug-report bug-report seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rxc_mutation_invalidate:ticket ticket seed:frontend-canon:rxc_mutation_invalidate 12 yes 12
rxc_mutation_invalidate:paraphrase paraphrase seed:frontend-canon:rxc_mutation_invalidate 67 MISS 12
rxc_mutation_invalidate:bug-report bug-report seed:frontend-canon:rxc_mutation_invalidate 8 yes 12
rxc_query_keys:ticket ticket seed:frontend-canon:rxc_query_keys 1 yes 12
rxc_query_keys:paraphrase paraphrase seed:frontend-canon:rxc_query_keys 9 MISS 12
rxc_query_keys:bug-report bug-report seed:frontend-canon:rxc_query_keys 25 MISS 12
rxc_shared_promotion:ticket ticket seed:frontend-canon:rxc_shared_promotion 1 yes 12
rxc_shared_promotion:paraphrase paraphrase seed:frontend-canon:rxc_shared_promotion 8 MISS 7
rxc_shared_promotion:bug-report bug-report seed:frontend-canon:rxc_shared_promotion 1 yes 12
r_resubstitution_not_validation:ticket ticket seed:geospatial-deeptime-defects:r_resubstitution_not_validation 4 yes 12
r_resubstitution_not_validation:paraphrase paraphrase seed:geospatial-deeptime-defects:r_resubstitution_not_validation 44 MISS 12
r_resubstitution_not_validation:bug-report bug-report seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 12
d15:ticket ticket seed:geospatial-defects:d15 1 yes 12
d15:paraphrase paraphrase seed:geospatial-defects:d15 6 yes 12
d15:bug-report bug-report seed:geospatial-defects:d15 1 yes 12
g_verify_outputs:ticket ticket seed:geospatial-defects:g_verify_outputs 5 yes 12
g_verify_outputs:paraphrase paraphrase seed:geospatial-defects:g_verify_outputs 52 MISS 9
g_verify_outputs:bug-report bug-report seed:geospatial-defects:g_verify_outputs - MISS 12
d_invoked_by_nothing:ticket ticket seed:geospatial-enforcement-defects:d_invoked_by_nothing 1 yes 12
d_invoked_by_nothing:paraphrase paraphrase seed:geospatial-enforcement-defects:d_invoked_by_nothing 3 yes 12
d_invoked_by_nothing:bug-report bug-report seed:geospatial-enforcement-defects:d_invoked_by_nothing 2 yes 12
d_month_range_28:ticket ticket seed:geospatial-enforcement-defects:d_month_range_28 1 yes 12
d_month_range_28:paraphrase paraphrase seed:geospatial-enforcement-defects:d_month_range_28 3 yes 12
d_month_range_28:bug-report bug-report seed:geospatial-enforcement-defects:d_month_range_28 1 yes 10
g_gate_every_dir:ticket ticket seed:geospatial-enforcement-defects:g_gate_every_dir 13 MISS 12
g_gate_every_dir:paraphrase paraphrase seed:geospatial-enforcement-defects:g_gate_every_dir 3 yes 12
g_gate_every_dir:bug-report bug-report seed:geospatial-enforcement-defects:g_gate_every_dir 3 yes 12
g_review_agent_in_ci:ticket ticket seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
g_review_agent_in_ci:paraphrase paraphrase seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
g_review_agent_in_ci:bug-report bug-report seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
r_pin_gating_tools:ticket ticket seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 12
r_pin_gating_tools:paraphrase paraphrase seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 12
r_pin_gating_tools:bug-report bug-report seed:geospatial-enforcement-defects:r_pin_gating_tools 2 yes 12
r_preregistered_control_vetoes:ticket ticket seed:geospatial-eval-defects:r_preregistered_control_vetoes 2 yes 12
r_preregistered_control_vetoes:paraphrase paraphrase seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 12
r_preregistered_control_vetoes:bug-report bug-report seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 12
py_classes_earn_place:ticket ticket seed:python-canon:py_classes_earn_place - MISS 12
py_classes_earn_place:paraphrase paraphrase seed:python-canon:py_classes_earn_place 1 yes 10
py_classes_earn_place:bug-report bug-report seed:python-canon:py_classes_earn_place 1 yes 12
py_comments_why:ticket ticket seed:python-canon:py_comments_why 18 MISS 12
py_comments_why:paraphrase paraphrase seed:python-canon:py_comments_why 29 MISS 12
py_comments_why:bug-report bug-report seed:python-canon:py_comments_why 6 yes 12
py_contract_tests:ticket ticket seed:python-canon:py_contract_tests 1 yes 12
py_contract_tests:paraphrase paraphrase seed:python-canon:py_contract_tests 10 yes 12
py_contract_tests:bug-report bug-report seed:python-canon:py_contract_tests 1 yes 12
py_docstrings:ticket ticket seed:python-canon:py_docstrings 2 yes 12
py_docstrings:paraphrase paraphrase seed:python-canon:py_docstrings 38 MISS 12
py_docstrings:bug-report bug-report seed:python-canon:py_docstrings 1 yes 12
py_exceptions_canon:ticket ticket seed:python-canon:py_exceptions_canon 9 yes 12
py_exceptions_canon:paraphrase paraphrase seed:python-canon:py_exceptions_canon 56 MISS 12
py_exceptions_canon:bug-report bug-report seed:python-canon:py_exceptions_canon 7 yes 12
py_no_power_features:ticket ticket seed:python-canon:py_no_power_features 45 MISS 12
py_no_power_features:paraphrase paraphrase seed:python-canon:py_no_power_features - MISS 12
py_no_power_features:bug-report bug-report seed:python-canon:py_no_power_features 1 yes 12
py_one_docstring_format:ticket ticket seed:python-canon:py_one_docstring_format 1 yes 12
py_one_docstring_format:paraphrase paraphrase seed:python-canon:py_one_docstring_format 1 yes 12
py_one_docstring_format:bug-report bug-report seed:python-canon:py_one_docstring_format 1 yes 12
py_print_at_edges:ticket ticket seed:python-canon:py_print_at_edges 4 yes 12
py_print_at_edges:paraphrase paraphrase seed:python-canon:py_print_at_edges 1 yes 12
py_print_at_edges:bug-report bug-report seed:python-canon:py_print_at_edges 7 yes 12
py_protocol_isinstance_names_only:ticket ticket seed:python-canon:py_protocol_isinstance_names_only 7 yes 12
py_protocol_isinstance_names_only:paraphrase paraphrase seed:python-canon:py_protocol_isinstance_names_only 11 yes 12
py_protocol_isinstance_names_only:bug-report bug-report seed:python-canon:py_protocol_isinstance_names_only 2 yes 12
py_starlette_httpx2:ticket ticket seed:python-canon:py_starlette_httpx2 1 yes 12
py_starlette_httpx2:paraphrase paraphrase seed:python-canon:py_starlette_httpx2 1 yes 12
py_starlette_httpx2:bug-report bug-report seed:python-canon:py_starlette_httpx2 1 yes 12
py_strict_pytest:ticket ticket seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:paraphrase paraphrase seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:bug-report bug-report seed:python-canon:py_strict_pytest 3 yes 12
py_type_hints_gradual:ticket ticket seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:paraphrase paraphrase seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:bug-report bug-report seed:python-canon:py_type_hints_gradual 1 yes 12
py_typing_syntax_floor:ticket ticket seed:python-canon:py_typing_syntax_floor 1 yes 12
py_typing_syntax_floor:paraphrase paraphrase seed:python-canon:py_typing_syntax_floor 1 yes 12
py_typing_syntax_floor:bug-report bug-report seed:python-canon:py_typing_syntax_floor 1 yes 12
qz_agent_contract:ticket ticket seed:rag-defects:qz_agent_contract 3 yes 12
qz_agent_contract:paraphrase paraphrase seed:rag-defects:qz_agent_contract - MISS 12
qz_agent_contract:bug-report bug-report seed:rag-defects:qz_agent_contract 2 yes 12
qz_fixtures:ticket ticket seed:rag-defects:qz_fixtures 1 yes 12
qz_fixtures:paraphrase paraphrase seed:rag-defects:qz_fixtures 39 MISS 8
qz_fixtures:bug-report bug-report seed:rag-defects:qz_fixtures 1 yes 12
qz_identity:ticket ticket seed:rag-defects:qz_identity 1 yes 12
qz_identity:paraphrase paraphrase seed:rag-defects:qz_identity 1 yes 12
qz_identity:bug-report bug-report seed:rag-defects:qz_identity 1 yes 12
qz_wrong_corpus:ticket ticket seed:rag-defects:qz_wrong_corpus 3 yes 12
qz_wrong_corpus:paraphrase paraphrase seed:rag-defects:qz_wrong_corpus 6 yes 12
qz_wrong_corpus:bug-report bug-report seed:rag-defects:qz_wrong_corpus 1 yes 12
rx_fight_compiler:ticket ticket seed:react-defects:rx_fight_compiler 1 yes 12
rx_fight_compiler:paraphrase paraphrase seed:react-defects:rx_fight_compiler 24 MISS 12
rx_fight_compiler:bug-report bug-report seed:react-defects:rx_fight_compiler 1 yes 12
rx_tokens_localstorage:ticket ticket seed:react-defects:rx_tokens_localstorage 1 yes 12
rx_tokens_localstorage:paraphrase paraphrase seed:react-defects:rx_tokens_localstorage 1 yes 12
rx_tokens_localstorage:bug-report bug-report seed:react-defects:rx_tokens_localstorage 1 yes 12
