bench · label calibrated · split selection · code 29933681bc47
corpus: 183 records from 12 seed packs (sha 271b057d54d6) · queries queries.jsonl sha 97ecbcb5d681 · nulls 550 (sha 6e100bad522c)
arm: decision calibrated · hybrid off · rerank off · limit 12 · common-word share 0.05 · interests none · triggers on 173 lessons (triggers.jsonl, sha 814c7bb5aa68)

register       n         recall (briefed)  hit@1  hit@3  hit@12    MRR briefed/q
bug-report    83    96.4% [91.6%, 100.0%]  79.5%  94.0%   98.8%  0.876       4.9
paraphrase    83    77.1% [67.5%, 85.5%]  62.7%  75.9%   90.4%  0.714       4.4
ticket        83    90.4% [83.1%, 96.4%]  69.9%  86.7%   95.2%  0.789       4.7
all          249    88.0% [83.9%, 91.6%]  70.7%  85.5%   94.8%  0.793       4.7

null prompts briefed nothing: 528 of 550 (96.0%, 95% [94.0%, 97.3%]) · the rest got 2.4 lessons on average
  calibration half (sets the calibrated line): briefed anything 13 of 282 (4.6%, 95% [2.7%, 7.7%])
  unseen half (sets the calibrated line: never seen by it): briefed anything 9 of 268 (3.4%, 95% [1.8%, 6.3%])
latency per check: median 12 ms · p95 14 ms · 799 checks

per query: id register lesson rank briefed count
dec_sixth_surface:ticket ticket seed:dotnet-canon:dec_sixth_surface 1 yes 4
dec_sixth_surface:paraphrase paraphrase seed:dotnet-canon:dec_sixth_surface 1 yes 4
dec_sixth_surface:bug-report bug-report seed:dotnet-canon:dec_sixth_surface 2 yes 5
r_202_long_running:ticket ticket seed:dotnet-canon:r_202_long_running 3 yes 4
r_202_long_running:paraphrase paraphrase seed:dotnet-canon:r_202_long_running 1 yes 5
r_202_long_running:bug-report bug-report seed:dotnet-canon:r_202_long_running 1 yes 5
r_aaa_narrative:ticket ticket seed:dotnet-canon:r_aaa_narrative 24 MISS 5
r_aaa_narrative:paraphrase paraphrase seed:dotnet-canon:r_aaa_narrative 32 MISS 5
r_aaa_narrative:bug-report bug-report seed:dotnet-canon:r_aaa_narrative 2 yes 5
r_arch_enforcement_ladder:ticket ticket seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 5
r_arch_enforcement_ladder:paraphrase paraphrase seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 5
r_arch_enforcement_ladder:bug-report bug-report seed:dotnet-canon:r_arch_enforcement_ladder 2 yes 5
r_aspire_azure_fallback:ticket ticket seed:dotnet-canon:r_aspire_azure_fallback 1 yes 5
r_aspire_azure_fallback:paraphrase paraphrase seed:dotnet-canon:r_aspire_azure_fallback 7 MISS 5
r_aspire_azure_fallback:bug-report bug-report seed:dotnet-canon:r_aspire_azure_fallback 1 yes 5
r_aspire_versions:ticket ticket seed:dotnet-canon:r_aspire_versions 1 yes 1
r_aspire_versions:paraphrase paraphrase seed:dotnet-canon:r_aspire_versions 1 yes 5
r_aspire_versions:bug-report bug-report seed:dotnet-canon:r_aspire_versions 1 yes 5
r_aspire_waitfor:ticket ticket seed:dotnet-canon:r_aspire_waitfor 1 yes 5
r_aspire_waitfor:paraphrase paraphrase seed:dotnet-canon:r_aspire_waitfor 1 yes 5
r_aspire_waitfor:bug-report bug-report seed:dotnet-canon:r_aspire_waitfor 1 yes 5
r_bulk_ops:ticket ticket seed:dotnet-canon:r_bulk_ops 1 yes 5
r_bulk_ops:paraphrase paraphrase seed:dotnet-canon:r_bulk_ops 3 yes 4
r_bulk_ops:bug-report bug-report seed:dotnet-canon:r_bulk_ops 12 MISS 5
r_comments_durable_docs:ticket ticket seed:dotnet-canon:r_comments_durable_docs 1 yes 2
r_comments_durable_docs:paraphrase paraphrase seed:dotnet-canon:r_comments_durable_docs 1 MISS 1
r_comments_durable_docs:bug-report bug-report seed:dotnet-canon:r_comments_durable_docs 1 yes 3
r_docs_review_surface:ticket ticket seed:dotnet-canon:r_docs_review_surface 3 yes 5
r_docs_review_surface:paraphrase paraphrase seed:dotnet-canon:r_docs_review_surface 23 MISS 5
r_docs_review_surface:bug-report bug-report seed:dotnet-canon:r_docs_review_surface 1 yes 5
r_durability_not_replay:ticket ticket seed:dotnet-canon:r_durability_not_replay 1 yes 5
r_durability_not_replay:paraphrase paraphrase seed:dotnet-canon:r_durability_not_replay 1 yes 5
r_durability_not_replay:bug-report bug-report seed:dotnet-canon:r_durability_not_replay 1 yes 5
r_encoding_loop:ticket ticket seed:dotnet-canon:r_encoding_loop 2 yes 5
r_encoding_loop:paraphrase paraphrase seed:dotnet-canon:r_encoding_loop 4 MISS 5
r_encoding_loop:bug-report bug-report seed:dotnet-canon:r_encoding_loop 1 yes 5
r_exceptions_canon:ticket ticket seed:dotnet-canon:r_exceptions_canon 7 yes 3
r_exceptions_canon:paraphrase paraphrase seed:dotnet-canon:r_exceptions_canon 11 yes 5
r_exceptions_canon:bug-report bug-report seed:dotnet-canon:r_exceptions_canon 3 MISS 5
r_experiment_sunset:ticket ticket seed:dotnet-canon:r_experiment_sunset 1 yes 5
r_experiment_sunset:paraphrase paraphrase seed:dotnet-canon:r_experiment_sunset 1 yes 4
r_experiment_sunset:bug-report bug-report seed:dotnet-canon:r_experiment_sunset 1 yes 3
r_grep_to_zero:ticket ticket seed:dotnet-canon:r_grep_to_zero 4 yes 5
r_grep_to_zero:paraphrase paraphrase seed:dotnet-canon:r_grep_to_zero 2 yes 5
r_grep_to_zero:bug-report bug-report seed:dotnet-canon:r_grep_to_zero 1 yes 5
r_idp_policy_pinned:ticket ticket seed:dotnet-canon:r_idp_policy_pinned 2 yes 5
r_idp_policy_pinned:paraphrase paraphrase seed:dotnet-canon:r_idp_policy_pinned 1 yes 5
r_idp_policy_pinned:bug-report bug-report seed:dotnet-canon:r_idp_policy_pinned 1 yes 5
r_middleware_order:ticket ticket seed:dotnet-canon:r_middleware_order 2 yes 5
r_middleware_order:paraphrase paraphrase seed:dotnet-canon:r_middleware_order 1 yes 5
r_middleware_order:bug-report bug-report seed:dotnet-canon:r_middleware_order 1 yes 5
r_migrations_immutable:ticket ticket seed:dotnet-canon:r_migrations_immutable 1 yes 5
r_migrations_immutable:paraphrase paraphrase seed:dotnet-canon:r_migrations_immutable 1 yes 5
r_migrations_immutable:bug-report bug-report seed:dotnet-canon:r_migrations_immutable 1 yes 5
r_pagination_cap:ticket ticket seed:dotnet-canon:r_pagination_cap 4 yes 5
r_pagination_cap:paraphrase paraphrase seed:dotnet-canon:r_pagination_cap 32 MISS 5
r_pagination_cap:bug-report bug-report seed:dotnet-canon:r_pagination_cap 2 yes 5
r_rate_limiter_scaleout:ticket ticket seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 5
r_rate_limiter_scaleout:paraphrase paraphrase seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 5
r_rate_limiter_scaleout:bug-report bug-report seed:dotnet-canon:r_rate_limiter_scaleout 2 yes 5
r_request_naming:ticket ticket seed:dotnet-canon:r_request_naming 1 yes 5
r_request_naming:paraphrase paraphrase seed:dotnet-canon:r_request_naming 1 yes 5
r_request_naming:bug-report bug-report seed:dotnet-canon:r_request_naming 1 yes 5
r_rich_domain_when_observed:ticket ticket seed:dotnet-canon:r_rich_domain_when_observed 3 yes 5
r_rich_domain_when_observed:paraphrase paraphrase seed:dotnet-canon:r_rich_domain_when_observed 5 MISS 5
r_rich_domain_when_observed:bug-report bug-report seed:dotnet-canon:r_rich_domain_when_observed 1 yes 5
r_sargable:ticket ticket seed:dotnet-canon:r_sargable 1 yes 5
r_sargable:paraphrase paraphrase seed:dotnet-canon:r_sargable 4 yes 5
r_sargable:bug-report bug-report seed:dotnet-canon:r_sargable 1 yes 5
r_surprise_in_writing:ticket ticket seed:dotnet-canon:r_surprise_in_writing 64 MISS 5
r_surprise_in_writing:paraphrase paraphrase seed:dotnet-canon:r_surprise_in_writing 1 yes 1
r_surprise_in_writing:bug-report bug-report seed:dotnet-canon:r_surprise_in_writing 1 yes 5
r_wolverine_lockstep:ticket ticket seed:dotnet-canon:r_wolverine_lockstep 3 yes 5
r_wolverine_lockstep:paraphrase paraphrase seed:dotnet-canon:r_wolverine_lockstep 1 yes 5
r_wolverine_lockstep:bug-report bug-report seed:dotnet-canon:r_wolverine_lockstep 1 yes 5
pd_authz_adapts_at_endpoint_boundary:ticket ticket seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 6 yes 5
pd_authz_adapts_at_endpoint_boundary:paraphrase paraphrase seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 1 yes 4
pd_authz_adapts_at_endpoint_boundary:bug-report bug-report seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 1 yes 5
pd_central_package_management:ticket ticket seed:dotnet-decisions:pd_central_package_management 10 MISS 5
pd_central_package_management:paraphrase paraphrase seed:dotnet-decisions:pd_central_package_management 1 yes 5
pd_central_package_management:bug-report bug-report seed:dotnet-decisions:pd_central_package_management 1 yes 5
pd_established_idp_never_handroll_auth:ticket ticket seed:dotnet-decisions:pd_established_idp_never_handroll_auth 43 MISS 5
pd_established_idp_never_handroll_auth:paraphrase paraphrase seed:dotnet-decisions:pd_established_idp_never_handroll_auth 4 yes 5
pd_established_idp_never_handroll_auth:bug-report bug-report seed:dotnet-decisions:pd_established_idp_never_handroll_auth 2 yes 5
pd_license_driven_test_lib_forks:ticket ticket seed:dotnet-decisions:pd_license_driven_test_lib_forks 1 yes 5
pd_license_driven_test_lib_forks:paraphrase paraphrase seed:dotnet-decisions:pd_license_driven_test_lib_forks 1 yes 4
pd_license_driven_test_lib_forks:bug-report bug-report seed:dotnet-decisions:pd_license_driven_test_lib_forks 1 yes 5
pd_nonhandler_outbox_idbcontextoutbox:ticket ticket seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 1 yes 5
pd_nonhandler_outbox_idbcontextoutbox:paraphrase paraphrase seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 3 yes 5
pd_nonhandler_outbox_idbcontextoutbox:bug-report bug-report seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 1 yes 5
pd_openapi_dev_only:ticket ticket seed:dotnet-decisions:pd_openapi_dev_only 1 yes 5
pd_openapi_dev_only:paraphrase paraphrase seed:dotnet-decisions:pd_openapi_dev_only 1 MISS 0
pd_openapi_dev_only:bug-report bug-report seed:dotnet-decisions:pd_openapi_dev_only 1 yes 5
pd_rate_limit_expensive_endpoints:ticket ticket seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 2 yes 5
pd_rate_limit_expensive_endpoints:paraphrase paraphrase seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 42 MISS 1
pd_rate_limit_expensive_endpoints:bug-report bug-report seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 1 yes 5
pd_require_explicit_api_version:ticket ticket seed:dotnet-decisions:pd_require_explicit_api_version 1 yes 5
pd_require_explicit_api_version:paraphrase paraphrase seed:dotnet-decisions:pd_require_explicit_api_version 7 yes 5
pd_require_explicit_api_version:bug-report bug-report seed:dotnet-decisions:pd_require_explicit_api_version 4 yes 5
pd_standard_resilience_handler:ticket ticket seed:dotnet-decisions:pd_standard_resilience_handler 1 yes 5
pd_standard_resilience_handler:paraphrase paraphrase seed:dotnet-decisions:pd_standard_resilience_handler 1 yes 5
pd_standard_resilience_handler:bug-report bug-report seed:dotnet-decisions:pd_standard_resilience_handler 4 yes 5
pd_three_validation_layers:ticket ticket seed:dotnet-decisions:pd_three_validation_layers 1 yes 5
pd_three_validation_layers:paraphrase paraphrase seed:dotnet-decisions:pd_three_validation_layers 1 yes 5
pd_three_validation_layers:bug-report bug-report seed:dotnet-decisions:pd_three_validation_layers 1 yes 5
pd_transport_decision_tree:ticket ticket seed:dotnet-decisions:pd_transport_decision_tree 1 yes 5
pd_transport_decision_tree:paraphrase paraphrase seed:dotnet-decisions:pd_transport_decision_tree 1 yes 5
pd_transport_decision_tree:bug-report bug-report seed:dotnet-decisions:pd_transport_decision_tree 1 yes 5
pd_url_segment_versioning:ticket ticket seed:dotnet-decisions:pd_url_segment_versioning 1 yes 5
pd_url_segment_versioning:paraphrase paraphrase seed:dotnet-decisions:pd_url_segment_versioning 34 MISS 1
pd_url_segment_versioning:bug-report bug-report seed:dotnet-decisions:pd_url_segment_versioning 1 yes 5
pd_wolverine_middleware_order:ticket ticket seed:dotnet-decisions:pd_wolverine_middleware_order 1 yes 5
pd_wolverine_middleware_order:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_middleware_order 50 MISS 5
pd_wolverine_middleware_order:bug-report bug-report seed:dotnet-decisions:pd_wolverine_middleware_order 1 yes 5
pd_wolverine_over_mediatr_masstransit:ticket ticket seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 5
pd_wolverine_over_mediatr_masstransit:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 5
pd_wolverine_over_mediatr_masstransit:bug-report bug-report seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 2 yes 5
pd_zero_warning_build:ticket ticket seed:dotnet-decisions:pd_zero_warning_build 2 yes 5
pd_zero_warning_build:paraphrase paraphrase seed:dotnet-decisions:pd_zero_warning_build 1 yes 5
pd_zero_warning_build:bug-report bug-report seed:dotnet-decisions:pd_zero_warning_build 1 yes 5
g_tombstones_nc:ticket ticket seed:dotnet-defects:g_tombstones_nc 1 yes 5
g_tombstones_nc:paraphrase paraphrase seed:dotnet-defects:g_tombstones_nc 4 yes 5
g_tombstones_nc:bug-report bug-report seed:dotnet-defects:g_tombstones_nc 2 yes 5
nc_arch_reviewer:ticket ticket seed:dotnet-defects:nc_arch_reviewer 1 yes 5
nc_arch_reviewer:paraphrase paraphrase seed:dotnet-defects:nc_arch_reviewer 1 yes 5
nc_arch_reviewer:bug-report bug-report seed:dotnet-defects:nc_arch_reviewer 2 yes 5
nc_idor:ticket ticket seed:dotnet-defects:nc_idor 2 yes 5
nc_idor:paraphrase paraphrase seed:dotnet-defects:nc_idor 2 yes 5
nc_idor:bug-report bug-report seed:dotnet-defects:nc_idor 1 yes 5
nc_jwt_clockskew:ticket ticket seed:dotnet-defects:nc_jwt_clockskew 1 yes 5
nc_jwt_clockskew:paraphrase paraphrase seed:dotnet-defects:nc_jwt_clockskew 1 yes 5
nc_jwt_clockskew:bug-report bug-report seed:dotnet-defects:nc_jwt_clockskew 1 yes 5
nc_speculative_interface:ticket ticket seed:dotnet-defects:nc_speculative_interface 7 MISS 5
nc_speculative_interface:paraphrase paraphrase seed:dotnet-defects:nc_speculative_interface 1 yes 5
nc_speculative_interface:bug-report bug-report seed:dotnet-defects:nc_speculative_interface 2 yes 5
rs_event_carries_recipient_id:ticket ticket seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 5
rs_event_carries_recipient_id:paraphrase paraphrase seed:dotnet-review-surfaces:rs_event_carries_recipient_id 3 MISS 5
rs_event_carries_recipient_id:bug-report bug-report seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 5
rs_integration_tests_default:ticket ticket seed:dotnet-review-surfaces:rs_integration_tests_default 2 yes 5
rs_integration_tests_default:paraphrase paraphrase seed:dotnet-review-surfaces:rs_integration_tests_default 23 MISS 5
rs_integration_tests_default:bug-report bug-report seed:dotnet-review-surfaces:rs_integration_tests_default 79 MISS 5
rs_keyed_services_over_factories:ticket ticket seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 5
rs_keyed_services_over_factories:paraphrase paraphrase seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 5
rs_keyed_services_over_factories:bug-report bug-report seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 5
rs_meter_wildcard_registration:ticket ticket seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 5
rs_meter_wildcard_registration:paraphrase paraphrase seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 5
rs_meter_wildcard_registration:bug-report bug-report seed:dotnet-review-surfaces:rs_meter_wildcard_registration 2 yes 5
rs_sweeper_hygiene:ticket ticket seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 5
rs_sweeper_hygiene:paraphrase paraphrase seed:dotnet-review-surfaces:rs_sweeper_hygiene 3 yes 5
rs_sweeper_hygiene:bug-report bug-report seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 5
rs_transport_removal_orphans:ticket ticket seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 5
rs_transport_removal_orphans:paraphrase paraphrase seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 5
rs_transport_removal_orphans:bug-report bug-report seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 5
rs_workflow_hardening_baseline:ticket ticket seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 5
rs_workflow_hardening_baseline:paraphrase paraphrase seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 5
rs_workflow_hardening_baseline:bug-report bug-report seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 5
rxc_mutation_invalidate:ticket ticket seed:frontend-canon:rxc_mutation_invalidate 1 yes 5
rxc_mutation_invalidate:paraphrase paraphrase seed:frontend-canon:rxc_mutation_invalidate 6 MISS 5
rxc_mutation_invalidate:bug-report bug-report seed:frontend-canon:rxc_mutation_invalidate 1 yes 5
rxc_query_keys:ticket ticket seed:frontend-canon:rxc_query_keys 1 yes 5
rxc_query_keys:paraphrase paraphrase seed:frontend-canon:rxc_query_keys 2 yes 4
rxc_query_keys:bug-report bug-report seed:frontend-canon:rxc_query_keys 4 yes 5
rxc_shared_promotion:ticket ticket seed:frontend-canon:rxc_shared_promotion 1 yes 2
rxc_shared_promotion:paraphrase paraphrase seed:frontend-canon:rxc_shared_promotion 1 yes 2
rxc_shared_promotion:bug-report bug-report seed:frontend-canon:rxc_shared_promotion 1 yes 5
r_resubstitution_not_validation:ticket ticket seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 5
r_resubstitution_not_validation:paraphrase paraphrase seed:geospatial-deeptime-defects:r_resubstitution_not_validation 4 yes 5
r_resubstitution_not_validation:bug-report bug-report seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 3
d15:ticket ticket seed:geospatial-defects:d15 1 yes 5
d15:paraphrase paraphrase seed:geospatial-defects:d15 1 yes 3
d15:bug-report bug-report seed:geospatial-defects:d15 1 yes 5
g_verify_outputs:ticket ticket seed:geospatial-defects:g_verify_outputs 5 MISS 5
g_verify_outputs:paraphrase paraphrase seed:geospatial-defects:g_verify_outputs 2 yes 2
g_verify_outputs:bug-report bug-report seed:geospatial-defects:g_verify_outputs 1 yes 5
d_invoked_by_nothing:ticket ticket seed:geospatial-enforcement-defects:d_invoked_by_nothing 1 yes 5
d_invoked_by_nothing:paraphrase paraphrase seed:geospatial-enforcement-defects:d_invoked_by_nothing 3 yes 5
d_invoked_by_nothing:bug-report bug-report seed:geospatial-enforcement-defects:d_invoked_by_nothing 1 yes 5
d_month_range_28:ticket ticket seed:geospatial-enforcement-defects:d_month_range_28 1 yes 5
d_month_range_28:paraphrase paraphrase seed:geospatial-enforcement-defects:d_month_range_28 1 yes 5
d_month_range_28:bug-report bug-report seed:geospatial-enforcement-defects:d_month_range_28 1 yes 1
g_gate_every_dir:ticket ticket seed:geospatial-enforcement-defects:g_gate_every_dir 1 yes 5
g_gate_every_dir:paraphrase paraphrase seed:geospatial-enforcement-defects:g_gate_every_dir 1 yes 5
g_gate_every_dir:bug-report bug-report seed:geospatial-enforcement-defects:g_gate_every_dir 1 yes 5
g_review_agent_in_ci:ticket ticket seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 5
g_review_agent_in_ci:paraphrase paraphrase seed:geospatial-enforcement-defects:g_review_agent_in_ci 2 yes 5
g_review_agent_in_ci:bug-report bug-report seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 5
r_pin_gating_tools:ticket ticket seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 5
r_pin_gating_tools:paraphrase paraphrase seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 5
r_pin_gating_tools:bug-report bug-report seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 5
r_preregistered_control_vetoes:ticket ticket seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 5
r_preregistered_control_vetoes:paraphrase paraphrase seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 3
r_preregistered_control_vetoes:bug-report bug-report seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 4
py_classes_earn_place:ticket ticket seed:python-canon:py_classes_earn_place 77 MISS 5
py_classes_earn_place:paraphrase paraphrase seed:python-canon:py_classes_earn_place 1 yes 2
py_classes_earn_place:bug-report bug-report seed:python-canon:py_classes_earn_place 1 yes 5
py_comments_why:ticket ticket seed:python-canon:py_comments_why 3 yes 5
py_comments_why:paraphrase paraphrase seed:python-canon:py_comments_why 1 yes 2
py_comments_why:bug-report bug-report seed:python-canon:py_comments_why 1 yes 5
py_contract_tests:ticket ticket seed:python-canon:py_contract_tests 1 yes 5
py_contract_tests:paraphrase paraphrase seed:python-canon:py_contract_tests 1 yes 5
py_contract_tests:bug-report bug-report seed:python-canon:py_contract_tests 1 yes 5
py_docstrings:ticket ticket seed:python-canon:py_docstrings 1 yes 5
py_docstrings:paraphrase paraphrase seed:python-canon:py_docstrings 1 MISS 0
py_docstrings:bug-report bug-report seed:python-canon:py_docstrings 1 yes 5
py_exceptions_canon:ticket ticket seed:python-canon:py_exceptions_canon 1 yes 5
py_exceptions_canon:paraphrase paraphrase seed:python-canon:py_exceptions_canon 12 MISS 5
py_exceptions_canon:bug-report bug-report seed:python-canon:py_exceptions_canon 1 yes 5
py_no_power_features:ticket ticket seed:python-canon:py_no_power_features 1 yes 5
py_no_power_features:paraphrase paraphrase seed:python-canon:py_no_power_features 1 yes 5
py_no_power_features:bug-report bug-report seed:python-canon:py_no_power_features 1 yes 5
py_one_docstring_format:ticket ticket seed:python-canon:py_one_docstring_format 1 yes 5
py_one_docstring_format:paraphrase paraphrase seed:python-canon:py_one_docstring_format 1 yes 5
py_one_docstring_format:bug-report bug-report seed:python-canon:py_one_docstring_format 1 yes 5
py_print_at_edges:ticket ticket seed:python-canon:py_print_at_edges 2 MISS 0
py_print_at_edges:paraphrase paraphrase seed:python-canon:py_print_at_edges 1 yes 5
py_print_at_edges:bug-report bug-report seed:python-canon:py_print_at_edges 1 yes 5
py_protocol_isinstance_names_only:ticket ticket seed:python-canon:py_protocol_isinstance_names_only 1 yes 4
py_protocol_isinstance_names_only:paraphrase paraphrase seed:python-canon:py_protocol_isinstance_names_only 2 yes 5
py_protocol_isinstance_names_only:bug-report bug-report seed:python-canon:py_protocol_isinstance_names_only 1 yes 5
py_starlette_httpx2:ticket ticket seed:python-canon:py_starlette_httpx2 1 yes 5
py_starlette_httpx2:paraphrase paraphrase seed:python-canon:py_starlette_httpx2 1 yes 5
py_starlette_httpx2:bug-report bug-report seed:python-canon:py_starlette_httpx2 1 yes 5
py_strict_pytest:ticket ticket seed:python-canon:py_strict_pytest 1 yes 5
py_strict_pytest:paraphrase paraphrase seed:python-canon:py_strict_pytest 1 yes 5
py_strict_pytest:bug-report bug-report seed:python-canon:py_strict_pytest 1 yes 5
py_type_hints_gradual:ticket ticket seed:python-canon:py_type_hints_gradual 1 yes 5
py_type_hints_gradual:paraphrase paraphrase seed:python-canon:py_type_hints_gradual 1 yes 5
py_type_hints_gradual:bug-report bug-report seed:python-canon:py_type_hints_gradual 1 yes 5
py_typing_syntax_floor:ticket ticket seed:python-canon:py_typing_syntax_floor 1 yes 5
py_typing_syntax_floor:paraphrase paraphrase seed:python-canon:py_typing_syntax_floor 1 yes 5
py_typing_syntax_floor:bug-report bug-report seed:python-canon:py_typing_syntax_floor 1 yes 5
qz_agent_contract:ticket ticket seed:rag-defects:qz_agent_contract 2 yes 5
qz_agent_contract:paraphrase paraphrase seed:rag-defects:qz_agent_contract 5 MISS 5
qz_agent_contract:bug-report bug-report seed:rag-defects:qz_agent_contract 1 yes 5
qz_fixtures:ticket ticket seed:rag-defects:qz_fixtures 1 yes 3
qz_fixtures:paraphrase paraphrase seed:rag-defects:qz_fixtures 14 MISS 2
qz_fixtures:bug-report bug-report seed:rag-defects:qz_fixtures 1 yes 5
qz_identity:ticket ticket seed:rag-defects:qz_identity 1 yes 4
qz_identity:paraphrase paraphrase seed:rag-defects:qz_identity 1 MISS 5
qz_identity:bug-report bug-report seed:rag-defects:qz_identity 1 yes 5
qz_wrong_corpus:ticket ticket seed:rag-defects:qz_wrong_corpus 1 yes 5
qz_wrong_corpus:paraphrase paraphrase seed:rag-defects:qz_wrong_corpus 1 yes 5
qz_wrong_corpus:bug-report bug-report seed:rag-defects:qz_wrong_corpus 1 yes 5
rx_fight_compiler:ticket ticket seed:react-defects:rx_fight_compiler 1 yes 5
rx_fight_compiler:paraphrase paraphrase seed:react-defects:rx_fight_compiler 1 yes 5
rx_fight_compiler:bug-report bug-report seed:react-defects:rx_fight_compiler 1 yes 5
rx_tokens_localstorage:ticket ticket seed:react-defects:rx_tokens_localstorage 1 yes 5
rx_tokens_localstorage:paraphrase paraphrase seed:react-defects:rx_tokens_localstorage 1 yes 5
rx_tokens_localstorage:bug-report bug-report seed:react-defects:rx_tokens_localstorage 1 yes 5
