bench · label v1-rerank · split selection · code 29933681bc47
corpus: 183 records from 12 seed packs (sha 271b057d54d6) · queries queries.jsonl sha 97ecbcb5d681 · nulls 550 (sha 6e100bad522c)
arm: decision floor · hybrid linear · rerank on · limit 12 · common-word share 0.05 · interests none · triggers on 0 lessons

register       n         recall (briefed)  hit@1  hit@3  hit@12    MRR briefed/q
bug-report    83    84.3% [75.9%, 91.6%]  38.6%  51.8%   85.5%  0.512      12.0
paraphrase    83    66.3% [56.6%, 75.9%]  27.7%  42.2%   74.7%  0.395      11.7
ticket        83    79.5% [71.1%, 88.0%]  34.9%  51.8%   84.3%  0.479      11.9
all          249    76.7% [71.1%, 82.3%]  33.7%  48.6%   81.5%  0.462      11.9

null prompts briefed nothing: 237 of 550 (43.1%, 95% [39.0%, 47.3%]) · the rest got 5.9 lessons on average
  calibration half (sets the calibrated line): briefed anything 163 of 282 (57.8%, 95% [52.0%, 63.4%])
  unseen half (sets the calibrated line: never seen by it): briefed anything 150 of 268 (56.0%, 95% [50.0%, 61.8%])
latency per check: median 1723 ms · p95 3108 ms · 799 checks

per query: id register lesson rank briefed count
dec_sixth_surface:ticket ticket seed:dotnet-canon:dec_sixth_surface 1 yes 12
dec_sixth_surface:paraphrase paraphrase seed:dotnet-canon:dec_sixth_surface 21 MISS 12
dec_sixth_surface:bug-report bug-report seed:dotnet-canon:dec_sixth_surface 8 yes 12
r_202_long_running:ticket ticket seed:dotnet-canon:r_202_long_running 11 MISS 10
r_202_long_running:paraphrase paraphrase seed:dotnet-canon:r_202_long_running 1 yes 12
r_202_long_running:bug-report bug-report seed:dotnet-canon:r_202_long_running 26 MISS 12
r_aaa_narrative:ticket ticket seed:dotnet-canon:r_aaa_narrative 56 MISS 12
r_aaa_narrative:paraphrase paraphrase seed:dotnet-canon:r_aaa_narrative 21 MISS 12
r_aaa_narrative:bug-report bug-report seed:dotnet-canon:r_aaa_narrative 11 yes 12
r_arch_enforcement_ladder:ticket ticket seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 12
r_arch_enforcement_ladder:paraphrase paraphrase seed:dotnet-canon:r_arch_enforcement_ladder 2 yes 12
r_arch_enforcement_ladder:bug-report bug-report seed:dotnet-canon:r_arch_enforcement_ladder 4 yes 12
r_aspire_azure_fallback:ticket ticket seed:dotnet-canon:r_aspire_azure_fallback 1 yes 12
r_aspire_azure_fallback:paraphrase paraphrase seed:dotnet-canon:r_aspire_azure_fallback 30 MISS 12
r_aspire_azure_fallback:bug-report bug-report seed:dotnet-canon:r_aspire_azure_fallback 4 yes 12
r_aspire_versions:ticket ticket seed:dotnet-canon:r_aspire_versions 2 yes 12
r_aspire_versions:paraphrase paraphrase seed:dotnet-canon:r_aspire_versions 3 yes 12
r_aspire_versions:bug-report bug-report seed:dotnet-canon:r_aspire_versions 2 yes 12
r_aspire_waitfor:ticket ticket seed:dotnet-canon:r_aspire_waitfor 2 yes 12
r_aspire_waitfor:paraphrase paraphrase seed:dotnet-canon:r_aspire_waitfor 28 MISS 12
r_aspire_waitfor:bug-report bug-report seed:dotnet-canon:r_aspire_waitfor 1 yes 12
r_bulk_ops:ticket ticket seed:dotnet-canon:r_bulk_ops 40 MISS 12
r_bulk_ops:paraphrase paraphrase seed:dotnet-canon:r_bulk_ops 7 MISS 12
r_bulk_ops:bug-report bug-report seed:dotnet-canon:r_bulk_ops 26 MISS 12
r_comments_durable_docs:ticket ticket seed:dotnet-canon:r_comments_durable_docs 4 yes 12
r_comments_durable_docs:paraphrase paraphrase seed:dotnet-canon:r_comments_durable_docs 13 MISS 12
r_comments_durable_docs:bug-report bug-report seed:dotnet-canon:r_comments_durable_docs 7 yes 12
r_docs_review_surface:ticket ticket seed:dotnet-canon:r_docs_review_surface 23 MISS 12
r_docs_review_surface:paraphrase paraphrase seed:dotnet-canon:r_docs_review_surface 157 MISS 12
r_docs_review_surface:bug-report bug-report seed:dotnet-canon:r_docs_review_surface 6 yes 12
r_durability_not_replay:ticket ticket seed:dotnet-canon:r_durability_not_replay 2 yes 12
r_durability_not_replay:paraphrase paraphrase seed:dotnet-canon:r_durability_not_replay 1 yes 12
r_durability_not_replay:bug-report bug-report seed:dotnet-canon:r_durability_not_replay 3 yes 12
r_encoding_loop:ticket ticket seed:dotnet-canon:r_encoding_loop 1 yes 12
r_encoding_loop:paraphrase paraphrase seed:dotnet-canon:r_encoding_loop 5 yes 12
r_encoding_loop:bug-report bug-report seed:dotnet-canon:r_encoding_loop 1 yes 12
r_exceptions_canon:ticket ticket seed:dotnet-canon:r_exceptions_canon 45 MISS 12
r_exceptions_canon:paraphrase paraphrase seed:dotnet-canon:r_exceptions_canon 3 yes 12
r_exceptions_canon:bug-report bug-report seed:dotnet-canon:r_exceptions_canon 7 yes 12
r_experiment_sunset:ticket ticket seed:dotnet-canon:r_experiment_sunset 4 yes 12
r_experiment_sunset:paraphrase paraphrase seed:dotnet-canon:r_experiment_sunset 3 yes 12
r_experiment_sunset:bug-report bug-report seed:dotnet-canon:r_experiment_sunset 18 MISS 12
r_grep_to_zero:ticket ticket seed:dotnet-canon:r_grep_to_zero 7 yes 12
r_grep_to_zero:paraphrase paraphrase seed:dotnet-canon:r_grep_to_zero 7 yes 12
r_grep_to_zero:bug-report bug-report seed:dotnet-canon:r_grep_to_zero 5 yes 12
r_idp_policy_pinned:ticket ticket seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_idp_policy_pinned:paraphrase paraphrase seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_idp_policy_pinned:bug-report bug-report seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_middleware_order:ticket ticket seed:dotnet-canon:r_middleware_order 1 yes 12
r_middleware_order:paraphrase paraphrase seed:dotnet-canon:r_middleware_order 6 yes 12
r_middleware_order:bug-report bug-report seed:dotnet-canon:r_middleware_order 1 yes 12
r_migrations_immutable:ticket ticket seed:dotnet-canon:r_migrations_immutable 7 yes 9
r_migrations_immutable:paraphrase paraphrase seed:dotnet-canon:r_migrations_immutable 1 yes 12
r_migrations_immutable:bug-report bug-report seed:dotnet-canon:r_migrations_immutable 9 yes 12
r_pagination_cap:ticket ticket seed:dotnet-canon:r_pagination_cap 119 MISS 12
r_pagination_cap:paraphrase paraphrase seed:dotnet-canon:r_pagination_cap 42 MISS 12
r_pagination_cap:bug-report bug-report seed:dotnet-canon:r_pagination_cap 23 MISS 12
r_rate_limiter_scaleout:ticket ticket seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 12
r_rate_limiter_scaleout:paraphrase paraphrase seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 12
r_rate_limiter_scaleout:bug-report bug-report seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 12
r_request_naming:ticket ticket seed:dotnet-canon:r_request_naming 7 yes 12
r_request_naming:paraphrase paraphrase seed:dotnet-canon:r_request_naming 1 yes 12
r_request_naming:bug-report bug-report seed:dotnet-canon:r_request_naming 5 yes 12
r_rich_domain_when_observed:ticket ticket seed:dotnet-canon:r_rich_domain_when_observed 15 MISS 12
r_rich_domain_when_observed:paraphrase paraphrase seed:dotnet-canon:r_rich_domain_when_observed 7 yes 12
r_rich_domain_when_observed:bug-report bug-report seed:dotnet-canon:r_rich_domain_when_observed 1 yes 12
r_sargable:ticket ticket seed:dotnet-canon:r_sargable 3 yes 12
r_sargable:paraphrase paraphrase seed:dotnet-canon:r_sargable 8 MISS 12
r_sargable:bug-report bug-report seed:dotnet-canon:r_sargable 1 yes 12
r_surprise_in_writing:ticket ticket seed:dotnet-canon:r_surprise_in_writing 11 MISS 12
r_surprise_in_writing:paraphrase paraphrase seed:dotnet-canon:r_surprise_in_writing 3 yes 11
r_surprise_in_writing:bug-report bug-report seed:dotnet-canon:r_surprise_in_writing 1 yes 12
r_wolverine_lockstep:ticket ticket seed:dotnet-canon:r_wolverine_lockstep 8 yes 12
r_wolverine_lockstep:paraphrase paraphrase seed:dotnet-canon:r_wolverine_lockstep 2 yes 12
r_wolverine_lockstep:bug-report bug-report seed:dotnet-canon:r_wolverine_lockstep 7 yes 12
pd_authz_adapts_at_endpoint_boundary:ticket ticket seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 31 MISS 12
pd_authz_adapts_at_endpoint_boundary:paraphrase paraphrase seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 9 yes 12
pd_authz_adapts_at_endpoint_boundary:bug-report bug-report seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 19 MISS 12
pd_central_package_management:ticket ticket seed:dotnet-decisions:pd_central_package_management 11 MISS 12
pd_central_package_management:paraphrase paraphrase seed:dotnet-decisions:pd_central_package_management 1 yes 12
pd_central_package_management:bug-report bug-report seed:dotnet-decisions:pd_central_package_management 8 yes 12
pd_established_idp_never_handroll_auth:ticket ticket seed:dotnet-decisions:pd_established_idp_never_handroll_auth 22 MISS 10
pd_established_idp_never_handroll_auth:paraphrase paraphrase seed:dotnet-decisions:pd_established_idp_never_handroll_auth 7 MISS 12
pd_established_idp_never_handroll_auth:bug-report bug-report seed:dotnet-decisions:pd_established_idp_never_handroll_auth 10 yes 12
pd_license_driven_test_lib_forks:ticket ticket seed:dotnet-decisions:pd_license_driven_test_lib_forks 12 yes 12
pd_license_driven_test_lib_forks:paraphrase paraphrase seed:dotnet-decisions:pd_license_driven_test_lib_forks 12 yes 12
pd_license_driven_test_lib_forks:bug-report bug-report seed:dotnet-decisions:pd_license_driven_test_lib_forks 47 MISS 12
pd_nonhandler_outbox_idbcontextoutbox:ticket ticket seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 1 yes 12
pd_nonhandler_outbox_idbcontextoutbox:paraphrase paraphrase seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 29 MISS 12
pd_nonhandler_outbox_idbcontextoutbox:bug-report bug-report seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 1 yes 12
pd_openapi_dev_only:ticket ticket seed:dotnet-decisions:pd_openapi_dev_only 1 yes 12
pd_openapi_dev_only:paraphrase paraphrase seed:dotnet-decisions:pd_openapi_dev_only 1 MISS 7
pd_openapi_dev_only:bug-report bug-report seed:dotnet-decisions:pd_openapi_dev_only 2 yes 12
pd_rate_limit_expensive_endpoints:ticket ticket seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 8 yes 12
pd_rate_limit_expensive_endpoints:paraphrase paraphrase seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 41 MISS 6
pd_rate_limit_expensive_endpoints:bug-report bug-report seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 2 yes 12
pd_require_explicit_api_version:ticket ticket seed:dotnet-decisions:pd_require_explicit_api_version 1 yes 12
pd_require_explicit_api_version:paraphrase paraphrase seed:dotnet-decisions:pd_require_explicit_api_version 80 MISS 12
pd_require_explicit_api_version:bug-report bug-report seed:dotnet-decisions:pd_require_explicit_api_version 7 MISS 12
pd_standard_resilience_handler:ticket ticket seed:dotnet-decisions:pd_standard_resilience_handler 1 yes 10
pd_standard_resilience_handler:paraphrase paraphrase seed:dotnet-decisions:pd_standard_resilience_handler 9 yes 12
pd_standard_resilience_handler:bug-report bug-report seed:dotnet-decisions:pd_standard_resilience_handler 29 MISS 12
pd_three_validation_layers:ticket ticket seed:dotnet-decisions:pd_three_validation_layers 9 MISS 12
pd_three_validation_layers:paraphrase paraphrase seed:dotnet-decisions:pd_three_validation_layers 16 MISS 12
pd_three_validation_layers:bug-report bug-report seed:dotnet-decisions:pd_three_validation_layers 6 yes 12
pd_transport_decision_tree:ticket ticket seed:dotnet-decisions:pd_transport_decision_tree 6 yes 12
pd_transport_decision_tree:paraphrase paraphrase seed:dotnet-decisions:pd_transport_decision_tree 9 yes 11
pd_transport_decision_tree:bug-report bug-report seed:dotnet-decisions:pd_transport_decision_tree 5 yes 12
pd_url_segment_versioning:ticket ticket seed:dotnet-decisions:pd_url_segment_versioning 3 yes 12
pd_url_segment_versioning:paraphrase paraphrase seed:dotnet-decisions:pd_url_segment_versioning 57 MISS 12
pd_url_segment_versioning:bug-report bug-report seed:dotnet-decisions:pd_url_segment_versioning 4 yes 12
pd_wolverine_middleware_order:ticket ticket seed:dotnet-decisions:pd_wolverine_middleware_order 3 yes 12
pd_wolverine_middleware_order:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_middleware_order 42 MISS 12
pd_wolverine_middleware_order:bug-report bug-report seed:dotnet-decisions:pd_wolverine_middleware_order 1 yes 12
pd_wolverine_over_mediatr_masstransit:ticket ticket seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 4 yes 12
pd_wolverine_over_mediatr_masstransit:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 12
pd_wolverine_over_mediatr_masstransit:bug-report bug-report seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 4 yes 12
pd_zero_warning_build:ticket ticket seed:dotnet-decisions:pd_zero_warning_build 7 yes 12
pd_zero_warning_build:paraphrase paraphrase seed:dotnet-decisions:pd_zero_warning_build 2 yes 12
pd_zero_warning_build:bug-report bug-report seed:dotnet-decisions:pd_zero_warning_build 1 yes 12
g_tombstones_nc:ticket ticket seed:dotnet-defects:g_tombstones_nc 2 yes 12
g_tombstones_nc:paraphrase paraphrase seed:dotnet-defects:g_tombstones_nc 10 yes 12
g_tombstones_nc:bug-report bug-report seed:dotnet-defects:g_tombstones_nc 1 yes 12
nc_arch_reviewer:ticket ticket seed:dotnet-defects:nc_arch_reviewer 6 yes 12
nc_arch_reviewer:paraphrase paraphrase seed:dotnet-defects:nc_arch_reviewer 1 yes 12
nc_arch_reviewer:bug-report bug-report seed:dotnet-defects:nc_arch_reviewer 6 yes 12
nc_idor:ticket ticket seed:dotnet-defects:nc_idor 2 yes 12
nc_idor:paraphrase paraphrase seed:dotnet-defects:nc_idor 1 yes 12
nc_idor:bug-report bug-report seed:dotnet-defects:nc_idor 1 yes 12
nc_jwt_clockskew:ticket ticket seed:dotnet-defects:nc_jwt_clockskew 3 yes 12
nc_jwt_clockskew:paraphrase paraphrase seed:dotnet-defects:nc_jwt_clockskew 10 yes 12
nc_jwt_clockskew:bug-report bug-report seed:dotnet-defects:nc_jwt_clockskew 2 yes 12
nc_speculative_interface:ticket ticket seed:dotnet-defects:nc_speculative_interface 26 MISS 12
nc_speculative_interface:paraphrase paraphrase seed:dotnet-defects:nc_speculative_interface 1 yes 12
nc_speculative_interface:bug-report bug-report seed:dotnet-defects:nc_speculative_interface 1 yes 12
rs_event_carries_recipient_id:ticket ticket seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_event_carries_recipient_id:paraphrase paraphrase seed:dotnet-review-surfaces:rs_event_carries_recipient_id 5 yes 12
rs_event_carries_recipient_id:bug-report bug-report seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_integration_tests_default:ticket ticket seed:dotnet-review-surfaces:rs_integration_tests_default 2 yes 12
rs_integration_tests_default:paraphrase paraphrase seed:dotnet-review-surfaces:rs_integration_tests_default 9 yes 12
rs_integration_tests_default:bug-report bug-report seed:dotnet-review-surfaces:rs_integration_tests_default 83 MISS 12
rs_keyed_services_over_factories:ticket ticket seed:dotnet-review-surfaces:rs_keyed_services_over_factories 6 yes 12
rs_keyed_services_over_factories:paraphrase paraphrase seed:dotnet-review-surfaces:rs_keyed_services_over_factories 3 yes 12
rs_keyed_services_over_factories:bug-report bug-report seed:dotnet-review-surfaces:rs_keyed_services_over_factories 12 yes 12
rs_meter_wildcard_registration:ticket ticket seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 12
rs_meter_wildcard_registration:paraphrase paraphrase seed:dotnet-review-surfaces:rs_meter_wildcard_registration 10 yes 12
rs_meter_wildcard_registration:bug-report bug-report seed:dotnet-review-surfaces:rs_meter_wildcard_registration 2 yes 12
rs_sweeper_hygiene:ticket ticket seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_sweeper_hygiene:paraphrase paraphrase seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_sweeper_hygiene:bug-report bug-report seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_transport_removal_orphans:ticket ticket seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 12
rs_transport_removal_orphans:paraphrase paraphrase seed:dotnet-review-surfaces:rs_transport_removal_orphans 4 yes 12
rs_transport_removal_orphans:bug-report bug-report seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 12
rs_workflow_hardening_baseline:ticket ticket seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rs_workflow_hardening_baseline:paraphrase paraphrase seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rs_workflow_hardening_baseline:bug-report bug-report seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rxc_mutation_invalidate:ticket ticket seed:frontend-canon:rxc_mutation_invalidate 9 yes 12
rxc_mutation_invalidate:paraphrase paraphrase seed:frontend-canon:rxc_mutation_invalidate 26 MISS 12
rxc_mutation_invalidate:bug-report bug-report seed:frontend-canon:rxc_mutation_invalidate 11 yes 12
rxc_query_keys:ticket ticket seed:frontend-canon:rxc_query_keys 1 yes 12
rxc_query_keys:paraphrase paraphrase seed:frontend-canon:rxc_query_keys 2 MISS 12
rxc_query_keys:bug-report bug-report seed:frontend-canon:rxc_query_keys 24 MISS 12
rxc_shared_promotion:ticket ticket seed:frontend-canon:rxc_shared_promotion 2 yes 12
rxc_shared_promotion:paraphrase paraphrase seed:frontend-canon:rxc_shared_promotion 3 MISS 7
rxc_shared_promotion:bug-report bug-report seed:frontend-canon:rxc_shared_promotion 2 yes 12
r_resubstitution_not_validation:ticket ticket seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 12
r_resubstitution_not_validation:paraphrase paraphrase seed:geospatial-deeptime-defects:r_resubstitution_not_validation 44 MISS 12
r_resubstitution_not_validation:bug-report bug-report seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 12
d15:ticket ticket seed:geospatial-defects:d15 1 yes 12
d15:paraphrase paraphrase seed:geospatial-defects:d15 1 yes 12
d15:bug-report bug-report seed:geospatial-defects:d15 1 yes 12
g_verify_outputs:ticket ticket seed:geospatial-defects:g_verify_outputs 5 yes 12
g_verify_outputs:paraphrase paraphrase seed:geospatial-defects:g_verify_outputs 18 MISS 11
g_verify_outputs:bug-report bug-report seed:geospatial-defects:g_verify_outputs 46 MISS 12
d_invoked_by_nothing:ticket ticket seed:geospatial-enforcement-defects:d_invoked_by_nothing 9 yes 12
d_invoked_by_nothing:paraphrase paraphrase seed:geospatial-enforcement-defects:d_invoked_by_nothing 1 yes 12
d_invoked_by_nothing:bug-report bug-report seed:geospatial-enforcement-defects:d_invoked_by_nothing 1 yes 12
d_month_range_28:ticket ticket seed:geospatial-enforcement-defects:d_month_range_28 1 yes 12
d_month_range_28:paraphrase paraphrase seed:geospatial-enforcement-defects:d_month_range_28 4 yes 12
d_month_range_28:bug-report bug-report seed:geospatial-enforcement-defects:d_month_range_28 1 yes 11
g_gate_every_dir:ticket ticket seed:geospatial-enforcement-defects:g_gate_every_dir 5 yes 12
g_gate_every_dir:paraphrase paraphrase seed:geospatial-enforcement-defects:g_gate_every_dir 7 yes 12
g_gate_every_dir:bug-report bug-report seed:geospatial-enforcement-defects:g_gate_every_dir 1 yes 12
g_review_agent_in_ci:ticket ticket seed:geospatial-enforcement-defects:g_review_agent_in_ci 2 yes 12
g_review_agent_in_ci:paraphrase paraphrase seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
g_review_agent_in_ci:bug-report bug-report seed:geospatial-enforcement-defects:g_review_agent_in_ci 4 yes 12
r_pin_gating_tools:ticket ticket seed:geospatial-enforcement-defects:r_pin_gating_tools 4 yes 12
r_pin_gating_tools:paraphrase paraphrase seed:geospatial-enforcement-defects:r_pin_gating_tools 6 yes 12
r_pin_gating_tools:bug-report bug-report seed:geospatial-enforcement-defects:r_pin_gating_tools 20 MISS 12
r_preregistered_control_vetoes:ticket ticket seed:geospatial-eval-defects:r_preregistered_control_vetoes 8 yes 12
r_preregistered_control_vetoes:paraphrase paraphrase seed:geospatial-eval-defects:r_preregistered_control_vetoes 4 yes 12
r_preregistered_control_vetoes:bug-report bug-report seed:geospatial-eval-defects:r_preregistered_control_vetoes 4 yes 12
py_classes_earn_place:ticket ticket seed:python-canon:py_classes_earn_place 23 MISS 12
py_classes_earn_place:paraphrase paraphrase seed:python-canon:py_classes_earn_place 1 yes 12
py_classes_earn_place:bug-report bug-report seed:python-canon:py_classes_earn_place 4 yes 12
py_comments_why:ticket ticket seed:python-canon:py_comments_why 16 MISS 12
py_comments_why:paraphrase paraphrase seed:python-canon:py_comments_why 2 yes 12
py_comments_why:bug-report bug-report seed:python-canon:py_comments_why 10 yes 12
py_contract_tests:ticket ticket seed:python-canon:py_contract_tests 1 yes 12
py_contract_tests:paraphrase paraphrase seed:python-canon:py_contract_tests 4 yes 12
py_contract_tests:bug-report bug-report seed:python-canon:py_contract_tests 1 yes 12
py_docstrings:ticket ticket seed:python-canon:py_docstrings 1 yes 12
py_docstrings:paraphrase paraphrase seed:python-canon:py_docstrings 11 MISS 12
py_docstrings:bug-report bug-report seed:python-canon:py_docstrings 1 yes 12
py_exceptions_canon:ticket ticket seed:python-canon:py_exceptions_canon 10 yes 12
py_exceptions_canon:paraphrase paraphrase seed:python-canon:py_exceptions_canon 49 MISS 12
py_exceptions_canon:bug-report bug-report seed:python-canon:py_exceptions_canon 3 yes 12
py_no_power_features:ticket ticket seed:python-canon:py_no_power_features 61 MISS 12
py_no_power_features:paraphrase paraphrase seed:python-canon:py_no_power_features 25 MISS 12
py_no_power_features:bug-report bug-report seed:python-canon:py_no_power_features 4 yes 12
py_one_docstring_format:ticket ticket seed:python-canon:py_one_docstring_format 2 yes 12
py_one_docstring_format:paraphrase paraphrase seed:python-canon:py_one_docstring_format 1 yes 12
py_one_docstring_format:bug-report bug-report seed:python-canon:py_one_docstring_format 2 yes 12
py_print_at_edges:ticket ticket seed:python-canon:py_print_at_edges 12 yes 12
py_print_at_edges:paraphrase paraphrase seed:python-canon:py_print_at_edges 6 yes 12
py_print_at_edges:bug-report bug-report seed:python-canon:py_print_at_edges 21 MISS 12
py_protocol_isinstance_names_only:ticket ticket seed:python-canon:py_protocol_isinstance_names_only 6 yes 12
py_protocol_isinstance_names_only:paraphrase paraphrase seed:python-canon:py_protocol_isinstance_names_only 10 yes 12
py_protocol_isinstance_names_only:bug-report bug-report seed:python-canon:py_protocol_isinstance_names_only 4 yes 12
py_starlette_httpx2:ticket ticket seed:python-canon:py_starlette_httpx2 17 MISS 12
py_starlette_httpx2:paraphrase paraphrase seed:python-canon:py_starlette_httpx2 1 yes 12
py_starlette_httpx2:bug-report bug-report seed:python-canon:py_starlette_httpx2 1 yes 12
py_strict_pytest:ticket ticket seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:paraphrase paraphrase seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:bug-report bug-report seed:python-canon:py_strict_pytest 1 yes 12
py_type_hints_gradual:ticket ticket seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:paraphrase paraphrase seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:bug-report bug-report seed:python-canon:py_type_hints_gradual 1 yes 12
py_typing_syntax_floor:ticket ticket seed:python-canon:py_typing_syntax_floor 1 yes 12
py_typing_syntax_floor:paraphrase paraphrase seed:python-canon:py_typing_syntax_floor 4 yes 12
py_typing_syntax_floor:bug-report bug-report seed:python-canon:py_typing_syntax_floor 1 yes 12
qz_agent_contract:ticket ticket seed:rag-defects:qz_agent_contract 1 yes 12
qz_agent_contract:paraphrase paraphrase seed:rag-defects:qz_agent_contract 149 MISS 12
qz_agent_contract:bug-report bug-report seed:rag-defects:qz_agent_contract 1 yes 12
qz_fixtures:ticket ticket seed:rag-defects:qz_fixtures 1 yes 12
qz_fixtures:paraphrase paraphrase seed:rag-defects:qz_fixtures 41 MISS 8
qz_fixtures:bug-report bug-report seed:rag-defects:qz_fixtures 1 yes 12
qz_identity:ticket ticket seed:rag-defects:qz_identity 1 yes 12
qz_identity:paraphrase paraphrase seed:rag-defects:qz_identity 2 yes 12
qz_identity:bug-report bug-report seed:rag-defects:qz_identity 2 yes 12
qz_wrong_corpus:ticket ticket seed:rag-defects:qz_wrong_corpus 2 yes 12
qz_wrong_corpus:paraphrase paraphrase seed:rag-defects:qz_wrong_corpus 9 yes 12
qz_wrong_corpus:bug-report bug-report seed:rag-defects:qz_wrong_corpus 1 yes 12
rx_fight_compiler:ticket ticket seed:react-defects:rx_fight_compiler 1 yes 12
rx_fight_compiler:paraphrase paraphrase seed:react-defects:rx_fight_compiler 32 MISS 12
rx_fight_compiler:bug-report bug-report seed:react-defects:rx_fight_compiler 2 yes 12
rx_tokens_localstorage:ticket ticket seed:react-defects:rx_tokens_localstorage 11 yes 12
rx_tokens_localstorage:paraphrase paraphrase seed:react-defects:rx_tokens_localstorage 1 yes 12
rx_tokens_localstorage:bug-report bug-report seed:react-defects:rx_tokens_localstorage 11 yes 12
