bench · label v1-linear · split selection · code 29933681bc47
corpus: 183 records from 12 seed packs (sha 271b057d54d6) · queries queries.jsonl sha 97ecbcb5d681 · nulls 550 (sha 6e100bad522c)
arm: decision floor · hybrid linear · rerank off · limit 12 · common-word share 0.05 · interests none · triggers on 0 lessons

register       n         recall (briefed)  hit@1  hit@3  hit@12    MRR briefed/q
bug-report    83    88.0% [80.7%, 94.0%]  45.8%  69.9%   88.0%  0.609      12.0
paraphrase    83    66.3% [56.6%, 75.9%]  27.7%  47.0%   73.5%  0.412      11.7
ticket        83    80.7% [72.3%, 89.2%]  34.9%  61.4%   80.7%  0.508      11.9
all          249    78.3% [72.7%, 83.5%]  36.1%  59.4%   80.7%  0.509      11.9

null prompts briefed nothing: 237 of 550 (43.1%, 95% [39.0%, 47.3%]) · the rest got 5.9 lessons on average
  calibration half (sets the calibrated line): briefed anything 163 of 282 (57.8%, 95% [52.0%, 63.4%])
  unseen half (sets the calibrated line: never seen by it): briefed anything 150 of 268 (56.0%, 95% [50.0%, 61.8%])
latency per check: median 40 ms · p95 133 ms · 799 checks

per query: id register lesson rank briefed count
dec_sixth_surface:ticket ticket seed:dotnet-canon:dec_sixth_surface 1 yes 12
dec_sixth_surface:paraphrase paraphrase seed:dotnet-canon:dec_sixth_surface 10 MISS 12
dec_sixth_surface:bug-report bug-report seed:dotnet-canon:dec_sixth_surface 6 yes 12
r_202_long_running:ticket ticket seed:dotnet-canon:r_202_long_running 30 MISS 10
r_202_long_running:paraphrase paraphrase seed:dotnet-canon:r_202_long_running 2 yes 12
r_202_long_running:bug-report bug-report seed:dotnet-canon:r_202_long_running 17 MISS 12
r_aaa_narrative:ticket ticket seed:dotnet-canon:r_aaa_narrative 45 MISS 12
r_aaa_narrative:paraphrase paraphrase seed:dotnet-canon:r_aaa_narrative 4 MISS 12
r_aaa_narrative:bug-report bug-report seed:dotnet-canon:r_aaa_narrative 1 yes 12
r_arch_enforcement_ladder:ticket ticket seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 12
r_arch_enforcement_ladder:paraphrase paraphrase seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 12
r_arch_enforcement_ladder:bug-report bug-report seed:dotnet-canon:r_arch_enforcement_ladder 2 yes 12
r_aspire_azure_fallback:ticket ticket seed:dotnet-canon:r_aspire_azure_fallback 2 yes 12
r_aspire_azure_fallback:paraphrase paraphrase seed:dotnet-canon:r_aspire_azure_fallback 55 MISS 12
r_aspire_azure_fallback:bug-report bug-report seed:dotnet-canon:r_aspire_azure_fallback 5 yes 12
r_aspire_versions:ticket ticket seed:dotnet-canon:r_aspire_versions 1 yes 12
r_aspire_versions:paraphrase paraphrase seed:dotnet-canon:r_aspire_versions 2 yes 12
r_aspire_versions:bug-report bug-report seed:dotnet-canon:r_aspire_versions 1 yes 12
r_aspire_waitfor:ticket ticket seed:dotnet-canon:r_aspire_waitfor 2 yes 12
r_aspire_waitfor:paraphrase paraphrase seed:dotnet-canon:r_aspire_waitfor 20 MISS 12
r_aspire_waitfor:bug-report bug-report seed:dotnet-canon:r_aspire_waitfor 4 yes 12
r_bulk_ops:ticket ticket seed:dotnet-canon:r_bulk_ops 43 MISS 12
r_bulk_ops:paraphrase paraphrase seed:dotnet-canon:r_bulk_ops 29 MISS 12
r_bulk_ops:bug-report bug-report seed:dotnet-canon:r_bulk_ops 23 MISS 12
r_comments_durable_docs:ticket ticket seed:dotnet-canon:r_comments_durable_docs 3 yes 12
r_comments_durable_docs:paraphrase paraphrase seed:dotnet-canon:r_comments_durable_docs 1 MISS 12
r_comments_durable_docs:bug-report bug-report seed:dotnet-canon:r_comments_durable_docs 1 yes 12
r_docs_review_surface:ticket ticket seed:dotnet-canon:r_docs_review_surface 22 MISS 12
r_docs_review_surface:paraphrase paraphrase seed:dotnet-canon:r_docs_review_surface 157 MISS 12
r_docs_review_surface:bug-report bug-report seed:dotnet-canon:r_docs_review_surface 1 yes 12
r_durability_not_replay:ticket ticket seed:dotnet-canon:r_durability_not_replay 3 yes 12
r_durability_not_replay:paraphrase paraphrase seed:dotnet-canon:r_durability_not_replay 1 yes 12
r_durability_not_replay:bug-report bug-report seed:dotnet-canon:r_durability_not_replay 1 yes 12
r_encoding_loop:ticket ticket seed:dotnet-canon:r_encoding_loop 1 yes 12
r_encoding_loop:paraphrase paraphrase seed:dotnet-canon:r_encoding_loop 5 yes 12
r_encoding_loop:bug-report bug-report seed:dotnet-canon:r_encoding_loop 1 yes 12
r_exceptions_canon:ticket ticket seed:dotnet-canon:r_exceptions_canon 26 MISS 12
r_exceptions_canon:paraphrase paraphrase seed:dotnet-canon:r_exceptions_canon 4 yes 12
r_exceptions_canon:bug-report bug-report seed:dotnet-canon:r_exceptions_canon 6 yes 12
r_experiment_sunset:ticket ticket seed:dotnet-canon:r_experiment_sunset 15 yes 12
r_experiment_sunset:paraphrase paraphrase seed:dotnet-canon:r_experiment_sunset 2 yes 12
r_experiment_sunset:bug-report bug-report seed:dotnet-canon:r_experiment_sunset 9 MISS 12
r_grep_to_zero:ticket ticket seed:dotnet-canon:r_grep_to_zero 11 yes 12
r_grep_to_zero:paraphrase paraphrase seed:dotnet-canon:r_grep_to_zero 5 yes 12
r_grep_to_zero:bug-report bug-report seed:dotnet-canon:r_grep_to_zero 2 yes 12
r_idp_policy_pinned:ticket ticket seed:dotnet-canon:r_idp_policy_pinned 6 yes 12
r_idp_policy_pinned:paraphrase paraphrase seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_idp_policy_pinned:bug-report bug-report seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_middleware_order:ticket ticket seed:dotnet-canon:r_middleware_order 2 yes 12
r_middleware_order:paraphrase paraphrase seed:dotnet-canon:r_middleware_order 6 yes 12
r_middleware_order:bug-report bug-report seed:dotnet-canon:r_middleware_order 1 yes 12
r_migrations_immutable:ticket ticket seed:dotnet-canon:r_migrations_immutable 1 yes 9
r_migrations_immutable:paraphrase paraphrase seed:dotnet-canon:r_migrations_immutable 1 yes 12
r_migrations_immutable:bug-report bug-report seed:dotnet-canon:r_migrations_immutable 4 yes 12
r_pagination_cap:ticket ticket seed:dotnet-canon:r_pagination_cap 119 MISS 12
r_pagination_cap:paraphrase paraphrase seed:dotnet-canon:r_pagination_cap 27 MISS 12
r_pagination_cap:bug-report bug-report seed:dotnet-canon:r_pagination_cap 6 yes 12
r_rate_limiter_scaleout:ticket ticket seed:dotnet-canon:r_rate_limiter_scaleout 4 yes 12
r_rate_limiter_scaleout:paraphrase paraphrase seed:dotnet-canon:r_rate_limiter_scaleout 4 yes 12
r_rate_limiter_scaleout:bug-report bug-report seed:dotnet-canon:r_rate_limiter_scaleout 2 yes 12
r_request_naming:ticket ticket seed:dotnet-canon:r_request_naming 1 yes 12
r_request_naming:paraphrase paraphrase seed:dotnet-canon:r_request_naming 1 yes 12
r_request_naming:bug-report bug-report seed:dotnet-canon:r_request_naming 1 yes 12
r_rich_domain_when_observed:ticket ticket seed:dotnet-canon:r_rich_domain_when_observed 3 yes 12
r_rich_domain_when_observed:paraphrase paraphrase seed:dotnet-canon:r_rich_domain_when_observed 1 yes 12
r_rich_domain_when_observed:bug-report bug-report seed:dotnet-canon:r_rich_domain_when_observed 2 yes 12
r_sargable:ticket ticket seed:dotnet-canon:r_sargable 1 yes 12
r_sargable:paraphrase paraphrase seed:dotnet-canon:r_sargable 12 MISS 12
r_sargable:bug-report bug-report seed:dotnet-canon:r_sargable 1 yes 12
r_surprise_in_writing:ticket ticket seed:dotnet-canon:r_surprise_in_writing 14 MISS 12
r_surprise_in_writing:paraphrase paraphrase seed:dotnet-canon:r_surprise_in_writing 1 yes 11
r_surprise_in_writing:bug-report bug-report seed:dotnet-canon:r_surprise_in_writing 1 yes 12
r_wolverine_lockstep:ticket ticket seed:dotnet-canon:r_wolverine_lockstep 19 MISS 12
r_wolverine_lockstep:paraphrase paraphrase seed:dotnet-canon:r_wolverine_lockstep 1 yes 12
r_wolverine_lockstep:bug-report bug-report seed:dotnet-canon:r_wolverine_lockstep 2 yes 12
pd_authz_adapts_at_endpoint_boundary:ticket ticket seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 41 MISS 12
pd_authz_adapts_at_endpoint_boundary:paraphrase paraphrase seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 4 yes 12
pd_authz_adapts_at_endpoint_boundary:bug-report bug-report seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 14 MISS 12
pd_central_package_management:ticket ticket seed:dotnet-decisions:pd_central_package_management 18 MISS 12
pd_central_package_management:paraphrase paraphrase seed:dotnet-decisions:pd_central_package_management 1 yes 12
pd_central_package_management:bug-report bug-report seed:dotnet-decisions:pd_central_package_management 1 yes 12
pd_established_idp_never_handroll_auth:ticket ticket seed:dotnet-decisions:pd_established_idp_never_handroll_auth 19 MISS 10
pd_established_idp_never_handroll_auth:paraphrase paraphrase seed:dotnet-decisions:pd_established_idp_never_handroll_auth 40 MISS 12
pd_established_idp_never_handroll_auth:bug-report bug-report seed:dotnet-decisions:pd_established_idp_never_handroll_auth 2 yes 12
pd_license_driven_test_lib_forks:ticket ticket seed:dotnet-decisions:pd_license_driven_test_lib_forks 8 yes 12
pd_license_driven_test_lib_forks:paraphrase paraphrase seed:dotnet-decisions:pd_license_driven_test_lib_forks 5 yes 12
pd_license_driven_test_lib_forks:bug-report bug-report seed:dotnet-decisions:pd_license_driven_test_lib_forks 27 MISS 12
pd_nonhandler_outbox_idbcontextoutbox:ticket ticket seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 3 yes 12
pd_nonhandler_outbox_idbcontextoutbox:paraphrase paraphrase seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 21 MISS 12
pd_nonhandler_outbox_idbcontextoutbox:bug-report bug-report seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 2 yes 12
pd_openapi_dev_only:ticket ticket seed:dotnet-decisions:pd_openapi_dev_only 1 yes 12
pd_openapi_dev_only:paraphrase paraphrase seed:dotnet-decisions:pd_openapi_dev_only 3 MISS 7
pd_openapi_dev_only:bug-report bug-report seed:dotnet-decisions:pd_openapi_dev_only 1 yes 12
pd_rate_limit_expensive_endpoints:ticket ticket seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 2 yes 12
pd_rate_limit_expensive_endpoints:paraphrase paraphrase seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 39 MISS 6
pd_rate_limit_expensive_endpoints:bug-report bug-report seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 1 yes 12
pd_require_explicit_api_version:ticket ticket seed:dotnet-decisions:pd_require_explicit_api_version 2 yes 12
pd_require_explicit_api_version:paraphrase paraphrase seed:dotnet-decisions:pd_require_explicit_api_version 80 MISS 12
pd_require_explicit_api_version:bug-report bug-report seed:dotnet-decisions:pd_require_explicit_api_version 5 MISS 12
pd_standard_resilience_handler:ticket ticket seed:dotnet-decisions:pd_standard_resilience_handler 1 yes 10
pd_standard_resilience_handler:paraphrase paraphrase seed:dotnet-decisions:pd_standard_resilience_handler 2 yes 12
pd_standard_resilience_handler:bug-report bug-report seed:dotnet-decisions:pd_standard_resilience_handler 46 MISS 12
pd_three_validation_layers:ticket ticket seed:dotnet-decisions:pd_three_validation_layers 5 MISS 12
pd_three_validation_layers:paraphrase paraphrase seed:dotnet-decisions:pd_three_validation_layers 5 yes 12
pd_three_validation_layers:bug-report bug-report seed:dotnet-decisions:pd_three_validation_layers 2 yes 12
pd_transport_decision_tree:ticket ticket seed:dotnet-decisions:pd_transport_decision_tree 1 yes 12
pd_transport_decision_tree:paraphrase paraphrase seed:dotnet-decisions:pd_transport_decision_tree 1 yes 11
pd_transport_decision_tree:bug-report bug-report seed:dotnet-decisions:pd_transport_decision_tree 1 yes 12
pd_url_segment_versioning:ticket ticket seed:dotnet-decisions:pd_url_segment_versioning 2 yes 12
pd_url_segment_versioning:paraphrase paraphrase seed:dotnet-decisions:pd_url_segment_versioning 56 MISS 12
pd_url_segment_versioning:bug-report bug-report seed:dotnet-decisions:pd_url_segment_versioning 1 yes 12
pd_wolverine_middleware_order:ticket ticket seed:dotnet-decisions:pd_wolverine_middleware_order 2 yes 12
pd_wolverine_middleware_order:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_middleware_order 62 MISS 12
pd_wolverine_middleware_order:bug-report bug-report seed:dotnet-decisions:pd_wolverine_middleware_order 2 yes 12
pd_wolverine_over_mediatr_masstransit:ticket ticket seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 12
pd_wolverine_over_mediatr_masstransit:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 3 yes 12
pd_wolverine_over_mediatr_masstransit:bug-report bug-report seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 12
pd_zero_warning_build:ticket ticket seed:dotnet-decisions:pd_zero_warning_build 20 MISS 12
pd_zero_warning_build:paraphrase paraphrase seed:dotnet-decisions:pd_zero_warning_build 1 yes 12
pd_zero_warning_build:bug-report bug-report seed:dotnet-decisions:pd_zero_warning_build 1 yes 12
g_tombstones_nc:ticket ticket seed:dotnet-defects:g_tombstones_nc 1 yes 12
g_tombstones_nc:paraphrase paraphrase seed:dotnet-defects:g_tombstones_nc 4 yes 12
g_tombstones_nc:bug-report bug-report seed:dotnet-defects:g_tombstones_nc 4 yes 12
nc_arch_reviewer:ticket ticket seed:dotnet-defects:nc_arch_reviewer 12 yes 12
nc_arch_reviewer:paraphrase paraphrase seed:dotnet-defects:nc_arch_reviewer 3 yes 12
nc_arch_reviewer:bug-report bug-report seed:dotnet-defects:nc_arch_reviewer 1 yes 12
nc_idor:ticket ticket seed:dotnet-defects:nc_idor 2 yes 12
nc_idor:paraphrase paraphrase seed:dotnet-defects:nc_idor 1 yes 12
nc_idor:bug-report bug-report seed:dotnet-defects:nc_idor 1 yes 12
nc_jwt_clockskew:ticket ticket seed:dotnet-defects:nc_jwt_clockskew 5 yes 12
nc_jwt_clockskew:paraphrase paraphrase seed:dotnet-defects:nc_jwt_clockskew 19 yes 12
nc_jwt_clockskew:bug-report bug-report seed:dotnet-defects:nc_jwt_clockskew 3 yes 12
nc_speculative_interface:ticket ticket seed:dotnet-defects:nc_speculative_interface 21 MISS 12
nc_speculative_interface:paraphrase paraphrase seed:dotnet-defects:nc_speculative_interface 1 yes 12
nc_speculative_interface:bug-report bug-report seed:dotnet-defects:nc_speculative_interface 1 yes 12
rs_event_carries_recipient_id:ticket ticket seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_event_carries_recipient_id:paraphrase paraphrase seed:dotnet-review-surfaces:rs_event_carries_recipient_id 6 yes 12
rs_event_carries_recipient_id:bug-report bug-report seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_integration_tests_default:ticket ticket seed:dotnet-review-surfaces:rs_integration_tests_default 4 yes 12
rs_integration_tests_default:paraphrase paraphrase seed:dotnet-review-surfaces:rs_integration_tests_default 17 MISS 12
rs_integration_tests_default:bug-report bug-report seed:dotnet-review-surfaces:rs_integration_tests_default 83 MISS 12
rs_keyed_services_over_factories:ticket ticket seed:dotnet-review-surfaces:rs_keyed_services_over_factories 4 yes 12
rs_keyed_services_over_factories:paraphrase paraphrase seed:dotnet-review-surfaces:rs_keyed_services_over_factories 3 yes 12
rs_keyed_services_over_factories:bug-report bug-report seed:dotnet-review-surfaces:rs_keyed_services_over_factories 18 yes 12
rs_meter_wildcard_registration:ticket ticket seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 12
rs_meter_wildcard_registration:paraphrase paraphrase seed:dotnet-review-surfaces:rs_meter_wildcard_registration 2 yes 12
rs_meter_wildcard_registration:bug-report bug-report seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 12
rs_sweeper_hygiene:ticket ticket seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_sweeper_hygiene:paraphrase paraphrase seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_sweeper_hygiene:bug-report bug-report seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_transport_removal_orphans:ticket ticket seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 12
rs_transport_removal_orphans:paraphrase paraphrase seed:dotnet-review-surfaces:rs_transport_removal_orphans 3 yes 12
rs_transport_removal_orphans:bug-report bug-report seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 12
rs_workflow_hardening_baseline:ticket ticket seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rs_workflow_hardening_baseline:paraphrase paraphrase seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 3 yes 12
rs_workflow_hardening_baseline:bug-report bug-report seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 2 yes 12
rxc_mutation_invalidate:ticket ticket seed:frontend-canon:rxc_mutation_invalidate 12 yes 12
rxc_mutation_invalidate:paraphrase paraphrase seed:frontend-canon:rxc_mutation_invalidate 43 MISS 12
rxc_mutation_invalidate:bug-report bug-report seed:frontend-canon:rxc_mutation_invalidate 3 yes 12
rxc_query_keys:ticket ticket seed:frontend-canon:rxc_query_keys 4 yes 12
rxc_query_keys:paraphrase paraphrase seed:frontend-canon:rxc_query_keys 9 MISS 12
rxc_query_keys:bug-report bug-report seed:frontend-canon:rxc_query_keys 18 MISS 12
rxc_shared_promotion:ticket ticket seed:frontend-canon:rxc_shared_promotion 1 yes 12
rxc_shared_promotion:paraphrase paraphrase seed:frontend-canon:rxc_shared_promotion 10 MISS 7
rxc_shared_promotion:bug-report bug-report seed:frontend-canon:rxc_shared_promotion 2 yes 12
r_resubstitution_not_validation:ticket ticket seed:geospatial-deeptime-defects:r_resubstitution_not_validation 2 yes 12
r_resubstitution_not_validation:paraphrase paraphrase seed:geospatial-deeptime-defects:r_resubstitution_not_validation 34 MISS 12
r_resubstitution_not_validation:bug-report bug-report seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 12
d15:ticket ticket seed:geospatial-defects:d15 1 yes 12
d15:paraphrase paraphrase seed:geospatial-defects:d15 2 yes 12
d15:bug-report bug-report seed:geospatial-defects:d15 1 yes 12
g_verify_outputs:ticket ticket seed:geospatial-defects:g_verify_outputs 3 yes 12
g_verify_outputs:paraphrase paraphrase seed:geospatial-defects:g_verify_outputs 32 MISS 11
g_verify_outputs:bug-report bug-report seed:geospatial-defects:g_verify_outputs 64 MISS 12
d_invoked_by_nothing:ticket ticket seed:geospatial-enforcement-defects:d_invoked_by_nothing 4 yes 12
d_invoked_by_nothing:paraphrase paraphrase seed:geospatial-enforcement-defects:d_invoked_by_nothing 2 yes 12
d_invoked_by_nothing:bug-report bug-report seed:geospatial-enforcement-defects:d_invoked_by_nothing 2 yes 12
d_month_range_28:ticket ticket seed:geospatial-enforcement-defects:d_month_range_28 1 yes 12
d_month_range_28:paraphrase paraphrase seed:geospatial-enforcement-defects:d_month_range_28 1 yes 12
d_month_range_28:bug-report bug-report seed:geospatial-enforcement-defects:d_month_range_28 1 yes 11
g_gate_every_dir:ticket ticket seed:geospatial-enforcement-defects:g_gate_every_dir 2 yes 12
g_gate_every_dir:paraphrase paraphrase seed:geospatial-enforcement-defects:g_gate_every_dir 9 yes 12
g_gate_every_dir:bug-report bug-report seed:geospatial-enforcement-defects:g_gate_every_dir 7 yes 12
g_review_agent_in_ci:ticket ticket seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
g_review_agent_in_ci:paraphrase paraphrase seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
g_review_agent_in_ci:bug-report bug-report seed:geospatial-enforcement-defects:g_review_agent_in_ci 4 yes 12
r_pin_gating_tools:ticket ticket seed:geospatial-enforcement-defects:r_pin_gating_tools 2 yes 12
r_pin_gating_tools:paraphrase paraphrase seed:geospatial-enforcement-defects:r_pin_gating_tools 4 yes 12
r_pin_gating_tools:bug-report bug-report seed:geospatial-enforcement-defects:r_pin_gating_tools 3 yes 12
r_preregistered_control_vetoes:ticket ticket seed:geospatial-eval-defects:r_preregistered_control_vetoes 3 yes 12
r_preregistered_control_vetoes:paraphrase paraphrase seed:geospatial-eval-defects:r_preregistered_control_vetoes 12 yes 12
r_preregistered_control_vetoes:bug-report bug-report seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 12
py_classes_earn_place:ticket ticket seed:python-canon:py_classes_earn_place 51 MISS 12
py_classes_earn_place:paraphrase paraphrase seed:python-canon:py_classes_earn_place 2 yes 12
py_classes_earn_place:bug-report bug-report seed:python-canon:py_classes_earn_place 2 yes 12
py_comments_why:ticket ticket seed:python-canon:py_comments_why 10 yes 12
py_comments_why:paraphrase paraphrase seed:python-canon:py_comments_why 7 yes 12
py_comments_why:bug-report bug-report seed:python-canon:py_comments_why 3 yes 12
py_contract_tests:ticket ticket seed:python-canon:py_contract_tests 2 yes 12
py_contract_tests:paraphrase paraphrase seed:python-canon:py_contract_tests 2 yes 12
py_contract_tests:bug-report bug-report seed:python-canon:py_contract_tests 1 yes 12
py_docstrings:ticket ticket seed:python-canon:py_docstrings 2 yes 12
py_docstrings:paraphrase paraphrase seed:python-canon:py_docstrings 23 MISS 12
py_docstrings:bug-report bug-report seed:python-canon:py_docstrings 2 yes 12
py_exceptions_canon:ticket ticket seed:python-canon:py_exceptions_canon 6 yes 12
py_exceptions_canon:paraphrase paraphrase seed:python-canon:py_exceptions_canon 47 MISS 12
py_exceptions_canon:bug-report bug-report seed:python-canon:py_exceptions_canon 4 yes 12
py_no_power_features:ticket ticket seed:python-canon:py_no_power_features 49 MISS 12
py_no_power_features:paraphrase paraphrase seed:python-canon:py_no_power_features 45 MISS 12
py_no_power_features:bug-report bug-report seed:python-canon:py_no_power_features 1 yes 12
py_one_docstring_format:ticket ticket seed:python-canon:py_one_docstring_format 1 yes 12
py_one_docstring_format:paraphrase paraphrase seed:python-canon:py_one_docstring_format 1 yes 12
py_one_docstring_format:bug-report bug-report seed:python-canon:py_one_docstring_format 1 yes 12
py_print_at_edges:ticket ticket seed:python-canon:py_print_at_edges 2 yes 12
py_print_at_edges:paraphrase paraphrase seed:python-canon:py_print_at_edges 1 yes 12
py_print_at_edges:bug-report bug-report seed:python-canon:py_print_at_edges 8 yes 12
py_protocol_isinstance_names_only:ticket ticket seed:python-canon:py_protocol_isinstance_names_only 4 yes 12
py_protocol_isinstance_names_only:paraphrase paraphrase seed:python-canon:py_protocol_isinstance_names_only 8 yes 12
py_protocol_isinstance_names_only:bug-report bug-report seed:python-canon:py_protocol_isinstance_names_only 2 yes 12
py_starlette_httpx2:ticket ticket seed:python-canon:py_starlette_httpx2 6 yes 12
py_starlette_httpx2:paraphrase paraphrase seed:python-canon:py_starlette_httpx2 11 yes 12
py_starlette_httpx2:bug-report bug-report seed:python-canon:py_starlette_httpx2 1 yes 12
py_strict_pytest:ticket ticket seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:paraphrase paraphrase seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:bug-report bug-report seed:python-canon:py_strict_pytest 1 yes 12
py_type_hints_gradual:ticket ticket seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:paraphrase paraphrase seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:bug-report bug-report seed:python-canon:py_type_hints_gradual 1 yes 12
py_typing_syntax_floor:ticket ticket seed:python-canon:py_typing_syntax_floor 1 yes 12
py_typing_syntax_floor:paraphrase paraphrase seed:python-canon:py_typing_syntax_floor 1 yes 12
py_typing_syntax_floor:bug-report bug-report seed:python-canon:py_typing_syntax_floor 5 yes 12
qz_agent_contract:ticket ticket seed:rag-defects:qz_agent_contract 1 yes 12
qz_agent_contract:paraphrase paraphrase seed:rag-defects:qz_agent_contract 149 MISS 12
qz_agent_contract:bug-report bug-report seed:rag-defects:qz_agent_contract 23 yes 12
qz_fixtures:ticket ticket seed:rag-defects:qz_fixtures 1 yes 12
qz_fixtures:paraphrase paraphrase seed:rag-defects:qz_fixtures 26 MISS 8
qz_fixtures:bug-report bug-report seed:rag-defects:qz_fixtures 1 yes 12
qz_identity:ticket ticket seed:rag-defects:qz_identity 1 yes 12
qz_identity:paraphrase paraphrase seed:rag-defects:qz_identity 1 yes 12
qz_identity:bug-report bug-report seed:rag-defects:qz_identity 3 yes 12
qz_wrong_corpus:ticket ticket seed:rag-defects:qz_wrong_corpus 3 yes 12
qz_wrong_corpus:paraphrase paraphrase seed:rag-defects:qz_wrong_corpus 12 yes 12
qz_wrong_corpus:bug-report bug-report seed:rag-defects:qz_wrong_corpus 1 yes 12
rx_fight_compiler:ticket ticket seed:react-defects:rx_fight_compiler 1 yes 12
rx_fight_compiler:paraphrase paraphrase seed:react-defects:rx_fight_compiler 20 MISS 12
rx_fight_compiler:bug-report bug-report seed:react-defects:rx_fight_compiler 1 yes 12
rx_tokens_localstorage:ticket ticket seed:react-defects:rx_tokens_localstorage 3 yes 12
rx_tokens_localstorage:paraphrase paraphrase seed:react-defects:rx_tokens_localstorage 3 yes 12
rx_tokens_localstorage:bug-report bug-report seed:react-defects:rx_tokens_localstorage 5 yes 12
