bench · label v1-fulltext-triggers · split selection · code 29933681bc47
corpus: 183 records from 12 seed packs (sha 271b057d54d6) · queries queries.jsonl sha 97ecbcb5d681 · nulls 550 (sha 6e100bad522c)
arm: decision floor · hybrid off · rerank off · limit 12 · common-word share 0.05 · interests none · triggers on 173 lessons (triggers.jsonl, sha 814c7bb5aa68)

register       n         recall (briefed)  hit@1  hit@3  hit@12    MRR briefed/q
bug-report    83    89.2% [81.9%, 95.2%]  79.5%  94.0%   98.8%  0.876      12.0
paraphrase    83    66.3% [56.6%, 75.9%]  62.7%  75.9%   90.4%  0.714      11.6
ticket        83    85.5% [78.3%, 92.8%]  69.9%  86.7%   95.2%  0.789      11.8
all          249    80.3% [75.1%, 85.5%]  70.7%  85.5%   94.8%  0.793      11.8

null prompts briefed nothing: 238 of 550 (43.3%, 95% [39.2%, 47.4%]) · the rest got 5.2 lessons on average
  calibration half (sets the calibrated line): briefed anything 163 of 282 (57.8%, 95% [52.0%, 63.4%])
  unseen half (sets the calibrated line: never seen by it): briefed anything 149 of 268 (55.6%, 95% [49.6%, 61.4%])
latency per check: median 7 ms · p95 37 ms · 799 checks

per query: id register lesson rank briefed count
dec_sixth_surface:ticket ticket seed:dotnet-canon:dec_sixth_surface 1 yes 12
dec_sixth_surface:paraphrase paraphrase seed:dotnet-canon:dec_sixth_surface 1 MISS 12
dec_sixth_surface:bug-report bug-report seed:dotnet-canon:dec_sixth_surface 2 yes 12
r_202_long_running:ticket ticket seed:dotnet-canon:r_202_long_running 3 MISS 9
r_202_long_running:paraphrase paraphrase seed:dotnet-canon:r_202_long_running 1 yes 11
r_202_long_running:bug-report bug-report seed:dotnet-canon:r_202_long_running 1 MISS 12
r_aaa_narrative:ticket ticket seed:dotnet-canon:r_aaa_narrative 24 MISS 12
r_aaa_narrative:paraphrase paraphrase seed:dotnet-canon:r_aaa_narrative 32 MISS 12
r_aaa_narrative:bug-report bug-report seed:dotnet-canon:r_aaa_narrative 2 yes 12
r_arch_enforcement_ladder:ticket ticket seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 12
r_arch_enforcement_ladder:paraphrase paraphrase seed:dotnet-canon:r_arch_enforcement_ladder 1 yes 12
r_arch_enforcement_ladder:bug-report bug-report seed:dotnet-canon:r_arch_enforcement_ladder 2 yes 12
r_aspire_azure_fallback:ticket ticket seed:dotnet-canon:r_aspire_azure_fallback 1 yes 10
r_aspire_azure_fallback:paraphrase paraphrase seed:dotnet-canon:r_aspire_azure_fallback 7 MISS 12
r_aspire_azure_fallback:bug-report bug-report seed:dotnet-canon:r_aspire_azure_fallback 1 yes 12
r_aspire_versions:ticket ticket seed:dotnet-canon:r_aspire_versions 1 yes 12
r_aspire_versions:paraphrase paraphrase seed:dotnet-canon:r_aspire_versions 1 yes 12
r_aspire_versions:bug-report bug-report seed:dotnet-canon:r_aspire_versions 1 yes 12
r_aspire_waitfor:ticket ticket seed:dotnet-canon:r_aspire_waitfor 1 yes 12
r_aspire_waitfor:paraphrase paraphrase seed:dotnet-canon:r_aspire_waitfor 1 MISS 12
r_aspire_waitfor:bug-report bug-report seed:dotnet-canon:r_aspire_waitfor 1 yes 12
r_bulk_ops:ticket ticket seed:dotnet-canon:r_bulk_ops 1 MISS 12
r_bulk_ops:paraphrase paraphrase seed:dotnet-canon:r_bulk_ops 3 MISS 12
r_bulk_ops:bug-report bug-report seed:dotnet-canon:r_bulk_ops 12 MISS 12
r_comments_durable_docs:ticket ticket seed:dotnet-canon:r_comments_durable_docs 1 yes 12
r_comments_durable_docs:paraphrase paraphrase seed:dotnet-canon:r_comments_durable_docs 1 MISS 12
r_comments_durable_docs:bug-report bug-report seed:dotnet-canon:r_comments_durable_docs 1 yes 12
r_docs_review_surface:ticket ticket seed:dotnet-canon:r_docs_review_surface 3 yes 12
r_docs_review_surface:paraphrase paraphrase seed:dotnet-canon:r_docs_review_surface 23 MISS 12
r_docs_review_surface:bug-report bug-report seed:dotnet-canon:r_docs_review_surface 1 yes 12
r_durability_not_replay:ticket ticket seed:dotnet-canon:r_durability_not_replay 1 yes 12
r_durability_not_replay:paraphrase paraphrase seed:dotnet-canon:r_durability_not_replay 1 yes 12
r_durability_not_replay:bug-report bug-report seed:dotnet-canon:r_durability_not_replay 1 yes 12
r_encoding_loop:ticket ticket seed:dotnet-canon:r_encoding_loop 2 yes 12
r_encoding_loop:paraphrase paraphrase seed:dotnet-canon:r_encoding_loop 4 yes 12
r_encoding_loop:bug-report bug-report seed:dotnet-canon:r_encoding_loop 1 yes 12
r_exceptions_canon:ticket ticket seed:dotnet-canon:r_exceptions_canon 7 yes 12
r_exceptions_canon:paraphrase paraphrase seed:dotnet-canon:r_exceptions_canon 11 yes 12
r_exceptions_canon:bug-report bug-report seed:dotnet-canon:r_exceptions_canon 3 yes 12
r_experiment_sunset:ticket ticket seed:dotnet-canon:r_experiment_sunset 1 yes 12
r_experiment_sunset:paraphrase paraphrase seed:dotnet-canon:r_experiment_sunset 1 yes 12
r_experiment_sunset:bug-report bug-report seed:dotnet-canon:r_experiment_sunset 1 MISS 12
r_grep_to_zero:ticket ticket seed:dotnet-canon:r_grep_to_zero 4 yes 12
r_grep_to_zero:paraphrase paraphrase seed:dotnet-canon:r_grep_to_zero 2 yes 12
r_grep_to_zero:bug-report bug-report seed:dotnet-canon:r_grep_to_zero 1 yes 12
r_idp_policy_pinned:ticket ticket seed:dotnet-canon:r_idp_policy_pinned 2 yes 12
r_idp_policy_pinned:paraphrase paraphrase seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_idp_policy_pinned:bug-report bug-report seed:dotnet-canon:r_idp_policy_pinned 1 yes 12
r_middleware_order:ticket ticket seed:dotnet-canon:r_middleware_order 2 yes 12
r_middleware_order:paraphrase paraphrase seed:dotnet-canon:r_middleware_order 1 yes 12
r_middleware_order:bug-report bug-report seed:dotnet-canon:r_middleware_order 1 yes 12
r_migrations_immutable:ticket ticket seed:dotnet-canon:r_migrations_immutable 1 yes 9
r_migrations_immutable:paraphrase paraphrase seed:dotnet-canon:r_migrations_immutable 1 yes 12
r_migrations_immutable:bug-report bug-report seed:dotnet-canon:r_migrations_immutable 1 yes 12
r_pagination_cap:ticket ticket seed:dotnet-canon:r_pagination_cap 4 MISS 12
r_pagination_cap:paraphrase paraphrase seed:dotnet-canon:r_pagination_cap 32 MISS 12
r_pagination_cap:bug-report bug-report seed:dotnet-canon:r_pagination_cap 2 yes 12
r_rate_limiter_scaleout:ticket ticket seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 12
r_rate_limiter_scaleout:paraphrase paraphrase seed:dotnet-canon:r_rate_limiter_scaleout 1 yes 12
r_rate_limiter_scaleout:bug-report bug-report seed:dotnet-canon:r_rate_limiter_scaleout 2 yes 12
r_request_naming:ticket ticket seed:dotnet-canon:r_request_naming 1 yes 12
r_request_naming:paraphrase paraphrase seed:dotnet-canon:r_request_naming 1 yes 12
r_request_naming:bug-report bug-report seed:dotnet-canon:r_request_naming 1 yes 12
r_rich_domain_when_observed:ticket ticket seed:dotnet-canon:r_rich_domain_when_observed 3 yes 12
r_rich_domain_when_observed:paraphrase paraphrase seed:dotnet-canon:r_rich_domain_when_observed 5 yes 12
r_rich_domain_when_observed:bug-report bug-report seed:dotnet-canon:r_rich_domain_when_observed 1 yes 12
r_sargable:ticket ticket seed:dotnet-canon:r_sargable 1 yes 12
r_sargable:paraphrase paraphrase seed:dotnet-canon:r_sargable 4 MISS 12
r_sargable:bug-report bug-report seed:dotnet-canon:r_sargable 1 yes 12
r_surprise_in_writing:ticket ticket seed:dotnet-canon:r_surprise_in_writing 64 MISS 12
r_surprise_in_writing:paraphrase paraphrase seed:dotnet-canon:r_surprise_in_writing 1 yes 10
r_surprise_in_writing:bug-report bug-report seed:dotnet-canon:r_surprise_in_writing 1 yes 12
r_wolverine_lockstep:ticket ticket seed:dotnet-canon:r_wolverine_lockstep 3 yes 12
r_wolverine_lockstep:paraphrase paraphrase seed:dotnet-canon:r_wolverine_lockstep 1 yes 12
r_wolverine_lockstep:bug-report bug-report seed:dotnet-canon:r_wolverine_lockstep 1 yes 12
pd_authz_adapts_at_endpoint_boundary:ticket ticket seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 6 MISS 12
pd_authz_adapts_at_endpoint_boundary:paraphrase paraphrase seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 1 yes 12
pd_authz_adapts_at_endpoint_boundary:bug-report bug-report seed:dotnet-decisions:pd_authz_adapts_at_endpoint_boundary 1 yes 12
pd_central_package_management:ticket ticket seed:dotnet-decisions:pd_central_package_management 10 MISS 12
pd_central_package_management:paraphrase paraphrase seed:dotnet-decisions:pd_central_package_management 1 yes 12
pd_central_package_management:bug-report bug-report seed:dotnet-decisions:pd_central_package_management 1 yes 12
pd_established_idp_never_handroll_auth:ticket ticket seed:dotnet-decisions:pd_established_idp_never_handroll_auth 43 MISS 9
pd_established_idp_never_handroll_auth:paraphrase paraphrase seed:dotnet-decisions:pd_established_idp_never_handroll_auth 4 MISS 12
pd_established_idp_never_handroll_auth:bug-report bug-report seed:dotnet-decisions:pd_established_idp_never_handroll_auth 2 yes 12
pd_license_driven_test_lib_forks:ticket ticket seed:dotnet-decisions:pd_license_driven_test_lib_forks 1 yes 12
pd_license_driven_test_lib_forks:paraphrase paraphrase seed:dotnet-decisions:pd_license_driven_test_lib_forks 1 yes 12
pd_license_driven_test_lib_forks:bug-report bug-report seed:dotnet-decisions:pd_license_driven_test_lib_forks 1 MISS 12
pd_nonhandler_outbox_idbcontextoutbox:ticket ticket seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 1 yes 12
pd_nonhandler_outbox_idbcontextoutbox:paraphrase paraphrase seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 3 yes 12
pd_nonhandler_outbox_idbcontextoutbox:bug-report bug-report seed:dotnet-decisions:pd_nonhandler_outbox_idbcontextoutbox 1 yes 12
pd_openapi_dev_only:ticket ticket seed:dotnet-decisions:pd_openapi_dev_only 1 yes 12
pd_openapi_dev_only:paraphrase paraphrase seed:dotnet-decisions:pd_openapi_dev_only 1 MISS 6
pd_openapi_dev_only:bug-report bug-report seed:dotnet-decisions:pd_openapi_dev_only 1 yes 12
pd_rate_limit_expensive_endpoints:ticket ticket seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 2 yes 12
pd_rate_limit_expensive_endpoints:paraphrase paraphrase seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 42 MISS 6
pd_rate_limit_expensive_endpoints:bug-report bug-report seed:dotnet-decisions:pd_rate_limit_expensive_endpoints 1 yes 12
pd_require_explicit_api_version:ticket ticket seed:dotnet-decisions:pd_require_explicit_api_version 1 yes 12
pd_require_explicit_api_version:paraphrase paraphrase seed:dotnet-decisions:pd_require_explicit_api_version 7 MISS 12
pd_require_explicit_api_version:bug-report bug-report seed:dotnet-decisions:pd_require_explicit_api_version 4 MISS 12
pd_standard_resilience_handler:ticket ticket seed:dotnet-decisions:pd_standard_resilience_handler 1 yes 10
pd_standard_resilience_handler:paraphrase paraphrase seed:dotnet-decisions:pd_standard_resilience_handler 1 yes 12
pd_standard_resilience_handler:bug-report bug-report seed:dotnet-decisions:pd_standard_resilience_handler 4 MISS 12
pd_three_validation_layers:ticket ticket seed:dotnet-decisions:pd_three_validation_layers 1 MISS 12
pd_three_validation_layers:paraphrase paraphrase seed:dotnet-decisions:pd_three_validation_layers 1 yes 12
pd_three_validation_layers:bug-report bug-report seed:dotnet-decisions:pd_three_validation_layers 1 yes 12
pd_transport_decision_tree:ticket ticket seed:dotnet-decisions:pd_transport_decision_tree 1 yes 12
pd_transport_decision_tree:paraphrase paraphrase seed:dotnet-decisions:pd_transport_decision_tree 1 yes 10
pd_transport_decision_tree:bug-report bug-report seed:dotnet-decisions:pd_transport_decision_tree 1 yes 12
pd_url_segment_versioning:ticket ticket seed:dotnet-decisions:pd_url_segment_versioning 1 yes 12
pd_url_segment_versioning:paraphrase paraphrase seed:dotnet-decisions:pd_url_segment_versioning 34 MISS 12
pd_url_segment_versioning:bug-report bug-report seed:dotnet-decisions:pd_url_segment_versioning 1 yes 12
pd_wolverine_middleware_order:ticket ticket seed:dotnet-decisions:pd_wolverine_middleware_order 1 yes 12
pd_wolverine_middleware_order:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_middleware_order 50 MISS 12
pd_wolverine_middleware_order:bug-report bug-report seed:dotnet-decisions:pd_wolverine_middleware_order 1 yes 12
pd_wolverine_over_mediatr_masstransit:ticket ticket seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 12
pd_wolverine_over_mediatr_masstransit:paraphrase paraphrase seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 1 yes 12
pd_wolverine_over_mediatr_masstransit:bug-report bug-report seed:dotnet-decisions:pd_wolverine_over_mediatr_masstransit 2 yes 12
pd_zero_warning_build:ticket ticket seed:dotnet-decisions:pd_zero_warning_build 2 yes 12
pd_zero_warning_build:paraphrase paraphrase seed:dotnet-decisions:pd_zero_warning_build 1 yes 12
pd_zero_warning_build:bug-report bug-report seed:dotnet-decisions:pd_zero_warning_build 1 yes 12
g_tombstones_nc:ticket ticket seed:dotnet-defects:g_tombstones_nc 1 yes 12
g_tombstones_nc:paraphrase paraphrase seed:dotnet-defects:g_tombstones_nc 4 yes 12
g_tombstones_nc:bug-report bug-report seed:dotnet-defects:g_tombstones_nc 2 yes 12
nc_arch_reviewer:ticket ticket seed:dotnet-defects:nc_arch_reviewer 1 yes 12
nc_arch_reviewer:paraphrase paraphrase seed:dotnet-defects:nc_arch_reviewer 1 yes 12
nc_arch_reviewer:bug-report bug-report seed:dotnet-defects:nc_arch_reviewer 2 yes 12
nc_idor:ticket ticket seed:dotnet-defects:nc_idor 2 yes 12
nc_idor:paraphrase paraphrase seed:dotnet-defects:nc_idor 2 yes 12
nc_idor:bug-report bug-report seed:dotnet-defects:nc_idor 1 yes 12
nc_jwt_clockskew:ticket ticket seed:dotnet-defects:nc_jwt_clockskew 1 yes 12
nc_jwt_clockskew:paraphrase paraphrase seed:dotnet-defects:nc_jwt_clockskew 1 yes 12
nc_jwt_clockskew:bug-report bug-report seed:dotnet-defects:nc_jwt_clockskew 1 yes 12
nc_speculative_interface:ticket ticket seed:dotnet-defects:nc_speculative_interface 7 MISS 12
nc_speculative_interface:paraphrase paraphrase seed:dotnet-defects:nc_speculative_interface 1 yes 12
nc_speculative_interface:bug-report bug-report seed:dotnet-defects:nc_speculative_interface 2 yes 12
rs_event_carries_recipient_id:ticket ticket seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_event_carries_recipient_id:paraphrase paraphrase seed:dotnet-review-surfaces:rs_event_carries_recipient_id 3 yes 12
rs_event_carries_recipient_id:bug-report bug-report seed:dotnet-review-surfaces:rs_event_carries_recipient_id 1 yes 12
rs_integration_tests_default:ticket ticket seed:dotnet-review-surfaces:rs_integration_tests_default 2 yes 12
rs_integration_tests_default:paraphrase paraphrase seed:dotnet-review-surfaces:rs_integration_tests_default 23 MISS 12
rs_integration_tests_default:bug-report bug-report seed:dotnet-review-surfaces:rs_integration_tests_default 79 MISS 12
rs_keyed_services_over_factories:ticket ticket seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 12
rs_keyed_services_over_factories:paraphrase paraphrase seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 12
rs_keyed_services_over_factories:bug-report bug-report seed:dotnet-review-surfaces:rs_keyed_services_over_factories 1 yes 12
rs_meter_wildcard_registration:ticket ticket seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 12
rs_meter_wildcard_registration:paraphrase paraphrase seed:dotnet-review-surfaces:rs_meter_wildcard_registration 1 yes 12
rs_meter_wildcard_registration:bug-report bug-report seed:dotnet-review-surfaces:rs_meter_wildcard_registration 2 yes 12
rs_sweeper_hygiene:ticket ticket seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_sweeper_hygiene:paraphrase paraphrase seed:dotnet-review-surfaces:rs_sweeper_hygiene 3 yes 12
rs_sweeper_hygiene:bug-report bug-report seed:dotnet-review-surfaces:rs_sweeper_hygiene 1 yes 12
rs_transport_removal_orphans:ticket ticket seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 12
rs_transport_removal_orphans:paraphrase paraphrase seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 12
rs_transport_removal_orphans:bug-report bug-report seed:dotnet-review-surfaces:rs_transport_removal_orphans 1 yes 12
rs_workflow_hardening_baseline:ticket ticket seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rs_workflow_hardening_baseline:paraphrase paraphrase seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rs_workflow_hardening_baseline:bug-report bug-report seed:dotnet-review-surfaces:rs_workflow_hardening_baseline 1 yes 12
rxc_mutation_invalidate:ticket ticket seed:frontend-canon:rxc_mutation_invalidate 1 yes 12
rxc_mutation_invalidate:paraphrase paraphrase seed:frontend-canon:rxc_mutation_invalidate 6 MISS 12
rxc_mutation_invalidate:bug-report bug-report seed:frontend-canon:rxc_mutation_invalidate 1 yes 12
rxc_query_keys:ticket ticket seed:frontend-canon:rxc_query_keys 1 yes 12
rxc_query_keys:paraphrase paraphrase seed:frontend-canon:rxc_query_keys 2 MISS 12
rxc_query_keys:bug-report bug-report seed:frontend-canon:rxc_query_keys 4 MISS 12
rxc_shared_promotion:ticket ticket seed:frontend-canon:rxc_shared_promotion 1 yes 12
rxc_shared_promotion:paraphrase paraphrase seed:frontend-canon:rxc_shared_promotion 1 MISS 7
rxc_shared_promotion:bug-report bug-report seed:frontend-canon:rxc_shared_promotion 1 yes 12
r_resubstitution_not_validation:ticket ticket seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 12
r_resubstitution_not_validation:paraphrase paraphrase seed:geospatial-deeptime-defects:r_resubstitution_not_validation 4 MISS 12
r_resubstitution_not_validation:bug-report bug-report seed:geospatial-deeptime-defects:r_resubstitution_not_validation 1 yes 12
d15:ticket ticket seed:geospatial-defects:d15 1 yes 12
d15:paraphrase paraphrase seed:geospatial-defects:d15 1 yes 12
d15:bug-report bug-report seed:geospatial-defects:d15 1 yes 12
g_verify_outputs:ticket ticket seed:geospatial-defects:g_verify_outputs 5 yes 12
g_verify_outputs:paraphrase paraphrase seed:geospatial-defects:g_verify_outputs 2 MISS 9
g_verify_outputs:bug-report bug-report seed:geospatial-defects:g_verify_outputs 1 MISS 12
d_invoked_by_nothing:ticket ticket seed:geospatial-enforcement-defects:d_invoked_by_nothing 1 yes 12
d_invoked_by_nothing:paraphrase paraphrase seed:geospatial-enforcement-defects:d_invoked_by_nothing 3 yes 12
d_invoked_by_nothing:bug-report bug-report seed:geospatial-enforcement-defects:d_invoked_by_nothing 1 yes 12
d_month_range_28:ticket ticket seed:geospatial-enforcement-defects:d_month_range_28 1 yes 12
d_month_range_28:paraphrase paraphrase seed:geospatial-enforcement-defects:d_month_range_28 1 yes 12
d_month_range_28:bug-report bug-report seed:geospatial-enforcement-defects:d_month_range_28 1 yes 11
g_gate_every_dir:ticket ticket seed:geospatial-enforcement-defects:g_gate_every_dir 1 yes 12
g_gate_every_dir:paraphrase paraphrase seed:geospatial-enforcement-defects:g_gate_every_dir 1 yes 12
g_gate_every_dir:bug-report bug-report seed:geospatial-enforcement-defects:g_gate_every_dir 1 yes 12
g_review_agent_in_ci:ticket ticket seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
g_review_agent_in_ci:paraphrase paraphrase seed:geospatial-enforcement-defects:g_review_agent_in_ci 2 yes 12
g_review_agent_in_ci:bug-report bug-report seed:geospatial-enforcement-defects:g_review_agent_in_ci 1 yes 12
r_pin_gating_tools:ticket ticket seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 12
r_pin_gating_tools:paraphrase paraphrase seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 12
r_pin_gating_tools:bug-report bug-report seed:geospatial-enforcement-defects:r_pin_gating_tools 1 yes 12
r_preregistered_control_vetoes:ticket ticket seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 12
r_preregistered_control_vetoes:paraphrase paraphrase seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 12
r_preregistered_control_vetoes:bug-report bug-report seed:geospatial-eval-defects:r_preregistered_control_vetoes 1 yes 12
py_classes_earn_place:ticket ticket seed:python-canon:py_classes_earn_place 77 MISS 12
py_classes_earn_place:paraphrase paraphrase seed:python-canon:py_classes_earn_place 1 yes 11
py_classes_earn_place:bug-report bug-report seed:python-canon:py_classes_earn_place 1 yes 12
py_comments_why:ticket ticket seed:python-canon:py_comments_why 3 yes 12
py_comments_why:paraphrase paraphrase seed:python-canon:py_comments_why 1 MISS 12
py_comments_why:bug-report bug-report seed:python-canon:py_comments_why 1 yes 12
py_contract_tests:ticket ticket seed:python-canon:py_contract_tests 1 yes 12
py_contract_tests:paraphrase paraphrase seed:python-canon:py_contract_tests 1 yes 12
py_contract_tests:bug-report bug-report seed:python-canon:py_contract_tests 1 yes 12
py_docstrings:ticket ticket seed:python-canon:py_docstrings 1 yes 12
py_docstrings:paraphrase paraphrase seed:python-canon:py_docstrings 1 MISS 12
py_docstrings:bug-report bug-report seed:python-canon:py_docstrings 1 yes 12
py_exceptions_canon:ticket ticket seed:python-canon:py_exceptions_canon 1 yes 12
py_exceptions_canon:paraphrase paraphrase seed:python-canon:py_exceptions_canon 12 MISS 12
py_exceptions_canon:bug-report bug-report seed:python-canon:py_exceptions_canon 1 yes 12
py_no_power_features:ticket ticket seed:python-canon:py_no_power_features 1 MISS 12
py_no_power_features:paraphrase paraphrase seed:python-canon:py_no_power_features 1 MISS 12
py_no_power_features:bug-report bug-report seed:python-canon:py_no_power_features 1 yes 12
py_one_docstring_format:ticket ticket seed:python-canon:py_one_docstring_format 1 yes 12
py_one_docstring_format:paraphrase paraphrase seed:python-canon:py_one_docstring_format 1 yes 12
py_one_docstring_format:bug-report bug-report seed:python-canon:py_one_docstring_format 1 yes 12
py_print_at_edges:ticket ticket seed:python-canon:py_print_at_edges 2 yes 12
py_print_at_edges:paraphrase paraphrase seed:python-canon:py_print_at_edges 1 yes 12
py_print_at_edges:bug-report bug-report seed:python-canon:py_print_at_edges 1 yes 12
py_protocol_isinstance_names_only:ticket ticket seed:python-canon:py_protocol_isinstance_names_only 1 yes 12
py_protocol_isinstance_names_only:paraphrase paraphrase seed:python-canon:py_protocol_isinstance_names_only 2 yes 12
py_protocol_isinstance_names_only:bug-report bug-report seed:python-canon:py_protocol_isinstance_names_only 1 yes 12
py_starlette_httpx2:ticket ticket seed:python-canon:py_starlette_httpx2 1 yes 12
py_starlette_httpx2:paraphrase paraphrase seed:python-canon:py_starlette_httpx2 1 yes 12
py_starlette_httpx2:bug-report bug-report seed:python-canon:py_starlette_httpx2 1 yes 12
py_strict_pytest:ticket ticket seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:paraphrase paraphrase seed:python-canon:py_strict_pytest 1 yes 12
py_strict_pytest:bug-report bug-report seed:python-canon:py_strict_pytest 1 yes 12
py_type_hints_gradual:ticket ticket seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:paraphrase paraphrase seed:python-canon:py_type_hints_gradual 1 yes 12
py_type_hints_gradual:bug-report bug-report seed:python-canon:py_type_hints_gradual 1 yes 12
py_typing_syntax_floor:ticket ticket seed:python-canon:py_typing_syntax_floor 1 yes 12
py_typing_syntax_floor:paraphrase paraphrase seed:python-canon:py_typing_syntax_floor 1 yes 12
py_typing_syntax_floor:bug-report bug-report seed:python-canon:py_typing_syntax_floor 1 yes 12
qz_agent_contract:ticket ticket seed:rag-defects:qz_agent_contract 2 yes 12
qz_agent_contract:paraphrase paraphrase seed:rag-defects:qz_agent_contract 5 MISS 12
qz_agent_contract:bug-report bug-report seed:rag-defects:qz_agent_contract 1 yes 12
qz_fixtures:ticket ticket seed:rag-defects:qz_fixtures 1 yes 12
qz_fixtures:paraphrase paraphrase seed:rag-defects:qz_fixtures 14 MISS 8
qz_fixtures:bug-report bug-report seed:rag-defects:qz_fixtures 1 yes 12
qz_identity:ticket ticket seed:rag-defects:qz_identity 1 yes 12
qz_identity:paraphrase paraphrase seed:rag-defects:qz_identity 1 yes 12
qz_identity:bug-report bug-report seed:rag-defects:qz_identity 1 yes 12
qz_wrong_corpus:ticket ticket seed:rag-defects:qz_wrong_corpus 1 yes 12
qz_wrong_corpus:paraphrase paraphrase seed:rag-defects:qz_wrong_corpus 1 yes 12
qz_wrong_corpus:bug-report bug-report seed:rag-defects:qz_wrong_corpus 1 yes 12
rx_fight_compiler:ticket ticket seed:react-defects:rx_fight_compiler 1 yes 12
rx_fight_compiler:paraphrase paraphrase seed:react-defects:rx_fight_compiler 1 MISS 12
rx_fight_compiler:bug-report bug-report seed:react-defects:rx_fight_compiler 1 yes 12
rx_tokens_localstorage:ticket ticket seed:react-defects:rx_tokens_localstorage 1 yes 12
rx_tokens_localstorage:paraphrase paraphrase seed:react-defects:rx_tokens_localstorage 1 yes 12
rx_tokens_localstorage:bug-report bug-report seed:react-defects:rx_tokens_localstorage 1 yes 12
