{% extends "base.html" %} {% block title %}{% if judge %}{{ judge.name }}{% else %}New judge{% endif %} — Judges — SimpleAudit{% endblock %} {% block content %} ← Judges

{% if judge %}{{ judge.name }}{% else %}New judge{% endif %}

{% if shown %}{% include "partials/version_badge.html" with number=shown.version latest=shown_is_latest count=versions|length %}{% endif %}
{% if shown %}
{% if previous %} {% endif %} Clone v{{ shown.version }} {% if judge_in_use %} Delete {% else %}
{% csrf_token %}
{% endif %}
{% endif %}
{% if cloning %}

Prefilled from {{ cloning.label }}. Nothing is saved until you click Create judge. {% if clone_base.equivalent %}It's now your own criteria in the {{ start_label }} format, which grades the same way{% if clone_base.dimensions %} (dimensions: {{ clone_base.dimensions|join:", " }}){% endif %}. Edit anything. {% elif clone_base %}{{ clone_base.name }} reports extra fields ({{ clone_base.fields|join:", " }}), so the copy keeps its output format; edit the criteria freely, or pick a format under “Your own criteria”.{% endif %}

{% endif %} {% if shown and shown != latest %}

Viewing v{{ shown.version }} (latest is v{{ latest.version }}). Saving creates a new version from these values.

{% endif %}
{% csrf_token %}

Criteria, output format and probe prompt are versioned: changing them saves a new version. Name and description are not. The model that grades is picked per run on New Experiment.

Output format: — fixed by this judge. Fields:

Format instructions sent to the judge

Plain words; no JSON needed. The output format is added after the criteria automatically.

Probe prompt (how the auditor model plays the user)

{language} is replaced with the run's language.

Full judge prompt (preview)

        
{% if cloning %}{% endif %} {% if judge %} {% endif %}
{% if can_write %}
Cancel
{% endif %}
{% if versions|length > 1 %} {% include "partials/version_diff_modal.html" with id="judge-diff" title="What changed" versions=versions %} {% include "partials/version_diff_js.html" %} {{ diff_versions|json_script:"diff-data" }} {% endif %} {{ bases|json_script:"base-data" }} {{ formats|json_script:"format-data" }} {{ default_probe|json_script:"default-probe" }} {% if cloning %}{{ form.probe_prompt|json_script:"clone-probe" }}{{ cloning.judge.name|json_script:"clone-name" }}{% endif %} {% if shown %} {% include "partials/text_file_modal.html" %} {% endif %} {% endblock %}