{% extends "base.html" %} {% set order = 'desc' if data.descending else 'asc' %} {% block title %}Trials · {{ title }}{% endblock %} {% block html_attributes %} data-page="board"{% endblock %} {% block body %}

alphatonic · study

Trials · {{ title }}

{{ data.trials | length }} trial{{ '' if data.trials | length == 1 else 's' }} saved in {{ data.families | length }} famil{{ 'y' if data.families | length == 1 else 'ies' }} {%- if holdout_uses %} · {{ holdout_uses }} holdout evaluation{{ '' if holdout_uses == 1 else 's' }}{% endif %} {%- if data.holdout_start %} · holdout from {{ when(data.holdout_start) }} UTC{% endif %}. Statistics are at a horizon of {{ data.horizon or 1 }} bar{{ '' if data.horizon == 1 or not data.horizon else 's' }}.

{% if data.horizons %}
{% endif %}
{% if data.unreadable %}

{{ data.unreadable | length }} record{{ '' if data.unreadable | length == 1 else 's' }} could not be read: {{ data.unreadable | join(', ') }}

{% endif %} {% if rows %}
{% for group in groups %}{% endfor %} {% for column in columns %} {% endfor %} {% for trial in rows %} {% for column in columns %}{% set key = column.key %} {% if key == 'signal' %} {% elif key == 'cs_ic' or key.startswith('ts_') %} {% elif key == 'cs_z' %} {% elif key == 'cs_p' %} {% elif key == 'adjusted_p' %} {% elif key == 'trials' %} {% elif key == 'sample' %} {% elif key == 'start' %} {% elif key == 'bar' %} {% elif key == 'assets' %} {% elif key == 'created_at' %} {% else %} {% endif %} {% endfor %} {% endfor %}
Trials at a horizon of {{ data.horizon }} bars, sorted by {{ data.sort }}
{{ group.label }}
{{ column.heading }}{% if column.key == data.sort %} {{ '▼' if data.descending else '▲' }}{% endif %} Files
{% if trial.files.tearsheet %}{{ trial.signal }}{% else %}{{ trial.signal }}{% endif %} {% set details = [] %} {% if trial.family != trial.signal %}{% set _ = details.append('family ' ~ trial.family) %}{% endif %} {% for name, value in trial.parameters.items() %}{% set _ = details.append(name ~ '=' ~ value) %}{% endfor %} {% if details %}{{ details | join(' · ') }}{% endif %} {% if trial.note %}{{ trial.note }}{% endif %} {{ number(trial[key], 4) }}{{ number(trial.cs_z, 2) }}{{ p_value(trial.cs_p) }}{% if trial.adjusted_p is not none and trial.adjusted_p <= significant %}{{ p_value(trial.adjusted_p) }}{% else %}{{ p_value(trial.adjusted_p) }}{% endif %}{{ trial.trials }}{% if trial.sample == 'holdout' %}holdout{% if trial.holdout_uses > 1 %} · {{ trial.holdout_uses }} looks{% endif %}{% else %}in sample{% endif %}{{ when(trial.start, '%Y-%m-%d') }} – {{ when(trial.end, '%Y-%m-%d') }}{{ bar(trial.bar_seconds) }}{{ trial.assets if trial.assets else '–' }}{{ when(trial.created_at) }}{{ trial.context.get(key, '–') }}record
{% else %}

No trials{% if asked_signal %} of {{ asked_signal }}{% endif %} yet. Evaluations run through Study.evaluate appear here.

{% endif %}
About these columns
Cross-sectional rank IC, z and p
The mean Spearman IC across timestamps, its Newey–West z-statistic and the two-sided p-value.
Trials
Evaluations of the same family in this study, across parameters and both samples.
p × trials
The cross-sectional p-value times the number of trials of its family, at most 1: Bonferroni's correction. It is a lower bound on the penalty, because variants tried outside the study, or abandoned before evaluation, are not counted. Values of {{ significant }} or less are bold.
Sample
In sample, or the holdout. A second look at the holdout makes it in-sample data for that family.
Time-series rank IC, cosine and timing
The mean Spearman IC within assets, the uncentred cosine similarity, and the part of the cosine earned by timing rather than by the average position.
Data
The evaluated window (end exclusive, UTC), the bar spacing, the number of assets with prices, and facts recorded by the researcher.

A dash marks a statistic that is undefined at this horizon, never zero. The same list is available as JSON at study.json.

{% endblock %}