Metadata-Version: 2.4
Name: harness-observability-layer
Version: 1.0.2
Summary: Observability tooling for agent harness sessions, imports, and reports.
Author: Alexandre Lira
License: Mozilla Public License Version 2.0
        ==================================
        
        1. Definitions
        --------------
        
        1.1. "Contributor"
            means each individual or legal entity that creates, contributes to
            the creation of, or owns Covered Software.
        
        1.2. "Contributor Version"
            means the combination of the Contributions of others (if any) used
            by a Contributor and that particular Contributor's Contribution.
        
        1.3. "Contribution"
            means Covered Software of a particular Contributor.
        
        1.4. "Covered Software"
            means Source Code Form to which the initial Contributor has attached
            the notice in Exhibit A, the Executable Form of such Source Code
            Form, and Modifications of such Source Code Form, in each case
            including portions thereof.
        
        1.5. "Incompatible With Secondary Licenses"
            means
        
            (a) that the initial Contributor has attached the notice described
                in Exhibit B to the Covered Software; or
        
            (b) that the Covered Software was made available under the terms of
                version 1.1 or earlier of the License, but not also under the
                terms of a Secondary License.
        
        1.6. "Executable Form"
            means any form of the work other than Source Code Form.
        
        1.7. "Larger Work"
            means a work that combines Covered Software with other material, in
            a separate file or files, that is not Covered Software.
        
        1.8. "License"
            means this document.
        
        1.9. "Licensable"
            means having the right to grant, to the maximum extent possible,
            whether at the time of the initial grant or subsequently, any and
            all of the rights conveyed by this License.
        
        1.10. "Modifications"
            means any of the following:
        
            (a) any file in Source Code Form that results from an addition to,
                deletion from, or modification of the contents of Covered
                Software; or
        
            (b) any new file in Source Code Form that contains any Covered
                Software.
        
        1.11. "Patent Claims" of a Contributor
            means any patent claim(s), including without limitation, method,
            process, and apparatus claims, in any patent Licensable by such
            Contributor that would be infringed, but for the grant of the
            License, by the making, using, selling, offering for sale, having
            made, import, or transfer of either its Contributions or its
            Contributor Version.
        
        1.12. "Secondary License"
            means either the GNU General Public License, Version 2.0, the GNU
            Lesser General Public License, Version 2.1, the GNU Affero General
            Public License, Version 3.0, or any later versions of those
            licenses.
        
        1.13. "Source Code Form"
            means the form of the work preferred for making modifications.
        
        1.14. "You" (or "Your")
            means an individual or a legal entity exercising rights under this
            License. For legal entities, "You" includes any entity that
            controls, is controlled by, or is under common control with You. For
            purposes of this definition, "control" means (a) the power, direct
            or indirect, to cause the direction or management of such entity,
            whether by contract or otherwise, or (b) ownership of more than
            fifty percent (50%) of the outstanding shares or beneficial
            ownership of such entity.
        
        2. License Grants and Conditions
        --------------------------------
        
        2.1. Grants
        
        Each Contributor hereby grants You a world-wide, royalty-free,
        non-exclusive license:
        
        (a) under intellectual property rights (other than patent or trademark)
            Licensable by such Contributor to use, reproduce, make available,
            modify, display, perform, distribute, and otherwise exploit its
            Contributions, either on an unmodified basis, with Modifications, or
            as part of a Larger Work; and
        
        (b) under Patent Claims of such Contributor to make, use, sell, offer
            for sale, have made, import, and otherwise transfer either its
            Contributions or its Contributor Version.
        
        2.2. Effective Date
        
        The licenses granted in Section 2.1 with respect to any Contribution
        become effective for each Contribution on the date the Contributor first
        distributes such Contribution.
        
        2.3. Limitations on Grant Scope
        
        The licenses granted in this Section 2 are the only rights granted under
        this License. No additional rights or licenses will be implied from the
        distribution or licensing of Covered Software under this License.
        Notwithstanding Section 2.1(b) above, no patent license is granted by a
        Contributor:
        
        (a) for any code that a Contributor has removed from Covered Software;
            or
        
        (b) for infringements caused by: (i) Your and any other third party's
            modifications of Covered Software, or (ii) the combination of its
            Contributions with other software (except as part of its Contributor
            Version); or
        
        (c) under Patent Claims infringed by Covered Software in the absence of
            its Contributions.
        
        This License does not grant any rights in the trademarks, service marks,
        or logos of any Contributor (except as may be necessary to comply with
        the notice requirements in Section 3.4).
        
        2.4. Subsequent Licenses
        
        No Contributor makes additional grants as a result of Your choice to
        distribute the Covered Software under a subsequent version of this
        License (see Section 10.2) or under the terms of a Secondary License (if
        permitted under the terms of Section 3.3).
        
        2.5. Representation
        
        Each Contributor represents that the Contributor believes its
        Contributions are its original creation(s) or it has sufficient rights
        to grant the rights to its Contributions conveyed by this License.
        
        2.6. Fair Use
        
        This License is not intended to limit any rights You have under
        applicable copyright doctrines of fair use, fair dealing, or other
        equivalents.
        
        2.7. Conditions
        
        Sections 3.1, 3.2, 3.3, and 3.4 are conditions of the licenses granted
        in Section 2.1.
        
        3. Responsibilities
        -------------------
        
        3.1. Distribution of Source Form
        
        All distribution of Covered Software in Source Code Form, including any
        Modifications that You create or to which You contribute, must be under
        the terms of this License. You must inform recipients that the Source
        Code Form of the Covered Software is governed by the terms of this
        License, and how they can obtain a copy of this License. You may not
        attempt to alter or restrict the recipients' rights in the Source Code
        Form.
        
        3.2. Distribution of Executable Form
        
        If You distribute Covered Software in Executable Form then:
        
        (a) such Covered Software must also be made available in Source Code
            Form, as described in Section 3.1, and You must inform recipients of
            the Executable Form how they can obtain a copy of such Source Code
            Form by reasonable means in a timely manner, at a charge no more
            than the cost of distribution to the recipient; and
        
        (b) You may distribute such Executable Form under the terms of this
            License, or sublicense it under different terms, provided that the
            license for the Executable Form does not attempt to limit or alter
            the recipients' rights in the Source Code Form under this License.
        
        3.3. Distribution of a Larger Work
        
        You may create and distribute a Larger Work under terms of Your choice,
        provided that You also comply with the requirements of this License for
        the Covered Software. If the Larger Work is a combination of Covered
        Software with a work governed by one or more Secondary Licenses, and the
        Covered Software is not Incompatible With Secondary Licenses, this
        License permits You to additionally distribute such Covered Software
        under the terms of such Secondary License(s), so that the recipient of
        the Larger Work may, at their option, further distribute the Covered
        Software under the terms of either this License or such Secondary
        License(s).
        
        3.4. Notices
        
        You may not remove or alter the substance of any license notices
        (including copyright notices, patent notices, disclaimers of warranty,
        or limitations of liability) contained within the Source Code Form of
        the Covered Software, except that You may alter any license notices to
        the extent required to remedy known factual inaccuracies.
        
        3.5. Application of Additional Terms
        
        You may choose to offer, and to charge a fee for, warranty, support,
        indemnity or liability obligations to one or more recipients of Covered
        Software. However, You may do so only on Your own behalf, and not on
        behalf of any Contributor. You must make it absolutely clear that any
        such warranty, support, indemnity, or liability obligation is offered by
        You alone, and You hereby agree to indemnify every Contributor for any
        liability incurred by such Contributor as a result of warranty, support,
        indemnity or liability terms You offer. You may include additional
        disclaimers of warranty and limitations of liability specific to any
        jurisdiction.
        
        4. Inability to Comply Due to Statute or Regulation
        ---------------------------------------------------
        
        If it is impossible for You to comply with any of the terms of this
        License with respect to some or all of the Covered Software due to
        statute, judicial order, or regulation then You must: (a) comply with
        the terms of this License to the maximum extent possible; and (b)
        describe the limitations and the code they affect. Such description must
        be placed in a text file included with all distributions of the Covered
        Software under this License. Except to the extent prohibited by statute
        or regulation, such description must be sufficiently detailed for a
        recipient of ordinary skill to be able to understand it.
        
        5. Termination
        --------------
        
        5.1. The rights granted under this License will terminate automatically
        if You fail to comply with any of its terms. However, if You become
        compliant, then the rights granted under this License from a particular
        Contributor are reinstated (a) provisionally, unless and until such
        Contributor explicitly and finally terminates Your grants, and (b) on an
        ongoing basis, if such Contributor fails to notify You of the
        non-compliance by some reasonable means prior to 60 days after You have
        come back into compliance. Moreover, Your grants from a particular
        Contributor are reinstated on an ongoing basis if such Contributor
        notifies You of the non-compliance by some reasonable means, this is the
        first time You have received notice of non-compliance with this License
        from such Contributor, and You become compliant prior to 30 days after
        Your receipt of the notice.
        
        5.2. If You initiate litigation against any entity by asserting a patent
        infringement claim (excluding declaratory judgment actions,
        counter-claims, and cross-claims) alleging that a Contributor Version
        directly or indirectly infringes any patent, then the rights granted to
        You by any and all Contributors for the Covered Software under Section
        2.1 of this License shall terminate.
        
        5.3. In the event of termination under Sections 5.1 or 5.2 above, all
        end user license agreements (excluding distributors and resellers) which
        have been validly granted by You or Your distributors under this License
        prior to termination shall survive termination.
        
        ************************************************************************
        *                                                                      *
        *  6. Disclaimer of Warranty                                           *
        *  -------------------------                                           *
        *                                                                      *
        *  Covered Software is provided under this License on an "as is"       *
        *  basis, without warranty of any kind, either expressed, implied, or  *
        *  statutory, including, without limitation, warranties that the       *
        *  Covered Software is free of defects, merchantable, fit for a        *
        *  particular purpose or non-infringing. The entire risk as to the     *
        *  quality and performance of the Covered Software is with You.        *
        *  Should any Covered Software prove defective in any respect, You     *
        *  (not any Contributor) assume the cost of any necessary servicing,   *
        *  repair, or correction. This disclaimer of warranty constitutes an   *
        *  essential part of this License. No use of any Covered Software is   *
        *  authorized under this License except under this disclaimer.         *
        *                                                                      *
        ************************************************************************
        
        ************************************************************************
        *                                                                      *
        *  7. Limitation of Liability                                          *
        *  --------------------------                                          *
        *                                                                      *
        *  Under no circumstances and under no legal theory, whether tort      *
        *  (including negligence), contract, or otherwise, shall any           *
        *  Contributor, or anyone who distributes Covered Software as          *
        *  permitted above, be liable to You for any direct, indirect,         *
        *  special, incidental, or consequential damages of any character      *
        *  including, without limitation, damages for lost profits, loss of    *
        *  goodwill, work stoppage, computer failure or malfunction, or any    *
        *  and all other commercial damages or losses, even if such party      *
        *  shall have been informed of the possibility of such damages. This   *
        *  limitation of liability shall not apply to liability for death or   *
        *  personal injury resulting from such party's negligence to the       *
        *  extent applicable law prohibits such limitation. Some               *
        *  jurisdictions do not allow the exclusion or limitation of           *
        *  incidental or consequential damages, so this exclusion and          *
        *  limitation may not apply to You.                                    *
        *                                                                      *
        ************************************************************************
        
        8. Litigation
        -------------
        
        Any litigation relating to this License may be brought only in the
        courts of a jurisdiction where the defendant maintains its principal
        place of business and such litigation shall be governed by laws of that
        jurisdiction, without reference to its conflict-of-law provisions.
        Nothing in this Section shall prevent a party's ability to bring
        cross-claims or counter-claims.
        
        9. Miscellaneous
        ----------------
        
        This License represents the complete agreement concerning the subject
        matter hereof. If any provision of this License is held to be
        unenforceable, such provision shall be reformed only to the extent
        necessary to make it enforceable. Any law or regulation which provides
        that the language of a contract shall be construed against the drafter
        shall not be used to construe this License against a Contributor.
        
        10. Versions of the License
        ---------------------------
        
        10.1. New Versions
        
        Mozilla Foundation is the license steward. Except as provided in Section
        10.3, no one other than the license steward has the right to modify or
        publish new versions of this License. Each version will be given a
        distinguishing version number.
        
        10.2. Effect of New Versions
        
        You may distribute the Covered Software under the terms of the version
        of the License under which You originally received the Covered Software,
        or under the terms of any subsequent version published by the license
        steward.
        
        10.3. Modified Versions
        
        If you create software not governed by this License, and you want to
        create a new license for such software, you may create and use a
        modified version of this License if you rename the license and remove
        any references to the name of the license steward (except to note that
        such modified license differs from this License).
        
        10.4. Distributing Source Code Form that is Incompatible With Secondary
        Licenses
        
        If You choose to distribute Source Code Form that is Incompatible With
        Secondary Licenses under the terms of this version of the License, the
        notice described in Exhibit B of this License must be attached.
        
        Exhibit A - Source Code Form License Notice
        -------------------------------------------
        
          This Source Code Form is subject to the terms of the Mozilla Public
          License, v. 2.0. If a copy of the MPL was not distributed with this
          file, You can obtain one at https://mozilla.org/MPL/2.0/.
        
        If it is not possible or desirable to put the notice in a particular
        file, then You may include the notice in a location (such as a LICENSE
        file in a relevant directory) where a recipient would be likely to look
        for such a notice.
        
        You may add additional accurate notices of copyright ownership.
        
        Exhibit B - "Incompatible With Secondary Licenses" Notice
        ---------------------------------------------------------
        
          This Source Code Form is "Incompatible With Secondary Licenses", as
          defined by the Mozilla Public License, v. 2.0.
        
Project-URL: Homepage, https://github.com/alexandrelira99/harness_observability_layer
Project-URL: Repository, https://github.com/alexandrelira99/harness_observability_layer
Project-URL: Issues, https://github.com/alexandrelira99/harness_observability_layer/issues
Project-URL: Changelog, https://github.com/alexandrelira99/harness_observability_layer/blob/main/CHANGELOG.md
Project-URL: Security, https://github.com/alexandrelira99/harness_observability_layer/blob/main/SECURITY.md
Keywords: observability,agent,cli,codex,claude-code,jsonl
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Mozilla Public License 2.0 (MPL 2.0)
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: System :: Monitoring
Requires-Python: >=3.11
Description-Content-Type: text/markdown
License-File: LICENSE
Provides-Extra: dev
Requires-Dist: build>=1.2.2; extra == "dev"
Requires-Dist: twine>=5.1.1; extra == "dev"
Dynamic: license-file

# Harness Observability Layer

Harness Observability Layer, or HOL, is a local-first toolkit for importing agent sessions, normalizing them into canonical events, and turning them into actionable reports.

Today the project is more than a thin metrics MVP. It supports:

- importing archived Codex sessions
- importing archived Claude Code sessions
- generating canonical normalized JSONL events
- computing session summaries and richer attribution metrics
- building static HTML reporting surfaces
- comparing and summarizing sessions from the CLI
- producing project-level indexes and portfolio-style markdown views

The core idea is simple: if you already have agent session archives, HOL helps you inspect how the work happened, not just what the final answer was.

## What HOL Is Good For

Common use cases include:

- reviewing how an agent used tools, files, and skills during a session
- auditing whether edits happened before reads
- understanding token usage, cache behavior, duration, and failure rates
- comparing multiple sessions for quality or efficiency differences
- building a local artifact trail for debugging agent workflows
- generating shareable static reports without needing a running server

## Current Product Surface

HOL currently has four practical layers:

1. Importers for Codex and Claude Code archived sessions
2. A canonical event pipeline that normalizes raw session logs
3. A metrics and attribution layer that computes summaries from normalized events
4. Static reporting outputs, including a guided dashboard-style site and a project sessions index

## Install

```bash
pip install harness-observability-layer
```

This exposes the unified CLI:

```bash
hol --help
```

You can also invoke the package directly:

```bash
python -m harness_observability_layer --help
```

## Development Install

For local development from this repository:

```bash
pip install -e .
```

For release validation and packaging tooling during development:

```bash
pip install -e .[dev]
```

## Quick Start

The most common path is:

```bash
hol import latest
hol analyze latest --format markdown
```

If you are developing from this repository and want to be sure you are using the local checkout instead of an older installed package, prefer:

```bash
PYTHONPATH=src python3 -m harness_observability_layer.cli.main --project-root . import latest
```

## CLI Commands

The command surface is intentionally small and stable:

### Import

```bash
hol import session <path>
hol import latest
hol import all
hol import claude-session <path>
hol import claude-latest
hol import claude-all
```

Useful flags:

- `--reimport`
- `--no-raw-copy`
- `--no-resolve-files`

### Analyze

```bash
hol analyze session <session-id> --format markdown
hol analyze latest --format markdown
hol analyze compare <session-a> <session-b>
```

### Report

```bash
hol report html <session-id>
hol report markdown <session-id>
hol report summary <session-id> --format json
```

### Index And Review

```bash
hol list --limit 5
hol portfolio --limit 10
hol failures --min-failures 1
```

## Import Flows

### Import an existing Codex session

```bash
hol import session ~/.codex/archived_sessions/rollout-YYYY-MM-DDTHH-MM-SS-....jsonl
```

Privacy-oriented variant:

```bash
hol import session ~/.codex/archived_sessions/rollout-YYYY-MM-DDTHH-MM-SS-....jsonl --no-raw-copy --no-resolve-files
```

### Import the latest archived Codex session

```bash
hol import latest
```

Without `--archived-dir`, the generic `hol import latest` first tries Codex and automatically falls back to Claude Code when no eligible Codex session is available for the current project.

By default, HOL resolves the archive directory in this order:

1. `--archived-dir`
2. `HOL_CODEX_ARCHIVED_DIR` or `CODEX_ARCHIVED_SESSIONS_DIR`
3. auto-discovery in local defaults such as `~/.config/codex/archived_sessions`, `~/.codex/archived_sessions`, and the XDG data dir variant when `XDG_DATA_HOME` is set

This picks the most recently modified eligible `rollout-*.jsonl` from the first valid directory found.
Sessions whose recorded `cwd` points at a different directory are skipped. Sessions without a usable `cwd` are still eligible as a fallback.
If no valid archive directory is found, the command fails with a clear configuration error instead of silently importing nothing.

### Import all archived Codex sessions

```bash
hol import all
```

Without `--archived-dir`, the generic `hol import all` first tries Codex and automatically falls back to Claude Code when no eligible Codex sessions are available for the current project.

By default, existing imported session folders are skipped.
To force reimport:

```bash
hol import all --reimport
```

To pin a shared or nonstandard archive location explicitly:

```bash
hol import all --archived-dir /path/to/archived_sessions
```

### Import a Claude Code session

```bash
hol import claude-session ~/.claude/projects/<project>/<session>.jsonl
```

To import the latest Claude session from the default archive tree:

```bash
hol import claude-latest
```

Claude archive discovery follows the same precedence with source-specific configuration:

1. `--archived-dir`
2. `HOL_CLAUDE_ARCHIVED_DIR` or `CLAUDE_ARCHIVED_SESSIONS_DIR`
3. auto-discovery in local defaults such as `~/.config/claude/projects`, `~/.claude/projects`, and the XDG data dir variant when `XDG_DATA_HOME` is set

Like Codex import, Claude import filters out archived sessions whose recorded `cwd` clearly belongs to another directory. Sessions without a usable `cwd` remain eligible.

## Generated Artifacts

Each imported session creates a project-local artifact folder such as:

- `hol-artifacts/sessions/<session-name>/raw.codex.jsonl`
- `hol-artifacts/sessions/<session-name>/normalized.events.jsonl`
- `hol-artifacts/sessions/<session-name>/summary.json`
- `hol-artifacts/sessions/<session-name>/metadata.json`
- `hol-artifacts/sessions/<session-name>/report.html`
- `hol-artifacts/sessions/<session-name>/report.css`

HOL also generates the guided reporting site for each imported session under:

- `hol-artifacts/page/sessions/<session-name>/index.html`
- `hol-artifacts/page/sessions/<session-name>/workflow-trace.html`
- `hol-artifacts/page/sessions/<session-name>/qa-report.html`
- `hol-artifacts/page/sessions/<session-name>/cost-efficiency.html`
- `hol-artifacts/page/sessions/<session-name>/raw-metrics.html`
- `hol-artifacts/page/sessions/<session-name>/glossary.html`

And it refreshes the project-level landing page:

- `hol-artifacts/sessions/index.html`

## Guided Report Tabs

The guided site is the most important reporting surface in the current product.

### Workflow Trace

This is the operational overview tab for one session.
Use it to inspect:

- skill activity
- top tools
- event timeline
- attribution segments
- most-touched files

This is usually the best first page when you want to understand how a session unfolded.

### QA Report

This tab highlights quality and workflow-risk signals, including:

- edited-without-read behavior
- QA-oriented insight cards
- suspicious workflow patterns worth reviewing

### Cost & Efficiency

This tab focuses on session economics and throughput:

- token totals
- cache behavior
- cost estimates
- tokens by skill
- skill token breakdown

Use it when comparing a “good answer but expensive session” against a more efficient one.

### Raw Metrics

This tab is the audit-friendly layer.
It renders the `summary.json` content directly and pairs it with attribution tables so you can move from high-level UI back to concrete serialized metrics.

### Glossary

This tab explains the abstract reporting terms that show up in the guided site and in `summary.json`, including:

- skill segments
- boundary types
- tool calling types
- skill attribution buckets

Use it when onboarding someone new to the reporting model or when a metric label feels too internal.

## Project Landing Page

The project-level landing page at `hol-artifacts/sessions/index.html` is now a dashboard-style overview of imported sessions.

It helps answer questions like:

- which session should I open first
- which session had the most tool activity
- which one had the highest failure rate
- which session appears unusually expensive or long

From there, each row links into the guided site for that specific session.

## Security And Privacy

HOL is a local-first analysis tool.

- `hol import`, `hol analyze`, `hol report`, `hol list`, `hol portfolio`, and `hol failures` operate on local files.
- HOL does not upload imported conversations, prompts, tool outputs, or reports by default.
- HOL stores imported raw sessions and derived artifacts only in local paths you control.
- Some metrics such as `total_lines` and read coverage are optional local enrichments derived from the current filesystem state.

Privacy controls available now:

- `--no-raw-copy`
- `--no-resolve-files`
- `--redact-sensitive`

Additional review docs:

- [docs/security-and-privacy-review-plan.md](docs/security-and-privacy-review-plan.md)
- [docs/security-audit-inventory.md](docs/security-audit-inventory.md)
- [docs/release-hardening-checklist.md](docs/release-hardening-checklist.md)
- [CHANGELOG.md](CHANGELOG.md)
- [SECURITY.md](SECURITY.md)
- [CONTRIBUTING.md](CONTRIBUTING.md)
- [CODE_OF_CONDUCT.md](CODE_OF_CONDUCT.md)

## Repository-Local Runtime Wrapper

The published package centers on the `hol` CLI for imports, summaries, comparisons, and reports.
The live Codex runtime wrapper remains a repository-local helper:

```bash
PYTHONPATH=src .venv/bin/python scripts/run_codex_observed.py \
  "Say only OK" \
  --cwd /path/to/project
```

This wrapper:

- runs `codex exec --json`
- saves the raw Codex JSONL stream
- normalizes it into canonical events
- writes `summary.json`
- writes a styled `report.html`
- prints a metrics summary

By default, live runs are saved under `hol-artifacts/live_runs/run_###/`.

## Open The Reports

The generated HTML is static and does not require a server.

Recommended entry points:

- `hol-artifacts/sessions/index.html` for the project landing page
- `hol-artifacts/page/sessions/<session-name>/index.html` for the guided site of one session
- `hol-artifacts/sessions/<session-name>/report.html` for the legacy single-page report

## Citation

If you use this project in research, documentation, or derivative tooling, please cite it using [CITATION.cff](CITATION.cff).
