NousResearch/hermes-agent · error · SystemExit

ABORT (harness config error, not a result): {msg}

Error message

ABORT (harness config error, not a result): {msg}

What it means

Error "ABORT (harness config error, not a result): {msg}" thrown in NousResearch/hermes-agent.

Source

Thrown at evals/readtool/runner.py:126

        messages = convo.get("messages") or []
        result.update(_count_metrics(messages))
        result.update(
            {
                "final_response": final,
                "score": task.grade(final),
                "prompt_tokens": getattr(agent, "session_prompt_tokens", 0),
                "completion_tokens": getattr(agent, "session_completion_tokens", 0),
                "total_tokens": getattr(agent, "session_total_tokens", 0),
                "wall_s": round(time.monotonic() - t0, 1),
                "error": None,
            }
        )
    except Exception as exc:  # noqa: BLE001
        msg = f"{type(exc).__name__}: {exc}"
        if "No LLM provider configured" in str(exc) or "authentication" in str(exc).lower():
            # Harness misconfiguration, not a model result. Abort the whole
            # run rather than writing poisoned zero-score records.
            raise SystemExit(f"ABORT (harness config error, not a result): {msg}")
        result.update(
            {
                "final_response": "",
                "score": 0.0,
                "wall_s": round(time.monotonic() - t0, 1),
                "error": msg,
            }
        )
    finally:
        os.environ.clear()
        os.environ.update(old_env)
        shutil.rmtree(ws, ignore_errors=True)
        shutil.rmtree(hermes_home.parent, ignore_errors=True)
    return result


def main() -> int:
    ap = argparse.ArgumentParser()

View on GitHub (pinned to c896c09c42)

Solutions

1. Fix the harness configuration error in the message and re-run the eval.
2. Validate the eval config file against the expected schema.

When it happens

Trigger: Thrown at evals/readtool/runner.py:126 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of NousResearch/hermes-agent@c896c09c42 (2026-08-14). Data as JSON: /api/errors/1d8272a7b36e7b15. Report an issue: GitHub.