NousResearch/hermes-agent · error · SystemExit
no results for label '{label}' under {root}
Error message
no results for label '{label}' under {root} What it means
Error "no results for label '{label}' under {root}" thrown in NousResearch/hermes-agent.
Source
Thrown at evals/readtool/report.py:26
from __future__ import annotations
import argparse
import json
from collections import defaultdict
from pathlib import Path
from statistics import mean
RESULTS = Path(__file__).resolve().parent / "results"
METRICS = ["score", "api_turns", "tool_calls", "read_file_calls", "total_tokens", "wall_s"]
def load_label(label: str, model_filter: str | None) -> dict:
"""-> {model: {task_id: {metric: [values across reps]}}}"""
out: dict = defaultdict(lambda: defaultdict(lambda: defaultdict(list)))
root = RESULTS / label
if not root.is_dir():
raise SystemExit(f"no results for label '{label}' under {root}")
for model_dir in sorted(root.iterdir()):
if model_filter and model_dir.name != model_filter:
continue
for rep_file in sorted(model_dir.glob("rep*.json")):
data = json.loads(rep_file.read_text())
for rec in data["records"]:
if rec.get("error"):
# count errored task-runs as score 0 but keep them in the
# denominator; efficiency metrics excluded (not comparable)
out[model_dir.name][rec["task_id"]]["score"].append(0.0)
out[model_dir.name][rec["task_id"]]["errors"].append(1)
continue
for metric in METRICS:
if metric in rec and rec[metric] is not None:
out[model_dir.name][rec["task_id"]][metric].append(rec[metric])
return out
View on GitHub (pinned to c896c09c42)
Solutions
- Check the label matches a results directory under the given root.
- Run the eval first so results exist for that label.
When it happens
Trigger: Thrown at evals/readtool/report.py:26 when the library encounters an invalid state.
Common situations: See trigger scenarios.
AI-assisted analysis of NousResearch/hermes-agent@c896c09c42 (2026-08-14).
Data as JSON: /api/errors/59e60f60ee49b219.
Report an issue: GitHub.