rohitg00/ai-engineering-from-scratch · error · ValueError

adapter returned {len(outputs)} outputs for {len(chunk)} pro

Error message

adapter returned {len(outputs)} outputs for {len(chunk)} prompts in task {task_name}

What it means

Error "adapter returned {len(outputs)} outputs for {len(chunk)} prompts in task {task_name}" thrown in rohitg00/ai-engineering-from-scratch.

Source

Thrown at phases/19-capstone-projects/49-lm-eval-harness/code/main.py:312

    batch_size: int = 8,
) -> TaskResult:
    if batch_size <= 0:
        raise ValueError(f"batch_size must be > 0, got {batch_size}")
    if not examples:
        return TaskResult(task=task_name, metric="none", score=0.0, correct=0, total=0)
    metric = examples[0].metric
    assert all(ex.metric == metric for ex in examples), f"task {task_name} mixes metrics"
    metric_fn = METRIC_FNS[metric]
    per_example: List[Dict[str, object]] = []
    correct_sum = 0.0
    total = 0
    start = time.perf_counter()
    for i in range(0, len(examples), batch_size):
        chunk = examples[i:i + batch_size]
        prompts = [ex.prompt for ex in chunk]
        outputs = adapter.generate(prompts)
        if len(outputs) != len(chunk):
            raise ValueError(
                f"adapter returned {len(outputs)} outputs for {len(chunk)} prompts in task {task_name}"
            )
        for ex, out in zip(chunk, outputs, strict=True):
            score = metric_fn(out, ex.targets, ex.extras)
            correct_sum += score
            total += 1
            per_example.append({
                "id": ex.id,
                "prompt": ex.prompt,
                "prediction": out,
                "targets": ex.targets,
                "score": score,
            })
    latency_ms = (time.perf_counter() - start) * 1000.0
    score = correct_sum / total if total else 0.0
    correct_int = int(round(correct_sum))
    return TaskResult(
        task=task_name,

View on GitHub (pinned to 39ea8a1c6d)

When it happens

Trigger: Thrown at phases/19-capstone-projects/49-lm-eval-harness/code/main.py:312 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of rohitg00/ai-engineering-from-scratch@39ea8a1c6d (2026-08-26). Data as JSON: /api/errors/a9e47244ac357946. Report an issue: GitHub.