zed-industries/zed · error · NotImplementedError

rejudge currently supports registry datasets (SWE-Atlas rf/q

Error message

rejudge currently supports registry datasets (SWE-Atlas rf/qna). Parent run dataset_kind={dataset_kind!r} is not yet supported.

What it means

Error "rejudge currently supports registry datasets (SWE-Atlas rf/qna). Parent run dataset_kind={dataset_kind!r} is not yet supported." thrown in zed-industries/zed.

Source

Thrown at crates/eval_cli/zed_eval/modal_app.py:936

            pathlib.Path("/data/runs")
            / parent["namespace"]
            / parent["experiment_name"]
            / parent["run_id"]
        )
        parent_archive = parent_dir / "harbor-job.tar.gz"
        if not parent_archive.exists():
            raise FileNotFoundError(
                f"parent run has no harbor-job.tar.gz: {parent_archive}. "
                "Rejudge needs a completed parent run with a stored job archive."
            )

        metadata = load_json(parent_dir / "run-metadata.json") or {}
        benchmark = metadata.get("benchmark") or {}
        dataset = benchmark.get("dataset") if isinstance(benchmark, dict) else {}
        dataset_kind = dataset.get("kind") if isinstance(dataset, dict) else None
        dataset_name = dataset.get("name") if isinstance(dataset, dict) else None
        if dataset_kind != "registry" or not isinstance(dataset_name, str):
            raise NotImplementedError(
                "rejudge currently supports registry datasets (SWE-Atlas rf/qna). "
                f"Parent run dataset_kind={dataset_kind!r} is not yet supported."
            )

        work = pathlib.Path("/tmp/agent-evals/rejudge") / run_id
        if work.exists():
            shutil.rmtree(work)
        extract_root = work / "parent"
        extract_root.mkdir(parents=True, exist_ok=True)
        log(f"Extracting parent archive {parent_archive}")
        with tarfile.open(parent_archive, "r:gz") as archive:
            safe_extract_archive(archive, extract_root)
        parent_job_dir = extract_root / parent["run_id"]
        if not parent_job_dir.is_dir():
            # Fall back to the single top-level dir if the arcname differs.
            candidates = [p for p in extract_root.iterdir() if p.is_dir()]
            if len(candidates) != 1:
                raise FileNotFoundError(

View on GitHub (pinned to bc538def45)

When it happens

Trigger: Thrown at crates/eval_cli/zed_eval/modal_app.py:936 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of zed-industries/zed@bc538def45 (2026-08-16). Data as JSON: /api/errors/acd142f46100924c. Report an issue: GitHub.