{"record":{"id":"d42726150a2ab9f5","repo":"abhigyanpatwari/GitNexus","slug":"pinned-gitnexus-runtime-version-drifted-expected","errorCode":null,"errorMessage":"pinned GitNexus runtime version drifted: expected {PINNED_GITNEXUS_VERSION}, got {package.get('version')!r}","messagePattern":"pinned GitNexus runtime version drifted: expected (.+?), got (.+?)","errorType":"exception","errorClass":"SandboxError","httpStatus":null,"severity":"error","filePath":"eval/workflow_bench/runtime_mounts.py","lineNumber":237,"sourceCode":"        ),\n        _validated_runtime_component(\n            runtime,\n            \"hooks/claude\",\n            f\"{SANDBOX_GITNEXUS}/hooks/claude\",\n            directory=True,\n        ),\n    )\n\n    entrypoint = mounts[0].source / \"cli\" / \"index.js\"\n    try:\n        entrypoint_mode = entrypoint.lstat().st_mode\n        package = json.loads(mounts[1].source.read_text())\n    except (OSError, json.JSONDecodeError) as exc:\n        raise SandboxError(f\"pinned GitNexus runtime metadata is invalid: {exc}\") from exc\n    if stat.S_ISLNK(entrypoint_mode) or not stat.S_ISREG(entrypoint_mode):\n        raise SandboxError(f\"pinned GitNexus runtime entrypoint must be regular and non-symlink: {entrypoint}\")\n    if package.get(\"version\") != PINNED_GITNEXUS_VERSION:\n        raise SandboxError(\n            \"pinned GitNexus runtime version drifted: \"\n            f\"expected {PINNED_GITNEXUS_VERSION}, got {package.get('version')!r}\"\n        )\n\n    linked_shared = mounts[2].source / \"gitnexus-shared\"\n    if not linked_shared.is_symlink() or linked_shared.resolve(strict=True) != shared:\n        raise SandboxError(\"pinned GitNexus runtime has an unexpected gitnexus-shared dependency\")\n    try:\n        shared_package = json.loads(mounts[5].source.read_text())\n    except (OSError, json.JSONDecodeError) as exc:\n        raise SandboxError(f\"pinned GitNexus shared runtime metadata is invalid: {exc}\") from exc\n    if shared_package.get(\"name\") != \"gitnexus-shared\":\n        raise SandboxError(\"pinned GitNexus shared runtime has an unexpected package identity\")\n    return mounts\n\n\ndef validate_ce_plugin_inputs(\n    arms: Sequence[str],","sourceCodeStart":219,"sourceCodeEnd":255,"githubUrl":"https://github.com/abhigyanpatwari/GitNexus/blob/d540b00184d71a896261ee02670da9a92d59d8f7/eval/workflow_bench/runtime_mounts.py#L219-L255","documentation":"The harness pins benchmark reproducibility to PINNED_GITNEXUS_VERSION (currently \"1.6.9\"). It reads gitnexus/package.json and compares the version field; any mismatch aborts the run. This guarantees every operator is benchmarking exactly the same runtime.","triggerScenarios":"The local gitnexus/package.json reports a different version than PINNED_GITNEXUS_VERSION — e.g., after `npm version patch`, switching to a release branch, or pulling a newer main.","commonSituations":"Operator bumped the package version locally; the constant was not updated after a release; running the benchmark against an unreleased checkout.","solutions":["Check out the tag or commit whose gitnexus/package.json version equals PINNED_GITNEXUS_VERSION.","If you are intentionally rebaselining, update PINNED_GITNEXUS_VERSION in eval/workflow_bench/runtime_mounts.py to match package.json and re-run."],"exampleFix":"// before\nPINNED_GITNEXUS_VERSION = \"1.6.9\"\n// after (only when rebaselining the harness)\nPINNED_GITNEXUS_VERSION = \"1.7.0\"","handlingStrategy":"validation","validationCode":"import json\nfrom pathlib import Path\nfrom eval.workflow_bench.runtime_mounts import PINNED_GITNEXUS_VERSION\n\ndef runtime_version_matches(root: Path) -> bool:\n    try:\n        return json.loads((root / \"package.json\").read_text()).get(\"version\") == PINNED_GITNEXUS_VERSION\n    except (OSError, json.JSONDecodeError):\n        return False","typeGuard":null,"tryCatchPattern":"try:\n    mounts = trusted_gitnexus_runtime_mounts()\nexcept SandboxError as exc:\n    if \"version drifted\" in str(exc):\n        # either checkout the pinned tag or update PINNED_GITNEXUS_VERSION intentionally\n        ...\n    raise","preventionTips":["Keep the checkout on the tag matching PINNED_GITNEXUS_VERSION.","When bumping the release, update PINNED_GITNEXUS_VERSION in the same PR.","Add a CI assertion comparing package.json version to the pin."],"tags":["versioning","reproducibility","gitnexus-runtime"],"backgroundTag":null,"analyzedSha":"d540b00184d71a896261ee02670da9a92d59d8f7","analyzedAt":"2026-08-12T19:50:25.132Z","schemaVersion":2},"datasetVersion":"2026-08-12T23:17:12.415Z"}