vllm-project/vllm · error · RuntimeError

EPLB communicator 'nixl' supports only cuda-like devices (go

Error message

EPLB communicator 'nixl' supports only cuda-like devices (got {tensor_device_type}).

What it means

Error "EPLB communicator 'nixl' supports only cuda-like devices (got {tensor_device_type})." thrown in vllm-project/vllm.

Source

Thrown at vllm/distributed/eplb/eplb_communicator.py:753

                f"Elastic EP requires 'torch_nccl', 'pynccl', or 'nixl' "
                f"EPLB communicator (got '{backend}')."
            )
        else:
            if backend == "torch_nccl":
                logger.warning(
                    "Stateless elastic EP requires PyNCCL backend. "
                    "Forcing EPLB communicator to 'pynccl'."
                )
                backend = "pynccl"
            return _create_pynccl()

    if backend == "nixl":
        if not has_nixl():
            raise RuntimeError(
                "EPLB communicator 'nixl' requested but NIXL is unavailable."
            )
        if not (current_platform.is_cuda_alike() and tensor_device_type != "cpu"):
            raise RuntimeError(
                "EPLB communicator 'nixl' supports only cuda-like devices "
                f"(got {tensor_device_type})."
            )
        try:
            return NixlEplbCommunicator(
                cpu_group=group_coordinator.cpu_group,
                all_expert_weights=expert_weights,
                expert_buffer=expert_buffer,
                defer_remote_setup=is_stateless,
            )
        except Exception as exc:
            raise RuntimeError(
                f"Failed to initialize NixlEplbCommunicator ({exc})."
            ) from exc
    elif backend == "torch_gloo":
        return TorchDistGlooStagedEplbCommunicator(
            cpu_group=group_coordinator.cpu_group,
        )

View on GitHub (pinned to c794754062)

Solutions

1. Use a cuda-like device with the 'nixl' EPLB communicator, or select another backend.

When it happens

Trigger: Raised at vllm/distributed/eplb/eplb_communicator.py:753 when validation fails: EPLB communicator 'nixl' supports only cuda-like devices. Typically triggered by an incompatible or incomplete vLLM configuration, an unsupported platform/backend combination, or a runtime resource/dependency that is missing.

Common situations: Commonly encountered at vllm/distributed/eplb/eplb_communicator.py:753 during vLLM startup/config validation or runtime setup when: (1) conflicting CLI flags or config fields are combined, (2) the current platform (CUDA/ROCm/CPU/XPU) or installed optional packages do not support the requested feature, or (3) a required value is absent or out of range. Resolve by correcting the configuration as described in the message, or by selecting a supported alternative.

AI-assisted analysis of vllm-project/vllm@c794754062 (2026-08-14). Data as JSON: /api/errors/e134887a61b5b667. Report an issue: GitHub.