vllm-project/vllm · error · ValueError

Sleep mode is not supported on current platform.

Error message

Sleep mode is not supported on current platform.

What it means

Error "Sleep mode is not supported on current platform." thrown in vllm-project/vllm.

Source

Thrown at vllm/config/model.py:596

                self.hf_token,
            )

        if (
            can_resolve_model_revision
            and self.tokenizer == self.model
            and self.tokenizer_revision == requested_revision
        ):
            self.tokenizer_revision = self.revision
        else:
            self.tokenizer_revision = resolve_revision(
                self.tokenizer,
                self.tokenizer_revision,
                self.hf_token,
            )

        if self.enable_sleep_mode:
            if not current_platform.is_sleep_mode_available():
                raise ValueError("Sleep mode is not supported on current platform.")
            if current_platform.is_cuda_alike() and not self.enable_cumem_allocator:
                logger.info_once(
                    "Enabling cumem allocator because sleep mode requires it."
                )
                self.enable_cumem_allocator = True
        if (
            self.enable_cumem_allocator
            and not current_platform.is_cumem_allocator_available()
        ):
            raise ValueError("cumem allocator is not supported on current platform.")

        hf_config = get_config(
            self.hf_config_path or self.model,
            self.trust_remote_code,
            self.revision,
            self.code_revision,
            self.config_format,
            hf_overrides_kw=hf_overrides_kw,

View on GitHub (pinned to c794754062)

Solutions

1. Do not enable sleep mode on the current platform; it is only supported on CUDA.

When it happens

Trigger: Raised at vllm/config/model.py:596 when validation fails: Sleep mode is not supported on current platform.. Typically triggered by an incompatible or incomplete vLLM configuration, an unsupported platform/backend combination, or a runtime resource/dependency that is missing.

Common situations: Commonly encountered at vllm/config/model.py:596 during vLLM startup/config validation or runtime setup when: (1) conflicting CLI flags or config fields are combined, (2) the current platform (CUDA/ROCm/CPU/XPU) or installed optional packages do not support the requested feature, or (3) a required value is absent or out of range. Resolve by correcting the configuration as described in the message, or by selecting a supported alternative.

AI-assisted analysis of vllm-project/vllm@c794754062 (2026-08-14). Data as JSON: /api/errors/b560a390be7d1d25. Report an issue: GitHub.