sgl-project/sglang · error · ValueError
Unsupported backend: , currently only support
Error message
Unsupported backend: {backend}, currently only support {self.SUPPORTED_BACKENDS} What it means
AutoRound quantization error: the requested inference backend is not one of the supported backends; the supported list is included in the message.
Solutions
- Use 'auto' or one of the names in SUPPORTED_BACKENDS
- Upgrade SGLang so the backend is registered
- Re-export the model with default backend
Example fix
// before
"quantization_config": {"backend": "itrex", ...}
// after
"quantization_config": {"backend": "auto", ...} Defensive patterns
Strategy: validation
Validate before calling
be = quant_cfg.get("backend", "auto")
assert be in AutoRoundConfig.SUPPORTED_BACKENDS or be == "auto" Type guard
def is_supported_backend(b: str) -> bool:
return b in AutoRoundConfig.SUPPORTED_BACKENDS Prevention
- Leave backend as 'auto' unless targeting a specific runtime
- Pin SGLang version matching the exporter
When it happens
Trigger: Passing backend='something' when constructing AutoRoundConfig, or a checkpoint quantization_config embedding a backend name SGLang doesn't know.
Common situations: Newer AutoRound export tools emitting new backend names, or hand-tuning config.json for a specific runtime.
Understand the failure class
Background: "Invalid value" and "allowed values are" config errors: what your library rejected and how to fix it — this error's family across 41 libraries.
Related errors
- AutoRound fused module
- Fused module ' ' requires consistent quant config for
- Fused MoE layer ' ' requires consistent quant config for…
- SGLang diffusion currently supports AutoRound auto_gptq…
- SGLang's AutoRound CPU inference path currently supports…
AI-assisted analysis of sgl-project/sglang@0132848349 (2026-08-28).
Data as JSON: /api/errors/9e3556572b5b4d36.
Report an issue: GitHub.
Appendix: source
Thrown at python/sglang/srt/layers/quantization/auto_round.py:89
) -> None:
super().__init__()
if weight_bits not in self.SUPPORTED_BITS:
raise ValueError(
f"Unsupported weight_bits: {weight_bits}, "
f"currently only support {self.SUPPORTED_BITS}"
)
if data_type not in self.SUPPORTED_DTYPES:
raise ValueError(
f"Unsupported data_type: {data_type},"
f" currently only support {self.SUPPORTED_DTYPES}"
)
if packing_format not in self.SUPPORTED_FORMATS:
raise ValueError(
f"Unsupported packing_format: {packing_format}, "
f"currently only support {self.SUPPORTED_FORMATS}"
)
if backend not in self.SUPPORTED_BACKENDS:
raise ValueError(
f"Unsupported backend: {backend}, "
f"currently only support {self.SUPPORTED_BACKENDS}"
)
self.weight_bits = weight_bits
self.group_size = group_size
self.sym = sym
self.packing_format = packing_format
self.block_name_to_quantize = (
block_name_to_quantize.split(",")
if isinstance(block_name_to_quantize, str)
else block_name_to_quantize
)
self.extra_config = extra_config
self.data_type = data_type
self.backend = backend
self.pack_factor = Fraction(32, weight_bits)
self.lm_head_quantized = lm_head_quantizedView on GitHub (pinned to 0132848349)