{"record":{"id":"407d963db99d5ee1","repo":"sgl-project/sglang","slug":"sglang-diffusion-currently-supports-autoround-auto","errorCode":null,"errorMessage":"SGLang diffusion currently supports AutoRound auto_gptq checkpoints, but got {srt_config.packing_format!r}.","messagePattern":"SGLang diffusion currently supports AutoRound auto_gptq checkpoints, but got (.+?)\\.","errorType":"exception","errorClass":"ValueError","httpStatus":null,"severity":"error","filePath":"python/sglang/multimodal_gen/runtime/layers/quantization/auto_round.py","lineNumber":45,"sourceCode":"        return \"auto-round\"\n\n    @classmethod\n    def get_supported_act_dtypes(cls) -> list[torch.dtype]:\n        return SRTConfig.get_supported_act_dtypes()\n\n    @classmethod\n    def get_min_capability(cls) -> int:\n        return SRTConfig.get_min_capability()\n\n    @classmethod\n    def get_config_filenames(cls) -> list[str]:\n        return SRTConfig.get_config_filenames()\n\n    @classmethod\n    def from_config(cls, config: dict) -> \"AutoRoundConfig\":\n        srt_config = SRTConfig.from_config(config)\n        if \"gptq\" not in srt_config.packing_format:\n            raise ValueError(\n                \"SGLang diffusion currently supports AutoRound auto_gptq \"\n                f\"checkpoints, but got {srt_config.packing_format!r}.\"\n            )\n        return cls(srt_config)\n\n    def remap_checkpoint_prefixes(self, param_names_mapping: dict) -> None:\n        mapping = get_param_names_mapping(param_names_mapping)\n        remapped: dict[str, dict] = {}\n        for prefix, layer_config in (self.srt_config.extra_config or {}).items():\n            target, _, _ = mapping(f\"{prefix}.weight\")\n            target = target.removesuffix(\".weight\")\n            previous = remapped.setdefault(target, layer_config)\n            if previous != layer_config:\n                raise ValueError(\n                    f\"AutoRound fused module {target!r} has inconsistent shard configs.\"\n                )\n\n        self.srt_config.extra_config = remapped","sourceCodeStart":27,"sourceCodeEnd":63,"githubUrl":"https://github.com/sgl-project/sglang/blob/0132848349585cfe6aae51c4941cbae872505f8a/python/sglang/multimodal_gen/runtime/layers/quantization/auto_round.py#L27-L63","documentation":"AutoRoundConfig.from_config validates the checkpoint's packing format and only accepts GPTQ-style packs; anything else raises. The SGLang diffusion runtime only implements AutoRound's auto_gptq format.","triggerScenarios":"Loading an AutoRound checkpoint whose SRTConfig packing_format does not contain \"gptq\" (e.g. \"awq\", \"exl2\", or a packed float format) via AutoRoundConfig.from_config.","commonSituations":"Exporting a model with AutoRound using a non-GPTQ packing and trying to serve it here; checkpoints quantized with a newer AutoRound default format.","solutions":["Re-quantize/export the model with AutoRound's auto_gptq packing format","Check the checkpoint's quant config to see its actual packing_format value","Use a different runtime that supports the packing format you have"],"exampleFix":null,"handlingStrategy":"validation","validationCode":"srt = SRTConfig.from_config(config)\nif \"gptq\" not in srt.packing_format:\n    raise SystemExit(\"checkpoint is not auto_gptq packed; re-export with AutoRound gptq packing\")","typeGuard":null,"tryCatchPattern":null,"preventionTips":["Check packing_format before loading AutoRound checkpoints","Export with AutoRound's auto_gptq format for this runtime"],"tags":["quantization","auto-round","checkpoint","packing-format"],"backgroundTag":"unsupported-checkpoint-format","analyzedSha":"0132848349585cfe6aae51c4941cbae872505f8a","analyzedAt":"2026-08-28T05:10:05.995Z","schemaVersion":2},"datasetVersion":"2026-08-28T06:17:29.519Z"}