{"record":{"id":"bcba2e4bca37d4c2","repo":"vllm-project/vllm","slug":"quantization-method-specified-in-the-model-config","errorCode":null,"errorMessage":"Quantization method specified in the model config ({quant_method}) does not match the quantization method specified in the `quantization` argument ({self.quantization}).","messagePattern":"Quantization method specified in the model config \\((.+?)\\) does not match the quantization method specified in the `quantization` argument \\((.+?)\\)\\.","errorType":"validation","errorClass":"ValueError","httpStatus":null,"severity":"error","filePath":"vllm/config/model.py","lineNumber":1273,"sourceCode":"                        name in get_args(me_quant.QuantizationMethods)\n                        and name not in overrides\n                    ):\n                        raise ValueError(\n                            f\"Quantization method {name} is an override but \"\n                            \"is has not been added to the `overrides` list \"\n                            \"above. This is necessary to ensure that the \"\n                            \"overrides are checked in order of preference.\"\n                        )\n                    quant_method = quantization_override\n                    self.quantization = quantization_override\n                    break\n\n            quant_method = quant_method if quant_method != \"\" else None\n            # Verify quantization configurations.\n            if self.quantization is None:\n                self.quantization = quant_method\n            elif self.quantization != quant_method:\n                raise ValueError(\n                    \"Quantization method specified in the model config \"\n                    f\"({quant_method}) does not match the quantization \"\n                    f\"method specified in the `quantization` argument \"\n                    f\"({self.quantization}).\"\n                )\n\n        if self.quantization is not None:\n            if self.quantization not in supported_quantization:\n                raise ValueError(\n                    f\"Unknown quantization method: {self.quantization}. Must \"\n                    f\"be one of {supported_quantization}.\"\n                )\n            current_platform.verify_quantization(self.quantization)\n\n        if self.quantization in me_quant.DEPRECATED_QUANTIZATION_METHODS:\n            if self.allow_deprecated_quantization:\n                logger.warning(\n                    \"The quantization method %s is deprecated \"","sourceCodeStart":1255,"sourceCodeEnd":1291,"githubUrl":"https://github.com/vllm-project/vllm/blob/c794754062d49a8fdb63ab3c5215b488b865030c/vllm/config/model.py#L1255-L1291","documentation":"Error \"Quantization method specified in the model config ({quant_method}) does not match the quantization method specified in the `quantization` argument ({self.quantization}).\" thrown in vllm-project/vllm.","triggerScenarios":"Raised at vllm/config/model.py:1273 when validation fails: Quantization method in model config does not match the `quantization` argument. Typically triggered by an incompatible or incomplete vLLM configuration, an unsupported platform/backend combination, or a runtime resource/dependency that is missing.","commonSituations":"Commonly encountered at vllm/config/model.py:1273 during vLLM startup/config validation or runtime setup when: (1) conflicting CLI flags or config fields are combined, (2) the current platform (CUDA/ROCm/CPU/XPU) or installed optional packages do not support the requested feature, or (3) a required value is absent or out of range. Resolve by correcting the configuration as described in the message, or by selecting a supported alternative.","solutions":["Align the `quantization` argument with the quantization method in the model config, or omit the override to use the model's own setting."],"exampleFix":null,"handlingStrategy":null,"validationCode":null,"typeGuard":null,"tryCatchPattern":null,"preventionTips":[],"tags":[],"backgroundTag":null,"analyzedSha":"c794754062d49a8fdb63ab3c5215b488b865030c","analyzedAt":"2026-08-14T21:17:39.825Z","schemaVersion":2},"datasetVersion":"2026-08-15T17:31:12.345Z"}