sgl-project/sglang

Documented errors, page 21 of 32. Back to sgl-project/sglang

Code / MessageTypeSeverityTags
num_token_non_padded and x must be on the same device
exception error moe, device-mismatch, cuda, validation
must be a non-empty list
validation critical minimax-h3, model-index, config-validation
pooled_projections must be provided.
validation error stable-diffusion-3, missing-argument, pooled-embedding
Prompt text file not found
exception error file-not-found, prompt-file, input-validation, filesystem
Quanto layer has incompatible scale
validation error quantization, quanto, scale, shape-validation
Ray is required for --use-ray mode. Install it with: pip…
error_code critical sglang, ray, importerror, dependency, server-launch
sleep/wake does not support FSDP inference
validation error fsdp, sleep-wake, feature-unsupported
Unexpected SD2 mid block
validation error initialization, diffusers, type-mismatch
Unknown speculative phase
validation error speculative-decoding, validation, enum-lookup
Unsupported image type
validation error image, type-error, transform, input-validation
Unsupported residual_gate_add dtype
exception error dtype, jit, residual, cuda
use_mxfp8=True is not supported in Quark MXFP4…
exception error quantization, mxfp8, mxfp4, quark, config-mismatch
vec must be 1D
validation error scheduler, tensor-shape, validation
absolute aspect ratio must be smaller than 200, got
validation error image, aspect-ratio, resize, input-validation
class_labels are required by this UNet.
validation error unet, class-conditional, missing-argument
data URI must contain a comma separator
validation error minimax-h3, data-uri, material-io, parsing
Encoder DP mode requires --dp-size > 1 and --tp-size 1; got…
validation critical startup, config, dp-size, tp-size, parallelism
Expected [F, H, W, C] uint8 video, got shape=
validation error joy-echo, video, tensor-shape, nhwc, pil
HiSparse requires one of
validation error hisparse, kv-cache-dtype, sglang, config-validation
Host reference counter is already zero.
exception error radix-cache, refcount, hicache, double-release, runtime-error
Inkling thinking parts require role='assistant'
validation error inkling, reasoning, content-parts, parser
Interleaved FC1 N must be even, got
validation error nvfp4, shape-validation, swiglu, weight-layout
Invalid format: expected a mapping from GPU id to IB device…
validation error json, config, schema, mooncake
Invalid Quanto quantization_map_base64
validation error quantization, quanto, base64, json, checkpoint-metadata
LogicalHostPool size must be page-aligned, got size=
validation error sglang, memory-pool, page-alignment, validation
material URI has an invalid base64 character
validation error minimax-h3, base64, alphabet, material-io
memory_size must be positive
validation error memory-pool, config-validation, cuda-ipc, multimodal-transport
MiniMax H3 media container format is not allowed
validation error minimax-h3, container-format, ffmpeg, unsupported-format
No model files found in
exception error model-files, checksum, path
runtime.response_format must be 'envelope' or 'raw'
validation error api, request-validation, response-format, http-400
SANA-WM streaming requires positive prompt embeds.
validation error sana-wm, streaming, prompt-embeds, conditioning, valueerror
sglang.srt.layers.attention.nsa.index_buf_accessor is…
console warning deprecation, sglang, nsa, import
Unsupported Comfy FP8 layer formats
validation error quantization, fp8, comfy, mixed-precision
verification failed for : Failed fields: \nDetails
validation error stage, verification, schema-validation
audio_projection_mode =
validation error phi4, audio, runtime-dispatch, value-error
control signal kind does not match queue kind
validation error control-signals, queue, type-mismatch
dst and src must be on the same device.
validation error device-mismatch, mamba, scatter, cuda
Failed to load the tokenizer. If the tokenizer is a custom…
exception error tokenizer, trust-remote-code, huggingface
Invalid number of contents in browser message
exception error harmony, browser-tool, message-structure, validation, sglang
Kimi expert-pack size does not match its manifest
validation critical kimi, moe, expert-pack, file-size-mismatch
Layer-sharded DSA indexer HiCache backup with page_first…
validation error dsa-hicache, layout, layer-sharding
Missing closing bracket in IPv6 address
validation error network, ipv6, parsing
mlx_call_multi operation must return a non-empty tuple or…
validation error sglang, mlx, callback, return-type, contract
Mooncake store is not initialized.
exception error mooncake, initialization, state, runtime-check
--prefill-only-disable-kv-cache currently requires the FA…
validation error sglang, attention-backend, flashattention, kv-cache, server-args
scale_shift_table must have shape [9, D]
validation error shape, ltx2, checkpoint, adaln
shape ratio must be a positive finite number
validation error minimax-h3, spatial, ratio, floating-point
TGV cute_ext output supports
validation error gemm, tgv, output-dtype, cutlass
The current scheduler class
validation error qwen-image, diffusers, scheduler, sigmas, scheduler-unsupported
The system message should be a single text.
validation error chat-api, system-message, validation
think_end_token ' ' could not be encoded by the tokenizer.
validation error reasoning, tokenizer, grammar, startup
timestep last dim must equal 9 * hidden
validation error shape, ltx2, adaln, dimension-mismatch
trtllm_mla backend can only be used with MLA models.
validation error attention-backend, trtllm, mla, server-args, valueerror
Unknown Ideogram 4 preset
validation error ideogram, preset, invalid-enum, validation
Unsupported Comfy INT8 format for
validation critical quantization, checkpoint, config-validation
All block sparse tensors must be on the same device
validation error block-sparse, device-mismatch
An exception occurred while loading
exception error multimodal, loading, input-validation
Cannot deinterleave odd gate/up dimension
exception error weight-loading, layout-conversion, shape-mismatch, interns2
Cannot resolve deferred scale_inv
exception error quantization, weight-loading, naming, mimo
--enable-ssl-refresh requires --ssl-certfile and…
validation error ssl, tls, certificate-rotation, server-args
Kimi expert-pack quant type is unsupported
validation critical kimi, moe, quantization, unsupported-dtype
Lost connection to server after
error_code error network, connection-lost, video-generation, polling, sgldiffusion
LTX-2 audio scheduler was not prepared.
exception critical ltx-2, audio-scheduler, initialization, pipeline-ordering
manually stop is only supported yet
exception error profiling, not-implemented, sglang
mask_search_files_path is required for STA_tuning mode
validation error sta, missing-argument, file-path, pipeline-ordering
{matcher_error}
exception error grammar, llguidance, structured-output
must be a list or None, got
validation error multimodal, type-validation, input-validation
pipeline_cls must inherit from ComposedPipelineBase
validation error type-error, registry, pipeline, validation, subclass
qkv_proj weight : unexpected shape ; expected sharded
exception error weight-loading, shape-mismatch, checkpoint, tensor-parallel
--quantization cannot be combined with a GGUF transformer…
validation error gguf, quantization, config-conflict, transformer-loader
The assistant's response should be a single text.
validation error chat-api, assistant-message, validation
Video not found
http warning http-404, video-generation, job-not-found, polling
Chat template is not a built-in template name or a valid…
error_code error chat-template, template-manager, file-not-found, server-args
DSpark ignores --speculative-moe-a2a-backend; with dp…
validation error speculative-decoding, dspark, moe, a2a-backend, conflicting-arguments
--enable-strict-thinking requires a grammar backend that…
validation critical grammar, configuration, strict-thinking, startup
Environment variable
console warning deprecation, environment-variables, alias, migration
Failed to decode base64 image
exception error base64, decode-error, image-input
flash_attn_varlen_func_op is out-only op…
validation error flash-attention, varlen, api-misuse, lse
Image file not found
validation error file-io, image-edit, path-validation
Invalid endpoint: must contain 'inproc' or 'tcp'
validation error kv-events, zmq, endpoint, config
kv-canary: scatter_req_token_ids offsets length
validation error kv-cache, shape-validation, csr-offsets, off-by-one
LTX2 split RoPE shape mismatch: x=
validation error rope, ltx, shape-validation
Marlin kernels require group quantization or channelwise…
validation error quantization, marlin, int4, group-quantization, strategy
min_new_tokens= is unavailable when…
validation error skip-tokenizer-init, min-new-tokens, sampling-params, sglang
MXFP8 KV cache requires torch.float8_e8m0fnu support.
exception error mxfp8, kv-cache, pytorch-version, dtype
out must not require gradients
validation error flash-attention, autograd, out-tensor, validation
Prepacked latent-frame camera_conditions require…
validation error sglang, sana-wm, chunk-plucker, prepacked-conditions, world-model
Shape mismatch: A K=
validation error nvfp4, shape-mismatch, gemm, quantization
sm_group_num must be >= 3
validation error pdmux, config, validation
tar material URI encoded header is too large
validation error minimax-h3, tar-uri, header-limit, material-io
tar material URI must contain
validation error minimax-h3, tar-uri, parsing, material-io
with shape cannot be expanded to expected shape .
validation error block-sparse, attention, shape-mismatch, broadcast
Trace file is empty.
exception error profiling, rocm, rpd, chrome-trace, sglang
Unsupported compute capability
validation error pdmux, gpu-architecture, compatibility
Unsupported split_k
exception error nsa, triton, split-k, invalid-argument
W4AFP8 shape_k = must be divisible by group_size = . Choose…
validation error humming, tensor-parallel, shape-mismatch, group-size, quantization
Weight file was not found in
exception error huggingface, weights, file-not-found
causal block prompt count must match causal block count, got
validation error causal-denoising, prompt-validation, block-config
chunk_size should be a int, or a tuple of length 2 or 3…
validation error validation, value-error, chunk-size, moba, shape
Could not open video file
exception error video, opencv, file-io, multimodal