sgl-project/sglang · error · NotImplementedError

forward_deepep branch not implemented yet

Error message

forward_deepep branch not implemented yet

What it means

Error "forward_deepep branch not implemented yet" thrown in sgl-project/sglang.

Source

Thrown at python/sglang/srt/models/gpt_oss.py:267

            config.num_local_experts,
            bias=True,
            quant_config=None,
            prefix=add_prefix("gate", prefix),
            params_dtype=config.dtype,
        )

    def forward(
        self,
        hidden_states: torch.Tensor,
        forward_batch: Optional[ForwardBatch] = None,
    ) -> torch.Tensor:
        if get_parallel().dwdp_size > 1:
            return self.forward_dwdp(hidden_states)

        if not get_moe_a2a_backend().is_deepep():
            return self.forward_normal(hidden_states)
        else:
            raise NotImplementedError("forward_deepep branch not implemented yet")

    def forward_dwdp(
        self,
        hidden_states: torch.Tensor,
    ) -> torch.Tensor:
        num_tokens = hidden_states.shape[0]
        hidden_dim_unpadded = self.hidden_size
        is_prepadded = hidden_states.shape[-1] != hidden_dim_unpadded

        if num_tokens > 0:
            router_input = (
                hidden_states[..., :hidden_dim_unpadded]
                if is_prepadded
                else hidden_states
            )
            router_logits, _ = self.router(router_input)
            topk_output = self.topk(router_input, router_logits)
            final_hidden_states = self.experts(hidden_states, topk_output)

View on GitHub (pinned to 0132848349)

When it happens

Trigger: Thrown at python/sglang/srt/models/gpt_oss.py:267 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of sgl-project/sglang@0132848349 (2026-08-28). Data as JSON: /api/errors/bde1a983d606db8f. Report an issue: GitHub.