{"record":{"id":"c39f9f6d32503008","repo":"sgl-project/sglang","slug":"lora-on-intern-s2-mobius-model-meta-mlp-routed-ban","errorCode":null,"errorMessage":"LoRA on Intern-S2-Mobius model.meta_mlp routed banks is not supported by the baseline; remove routed-expert targets or use a future bank-aware LoRA implementation.","messagePattern":"LoRA on Intern-S2-Mobius model\\.meta_mlp routed banks is not supported by the baseline; remove routed-expert targets or use a future bank-aware LoRA implementation\\.","errorType":"validation","errorClass":"ValueError","httpStatus":null,"severity":"error","filePath":"python/sglang/srt/lora/lora_manager.py","lineNumber":1002,"sourceCode":"            if (\n                parts[-1] in self.target_modules\n                or \".\".join(parts[-2:]) in self.target_modules\n            ):\n                layer_id = get_layer_id(module_name)\n                if layer_id is None:\n                    continue\n                self.lora_modules[layer_id][module_name] = self.set_lora_module(\n                    module_name, module\n                )\n                continue\n\n            if isinstance(module, (FusedMoE, InklingBatchDenseMLP)) and all(\n                x in self.target_modules for x in [\"gate_up_proj\", \"down_proj\"]\n            ):\n                layer_id = get_layer_id(module_name)\n                if layer_id is None:\n                    if module_name.startswith(\"model.meta_mlp.\"):\n                        raise ValueError(\n                            \"LoRA on Intern-S2-Mobius model.meta_mlp routed banks \"\n                            \"is not supported by the baseline; remove routed-expert \"\n                            \"targets or use a future bank-aware LoRA implementation.\"\n                        )\n                    # FusedMoE submodules outside the decoder layer hierarchy\n                    # (e.g. nested helpers under non-\".layers.\" prefixes) have\n                    # no resolvable layer id; skip them so we don't index\n                    # `self.lora_modules` with `None`.\n                    continue\n                if isinstance(module, InklingBatchDenseMLP):\n                    from sglang.srt.models.inkling_common.lora import (\n                        InklingBatchDenseMLPWithLoRA,\n                    )\n\n                    module.__class__ = InklingBatchDenseMLPWithLoRA\n                    module.initialize_lora(self.lora_backend)\n                    lora_module = module\n                else:","sourceCodeStart":984,"sourceCodeEnd":1020,"githubUrl":"https://github.com/sgl-project/sglang/blob/0132848349585cfe6aae51c4941cbae872505f8a/python/sglang/srt/lora/lora_manager.py#L984-L1020","documentation":"Raised in init_lora_modules when LoRA targets gate_up_proj/down_proj (FusedMoE/InklingBatchDenseMLP) on a module whose name cannot be mapped to a decoder layer id and which lives under model.meta_mlp. — the Intern-S2-Mobius routed expert banks. The baseline LoRA implementation only wraps per-layer modules and cannot address these routed banks, so it refuses.","triggerScenarios":"init_state on an Intern-S2-Mobius style model with --lora-target-modules (or adapter config) including gate_up_proj/down_proj such that model.meta_mlp.* routed-bank submodules match the LoRA wrapper walk.","commonSituations":"Using --lora-target-modules all or a broad module list on a model with a meta_mlp routed-bank component, unintentionally pulling the non-layer MoE banks into LoRA scope.","solutions":["Restrict --lora-target-modules to per-layer module suffixes that exclude the meta_mlp routed banks","Remove routed-expert targets from the adapter and retrain if you don't need them","Wait for / switch to a bank-aware LoRA implementation"],"exampleFix":"# before\n--lora-target-modules all\n# after\n--lora-target-modules q_proj k_proj v_proj","handlingStrategy":"validation","validationCode":"banned_context = 'intern-s2-mobius'  # or check model type\nif 'gate_up_proj' in server_args.lora_target_modules and 'down_proj' in server_args.lora_target_modules:\n    print('restrict --lora-target-modules; routed banks unsupported on this model')","typeGuard":null,"tryCatchPattern":null,"preventionTips":["Avoid --lora-target-modules all on models with meta_mlp routed banks","Scope target modules to standard per-layer projections"],"tags":["lora","intern-s2-mobius","moe","unsupported","sglang"],"backgroundTag":"unsupported-operation","analyzedSha":"0132848349585cfe6aae51c4941cbae872505f8a","analyzedAt":"2026-08-28T05:10:05.995Z","schemaVersion":2},"datasetVersion":"2026-08-28T06:17:29.519Z"}