{"record":{"id":"b0d8737e2ed97503","repo":"sgl-project/sglang","slug":"failed-to-setup-mooncake-store-error-code-ret-c","errorCode":null,"errorMessage":"Failed to setup Mooncake store, error code: {ret_code}","messagePattern":"Failed to setup Mooncake store, error code: (.+?)","errorType":"exception","errorClass":"RuntimeError","httpStatus":null,"severity":"critical","filePath":"python/sglang/srt/mem_cache/storage/mooncake_store/mooncake_store.py","lineNumber":548,"sourceCode":"                        if not unsupported_kwargs:\n                            raise\n                        if \"tenant_id\" in unsupported_kwargs:\n                            raise RuntimeError(\n                                \"The installed Mooncake version does not support \"\n                                \"tenant_id in MooncakeDistributedStore.setup(). \"\n                                \"Please upgrade Mooncake to use non-default \"\n                                \"Mooncake tenants with SGLang.\"\n                            ) from e\n                        logger.warning(\n                            \"The installed Mooncake version does not support the \"\n                            f\"{', '.join(unsupported_kwargs)} parameter(s) in setup(). \"\n                            f\"Retrying without {', '.join(unsupported_kwargs)}. \"\n                            \"Please upgrade Mooncake to enable SSD offload support.\"\n                        )\n                        for key in unsupported_kwargs:\n                            setup_kwargs.pop(key, None)\n            if ret_code:\n                raise RuntimeError(\n                    f\"Failed to setup Mooncake store, error code: {ret_code}\"\n                )\n            logger.info(\"Mooncake store setup successfully.\")\n\n            self.local_rank = (\n                storage_config.tp_rank if storage_config is not None else 0\n            )\n            self.warmup()\n            logger.info(\"Mooncake store warmup successfully.\")\n\n            self.enable_storage_metrics = False\n            if storage_config is not None:\n                self.is_mla_backend = storage_config.is_mla_model\n                self.pp_rank = storage_config.pp_rank\n                self.pp_size = storage_config.pp_size\n                self.attn_cp_rank = storage_config.attn_cp_rank\n                self.attn_cp_size = storage_config.attn_cp_size\n                self.enable_storage_metrics = storage_config.enable_storage_metrics","sourceCodeStart":530,"sourceCodeEnd":566,"githubUrl":"https://github.com/sgl-project/sglang/blob/0132848349585cfe6aae51c4941cbae872505f8a/python/sglang/srt/mem_cache/storage/mooncake_store/mooncake_store.py#L530-L566","documentation":"MooncakeDistributedStore.setup() returned a non-zero code after the kwarg-fallback logic ran; the store (transfer engine session with the metadata service) could not be established. The numeric code is included.","triggerScenarios":"Wrong master_server_address, unreachable metadata service, unsupported protocol/device combo, or invalid setup kwargs after unsupported ones were dropped (e.g. SSD offload args removed with a warning).","commonSituations":"Mooncake master down; firewall between SGLang node and master; RDMA protocol without RDMA NIC; degraded capability after retry-without-kwargs fallback still failed.","solutions":["Confirm mooncake master/transfer-engine metadata service is up and reachable at the configured address","Match MOONCAKE_PROTOCOL to hardware (use tcp if no RDMA)","Re-check config file / env / extra_config values","Upgrade mooncake-transfer-engine and retry"],"exampleFix":null,"handlingStrategy":"retry","validationCode":"import socket\ndef addr_up(addr: str) -> bool:\n    host, _, port = addr.rpartition(':')\n    try:\n        with socket.create_connection((host, int(port)), timeout=3):\n            return True\n    except OSError:\n        return False\nassert addr_up(cfg.master_server_address)","typeGuard":null,"tryCatchPattern":"for attempt in range(3):\n    try:\n        ms = MooncakeStore(...)\n        break\n    except RuntimeError as e:\n        if 'Failed to setup Mooncake store' in str(e) and attempt < 2:\n            time.sleep(5)\n            continue\n        raise","preventionTips":["Health-check the mooncake master before launch","Validate protocol/device against available NICs","Keep transfer-engine and SGLang versions aligned"],"tags":["mooncake","setup","transfer-engine","network"],"backgroundTag":"remote-store-setup-failed","analyzedSha":"0132848349585cfe6aae51c4941cbae872505f8a","analyzedAt":"2026-08-28T05:10:05.995Z","schemaVersion":2},"datasetVersion":"2026-08-28T11:17:15.048Z"}