BerriAI/litellm · error · HTTPException

Unable to find Milvus vector store config.

Error message

Unable to find Milvus vector store config.

What it means

HTTPException raised on the Milvus pass-through route: no provider vector-stores config is registered for the MILVUS provider, so the Milvus endpoint/base URL and credentials cannot be resolved. The pass-through cannot forward the request to a Milvus instance.

Source

Thrown at litellm/proxy/pass_through_endpoints/llm_passthrough_endpoints.py:445

@router.api_route(
    "/milvus/{endpoint:path}",
    methods=["GET", "POST", "PUT", "DELETE", "PATCH"],
    tags=["Milvus Pass-through", "pass-through"],
)
async def milvus_proxy_route(
    endpoint: str,
    request: Request,
    fastapi_response: Response,
    user_api_key_dict: UserAPIKeyAuth = Depends(user_api_key_auth),
):
    """
    Enable using Milvus `/vectors` endpoint as a pass-through endpoint.
    """

    provider_config: Final = ProviderConfigManager.get_provider_vector_stores_config(provider=LlmProviders.MILVUS)
    if not provider_config:
        raise HTTPException(
            status_code=500,
            detail="Unable to find Milvus vector store config.",
        )

    # check if managed vector store index is used
    request_body: Final = await get_request_body(request)

    # check collectionName
    collection_name: Final = cast(str | None, request_body.get("collectionName"))
    extra_headers = {}
    base_target_url: str | None = None
    if not collection_name:
        raise HTTPException(
            status_code=400,
            detail=f"Collection name is required. Got {request_body}",
        )

    if not litellm.vector_store_index_registry or not litellm.vector_store_registry:

View on GitHub (pinned to 77b7c6c40c)

Solutions

1. Define a vector store entry with the Milvus provider in the proxy config (litellm_vector_store_registry or config.yaml vector_stores).
2. Verify the vector_store_name/collection in the request matches a configured Milvus vector store.

When it happens

Trigger: Thrown at litellm/proxy/pass_through_endpoints/llm_passthrough_endpoints.py:445 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of BerriAI/litellm@77b7c6c40c (2026-08-18). Data as JSON: /api/errors/5e51bf0df34f9221. Report an issue: GitHub.