BerriAI/litellm · error · HTTPException

retrieval_config must contain 'vector_store_id'

Error message

retrieval_config must contain 'vector_store_id'

What it means

RAG query validation: retrieval_config is a valid object but contains no 'vector_store_id', so the handler has no vector store to retrieve from; rejected with 400.

Source

Thrown at litellm/proxy/rag_endpoints/endpoints.py:655

                detail={"error": "model is required"},
            )
        if not messages:
            raise HTTPException(
                status_code=400,
                detail={"error": "messages is required"},
            )
        if not retrieval_config:
            raise HTTPException(
                status_code=400,
                detail={"error": "retrieval_config is required"},
            )
        if not isinstance(retrieval_config, dict):
            raise HTTPException(
                status_code=400,
                detail={"error": "retrieval_config must be an object"},
            )
        if "vector_store_id" not in retrieval_config:
            raise HTTPException(
                status_code=400,
                detail={"error": "retrieval_config must contain 'vector_store_id'"},
            )
        await _authorize_nested_vector_store_ids(
            payload=retrieval_config,
            user_api_key_dict=user_api_key_dict,
        )

        # Add litellm data
        request_data: dict[str, object] = {}
        request_data = await add_litellm_data_to_request(
            data=request_data,
            request=request,
            general_settings=general_settings,
            user_api_key_dict=user_api_key_dict,
            version=version,
            proxy_config=proxy_config,
        )

View on GitHub (pinned to 77b7c6c40c)

Solutions

1. Include vector_store_id inside retrieval_config.

When it happens

Trigger: Thrown at litellm/proxy/rag_endpoints/endpoints.py:655 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of BerriAI/litellm@77b7c6c40c (2026-08-18). Data as JSON: /api/errors/71918c28bd58ae3b. Report an issue: GitHub.