BerriAI/litellm · error · ValueError

api_base must be provided for Deepinfra rerank. Set in call

Error message

api_base must be provided for Deepinfra rerank. Set in call or via DEEPINFRA_API_BASE env var.

What it means

API-base resolution guard for Deepinfra rerank: no api_base was supplied in the call or via DEEPINFRA_API_BASE, so the Deepinfra rerank endpoint cannot be determined.

Source

Thrown at litellm/rerank_api/main.py:401

                optional_rerank_params=optional_rerank_params,
                logging_obj=litellm_logging_obj,
                timeout=optional_params.timeout,
                api_key=api_key,
                api_base=api_base,
                _is_async=_is_async,
                headers=headers or litellm.headers or {},
                client=client,
                model_response=model_response,
                litellm_params=rerank_litellm_params,
            )

        elif _custom_llm_provider == litellm.LlmProviders.DEEPINFRA:
            api_key = dynamic_api_key or optional_params.api_key or get_secret_str("DEEPINFRA_API_KEY")

            api_base = dynamic_api_base or optional_params.api_base or get_secret_str("DEEPINFRA_API_BASE")

            if api_base is None:
                raise ValueError(
                    "api_base must be provided for Deepinfra rerank. Set in call or via DEEPINFRA_API_BASE env var."
                )

            response = base_llm_http_handler.rerank(
                model=model,
                custom_llm_provider=_custom_llm_provider,
                provider_config=rerank_provider_config,
                optional_rerank_params=optional_rerank_params,
                logging_obj=litellm_logging_obj,
                timeout=optional_params.timeout,
                api_key=api_key,
                api_base=api_base,
                _is_async=_is_async,
                headers=headers or litellm.headers or {},
                client=client,
                model_response=model_response,
                litellm_params=rerank_litellm_params,
            )

View on GitHub (pinned to 77b7c6c40c)

Solutions

1. Pass api_base in the call or set DEEPINFRA_API_BASE.

When it happens

Trigger: Thrown at litellm/rerank_api/main.py:401 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of BerriAI/litellm@77b7c6c40c (2026-08-18). Data as JSON: /api/errors/7537829af5e8b51e. Report an issue: GitHub.