BerriAI/litellm · error · Exception

Failed to load prompt version '{prompt_version_id}' from Ari

Error message

Failed to load prompt version '{prompt_version_id}' from Arize Phoenix: {e}

What it means

Error "Failed to load prompt version '{prompt_version_id}' from Arize Phoenix: {e}" thrown in BerriAI/litellm.

Source

Thrown at litellm/integrations/arize/arize_phoenix_prompt_manager.py:108

        )

        # Load prompt from Arize Phoenix if prompt_id is provided
        if self.prompt_id:
            self._load_prompt_from_arize(self.prompt_id)

    def _load_prompt_from_arize(self, prompt_version_id: str) -> None:
        """Load a specific prompt version from Arize Phoenix."""
        try:
            # Fetch the prompt version from Arize Phoenix
            prompt_data: Final = self.arize_client.get_prompt_version(prompt_version_id)

            if prompt_data:
                template: Final = self._parse_prompt_data(prompt_data, prompt_version_id)
                self.prompts[prompt_version_id] = template
            else:
                raise ValueError(f"Prompt version '{prompt_version_id}' not found")
        except Exception as e:
            raise Exception(f"Failed to load prompt version '{prompt_version_id}' from Arize Phoenix: {e}")

    def _parse_prompt_data(self, data: dict[str, Any], prompt_version_id: str) -> ArizePhoenixPromptTemplate:
        """Parse Arize Phoenix prompt data and extract messages and metadata."""
        template_data: Final = data.get("template", {})
        messages: Final = template_data.get("messages", [])

        # Extract invocation parameters
        invocation_params: Final = data.get("invocation_parameters", {})
        provider_params = {}

        # Extract provider-specific parameters
        if "openai" in invocation_params:
            provider_params = invocation_params["openai"]
        elif "anthropic" in invocation_params:
            provider_params = invocation_params["anthropic"]
        else:
            # Try to find any nested provider params
            for key, value in invocation_params.items():

View on GitHub (pinned to 6c2dcb801b)

Solutions

  1. Verify the prompt_version_id and Phoenix connectivity; see the wrapped exception for details.

When it happens

Trigger: Thrown at litellm/integrations/arize/arize_phoenix_prompt_manager.py:108 when the library encounters an invalid state.

Common situations: See trigger scenarios.


AI-assisted analysis of BerriAI/litellm@6c2dcb801b (2026-08-15). Data as JSON: /api/errors/92cc72d43018800f. Report an issue: GitHub.