run-llama/llama_index · error · ImportError

HoneyHiveCallbackHandler is not installed. Please install it

Error message

HoneyHiveCallbackHandler is not installed. Please install it using `pip install llama-index-callbacks-honeyhive`

What it means

Raised by create_global_handler() when eval_mode is 'honeyhive' but llama-index-callbacks-honeyhive is not installed. HoneyHive is one of several optional observability integrations; the handler is imported lazily and a missing wheel is reported with the precise pip command.

Source

Thrown at llama-index-core/llama_index/core/callbacks/global_handlers.py:62

    elif eval_mode == "arize_phoenix":
        try:
            from llama_index.callbacks.arize_phoenix import (
                arize_phoenix_callback_handler,
            )  # pants: no-infer-dep
        except ImportError:
            raise ImportError(
                "ArizePhoenixCallbackHandler is not installed. "
                "Please install it using `pip install llama-index-callbacks-arize-phoenix`"
            )

        handler = arize_phoenix_callback_handler(**eval_params)
    elif eval_mode == "honeyhive":
        try:
            from llama_index.callbacks.honeyhive import (
                honeyhive_callback_handler,
            )  # pants: no-infer-dep
        except ImportError:
            raise ImportError(
                "HoneyHiveCallbackHandler is not installed. "
                "Please install it using `pip install llama-index-callbacks-honeyhive`"
            )
        handler = honeyhive_callback_handler(**eval_params)
    elif eval_mode == "promptlayer":
        try:
            from llama_index.callbacks.promptlayer import (
                PromptLayerHandler,
            )  # pants: no-infer-dep
        except ImportError:
            raise ImportError(
                "PromptLayerHandler is not installed. "
                "Please install it using `pip install llama-index-callbacks-promptlayer`"
            )
        handler = PromptLayerHandler(**eval_params)
    elif eval_mode == "deepeval":
        try:
            from llama_index.callbacks.deepeval import (

View on GitHub (pinned to afd0fef371)

Solutions

pip install llama-index-callbacks-honeyhive
Verify: python -c "from llama_index.callbacks.honeyhive import honeyhive_callback_handler"
Ensure HoneyHive API key/environment is configured if you proceed with tracing
Drop the honeyhive eval mode if it was set accidentally

Example fix

# before
set_global_handler('honeyhive', project='x')  # ImportError

# after
# pip install llama-index-callbacks-honeyhive
set_global_handler('honeyhive', project='x')

Defensive patterns

Strategy: validation

Validate before calling

import importlib.util
if importlib.util.find_spec('llama_index.callbacks.honeyhive') is None:
    raise SystemExit('pip install llama-index-callbacks-honeyhive')

Try / catch

try:
    handler = create_global_handler('honeyhive')
except ImportError as e:
    handler = None

Prevention

Pin integration package versions to avoid resolution drift
Keep a single 'tracing extras' requirements file listing all callback packages in use

When it happens

Trigger: create_global_handler('honeyhive', ...) / set_global_handler('honeyhive') with the integration wheel missing; the `from llama_index.callbacks.honeyhive import honeyhive_callback_handler` import raises ImportError.

Common situations: Copy-pasting HoneyHive tutorial code into a project that only depends on llama-index-core; forgetting the extra when moving from a notebook (where it was installed) to a clean deployment image.

Related errors

AI-assisted analysis of run-llama/llama_index@afd0fef371 (2026-08-15). Data as JSON: /api/errors/aa6b4a1933ff9f50. Report an issue: GitHub.