mudler/LocalAI · error

error: failed to load voxtral model from %s

Error message

error: failed to load voxtral model from %s

What it means

The voxtral model file could not be loaded. Guard: verify the model path exists and is readable before loading; return a clear LoadModel error naming the path.

Source

Thrown at backend/go/voxtral/csrc/govoxtral.c:30

static char *last_result = NULL;
static int metal_initialized = 0;

int load_model(const char *model_dir) {
    if (ctx != NULL) {
        vox_free(ctx);
        ctx = NULL;
    }

#ifdef USE_METAL
    if (!metal_initialized) {
        vox_metal_init();
        metal_initialized = 1;
    }
#endif

    ctx = vox_load(model_dir);
    if (ctx == NULL) {
        fprintf(stderr, "error: failed to load voxtral model from %s\n", model_dir);
        return 1;
    }

    return 0;
}

const char *transcribe(const char *wav_path) {
    if (ctx == NULL) {
        fprintf(stderr, "error: model not loaded\n");
        return "";
    }

    if (last_result != NULL) {
        free(last_result);
        last_result = NULL;
    }

    last_result = vox_transcribe(ctx, wav_path);

View on GitHub (pinned to 44413a9d06)

Solutions

1. Verify the voxtral model path exists and is readable.
2. Confirm the model file is a valid voxtral checkpoint compatible with the shim.
3. Check disk space and memory during load.

When it happens

Trigger: Thrown at backend/go/voxtral/csrc/govoxtral.c:30 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of mudler/LocalAI@44413a9d06 (2026-08-15). Data as JSON: /api/errors/d1599c13e0536247. Report an issue: GitHub.