sipeed/picoclaw · error

invalid --eval-mode %q: must be token or llm

Error message

invalid --eval-mode %q: must be token or llm

What it means

Error "invalid --eval-mode %q: must be token or llm" thrown in sipeed/picoclaw.

Source

Thrown at cmd/membench/main.go:201

	if flagLimit > 0 {
		for i := range samples {
			if len(samples[i].QA) > flagLimit {
				samples[i].QA = samples[i].QA[:flagLimit]
			}
		}
		log.Printf("Limited to %d QA per sample", flagLimit)
	}

	evalMode := strings.ToLower(strings.TrimSpace(flagEvalMode))
	var useLLM bool
	switch evalMode {
	case "token":
		useLLM = false
	case "llm":
		useLLM = true
	default:
		return fmt.Errorf("invalid --eval-mode %q: must be token or llm", flagEvalMode)
	}
	var answerClient, judgeClient *LLMClient
	if useLLM {
		opts, err := buildLLMOptions()
		if err != nil {
			return err
		}
		answerClient = NewLLMClient(opts)
		judgeClient = answerClient // default: same client
		if flagJudgeModel != "" {
			jOpts := opts // copy base settings
			jOpts.Model = flagJudgeModel
			if flagJudgeAPIBase != "" {
				jOpts.BaseURL = flagJudgeAPIBase
			}
			if flagJudgeAPIKey != "" {
				jOpts.APIKey = flagJudgeAPIKey
			}

View on GitHub (pinned to 49183d7e8d)

When it happens

Trigger: Thrown at cmd/membench/main.go:201 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of sipeed/picoclaw@49183d7e8d (2026-08-15). Data as JSON: /api/errors/35d81909dbc99a0c. Report an issue: GitHub.