n8n-io/n8n · error · Error

Unknown --test-case " ". Available

Error message

Unknown --test-case "${args.testCase}". Available: ${options}

What it means

Output-validation error in evaluateWorkflowSimilarity. It fires when the uvx-launched Python similarity script finished but stdout is empty (after tolerating a non-zero exit code that still carried output), so there is no JSON to parse. The command line and any stderr are included to diagnose why the script printed nothing.

Solutions

1. Use one of the listed predefined case ids, or pass --prompts-csv with a CSV instead.
2. Run with --help or inspect loadDefaultTestCases to see available ids.
3. Check for typos or outdated ids from older runs.

When it happens

Trigger: Thrown at packages/@n8n/ai-workflow-builder.ee/evaluations/cli/index.ts:432 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of n8n-io/n8n@5ac6606e81 (2026-08-12). Data as JSON: /api/errors/9f8440ea87de3a66. Report an issue: GitHub.

Appendix: source

Thrown at packages/@n8n/ai-workflow-builder.ee/evaluations/cli/index.ts:432

}

/**
 * Load test cases from various sources.
 */
function loadTestCases(args: ReturnType<typeof parseEvaluationArgs>): TestCase[] {
	// From CSV file
	if (args.promptsCsv) {
		const testCases = loadTestCasesFromCsv(args.promptsCsv);
		return args.maxExamples ? testCases.slice(0, args.maxExamples) : testCases;
	}

	// Predefined test case by id
	if (args.testCase) {
		const defaultCases = loadDefaultTestCases();
		const match = defaultCases.find((tc) => tc.id === args.testCase);
		if (!match) {
			const options = getDefaultTestCaseIds().join(', ');
			throw new Error(`Unknown --test-case "${args.testCase}". Available: ${options}`);
		}

		const testCases: TestCase[] = [
			{
				prompt: match.prompt,
				id: match.id,
				context: { dos: args.dos, donts: args.donts },
			},
		];

		return args.maxExamples ? testCases.slice(0, args.maxExamples) : testCases;
	}

	// Single prompt from CLI
	if (args.prompt) {
		const testCases: TestCase[] = [
			{
				prompt: args.prompt,

View on GitHub (pinned to 5ac6606e81)