affaan-m/ECC · error · anyhow::Error

seed count exceeds 10000

Error message

seed count exceeds 10000

What it means

Guard in evaluate_paired: the explicit seed list for a paired evaluation exceeds 10,000 entries. The cap bounds runtime and memory when running each seed through both candidate and baseline evaluators.

Source

Thrown at ecc2/src/harness_eval.rs:470

#[derive(Debug, Clone, PartialEq, Serialize, Deserialize)]
pub struct PairedSample {
    pub seed: u64,
    pub candidate_score: f64,
    pub baseline_score: f64,
}

pub fn evaluate_paired(
    evaluator: &mut dyn Evaluator,
    candidate_id: &str,
    baseline_id: &str,
    seeds: &[u64],
) -> Result<Vec<PairedSample>> {
    if seeds.is_empty() {
        bail!("at least one explicit seed is required");
    }
    if seeds.len() > 10_000 {
        bail!("seed count exceeds 10000");
    }
    if seeds.iter().copied().collect::<BTreeSet<_>>().len() != seeds.len() {
        bail!("seeds must be unique");
    }
    seeds
        .iter()
        .map(|seed| {
            Ok(PairedSample {
                seed: *seed,
                candidate_score: evaluator.evaluate(candidate_id, *seed)?,
                baseline_score: evaluator.evaluate(baseline_id, *seed)?,
            })
        })
        .collect()
}

#[derive(Debug, Clone, Copy, PartialEq, Serialize, Deserialize)]
pub struct PromotionPolicy {

View on GitHub (pinned to 06c5e118c4)

Solutions

1. Reduce the seed list to at most 10000 entries.
2. Sample or shard the seeds and run multiple evaluations if more coverage is needed.

When it happens

Trigger: Thrown at ecc2/src/harness_eval.rs:470 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of affaan-m/ECC@06c5e118c4 (2026-08-18). Data as JSON: /api/errors/66f1a78fd0758730. Report an issue: GitHub.