apache/beam · error

bulk apply procces failed

Error message

bulk apply procces failed: %v

What it means

tryApplyBulk wraps the overall processErr from f.table.ApplyBulk. If the bulk-apply call itself failed (the call could not complete), it returns 'bulk apply procces failed: %v' (note the typo in the message). This is distinct from per-row failures reported in the errs slice.

Solutions

1. Read the wrapped processErr for the grpc status; retry the whole batch if the status is transient (Unavailable, DeadlineExceeded)
2. Check ctx cancellation — if the runner cancelled, treat as normal shutdown rather than a data bug
3. Reduce batch size (flush earlier than 100,000 ops) to shorten RPC duration
4. Verify connectivity/auth as in the client-creation error if it happens on every bundle

if processErr != nil {
	if isTransientGRPC(processErr) && !ctxCancelled(ctx) {
		return retryBulk(ctx, batch) // backoff + retry
	}
	return fmt.Errorf("bulk apply failed: %w", processErr)
}

When it happens

Trigger: tryApplyBulk receives a non-nil processErr from bigtable.Table.ApplyBulk (bigtable.go:269) — the bulk RPC failed wholesale: context cancelled, deadline exceeded, client closed, or connection error.

Common situations: Job cancelled by the runner mid-batch; batch deadline exceeded on a huge batch; network outage to bigtable.googleapis.com; Teardown ran before an in-flight bulk call.

Related errors

• could not apply mutation
• could not apply mutation for row key=
• one instance of bigtableio.Mutation must not have more than…
• BulkMutation took too long to close
• could not close data operations client

AI-assisted analysis of apache/beam@12126d8942 (2026-09-13). Data as JSON: /api/errors/aec9fa68159ddf97. Report an issue: GitHub.

Appendix: source

Thrown at sdks/go/pkg/beam/io/bigtableio/bigtable.go:269

		err := tryApplyBulk(f.table.ApplyBulk(ctx, rowKeysInBatch, mutationsInBatch))
		if err != nil {
			return err
		}
	}

	return nil
}

func validateMutation(mutation Mutation) error {
	if len(mutation.Ops) > 100000 {
		return fmt.Errorf("one instance of bigtableio.Mutation must not have more than 100,000 operations/mutations, see https://cloud.google.com/bigtable/docs/writes#batch")
	}
	return nil
}

func tryApplyBulk(errs []error, processErr error) error {
	if processErr != nil {
		return fmt.Errorf("bulk apply procces failed: %v", processErr)
	}
	for _, err := range errs {
		if err != nil {
			return fmt.Errorf("could not apply mutation: %v", err)
		}
	}
	return nil
}

func getBigtableMutation(mutation Mutation) *bigtable.Mutation {
	bigtableMutation := bigtable.NewMutation()
	for _, m := range mutation.Ops {
		bigtableMutation.Set(m.Family, m.Column, m.Ts, m.Value)
	}
	return bigtableMutation
}

View on GitHub (pinned to 12126d8942)