SigNoz/signoz · warning

consumer_group not found in the request

Error message

consumer_group not found in the request

What it means

Error returned by buildClickHouseQueryNetwork when the 'consumer_group' key is missing from messagingQueue.Variables, which is required to build network latency/throughput SQL for Kafka.

Source

Thrown at pkg/query-service/app/integrations/messagingQueues/kafka/translator.go:50

	queryRangeParams := &v3.QueryRangeParamsV3{
		Start:          messagingQueue.Start,
		End:            messagingQueue.End,
		Step:           defaultStepInterval,
		CompositeQuery: cq,
		Version:        "v4",
		FormatForWeb:   true,
	}

	return queryRangeParams, nil
}

func buildClickHouseQueryNetwork(messagingQueue *MessagingQueue, queueType string) (*v3.ClickHouseQuery, error) {
	start := messagingQueue.Start
	end := messagingQueue.End

	consumerGroup, ok := messagingQueue.Variables["consumer_group"]
	if !ok {
		return nil, fmt.Errorf("consumer_group not found in the request")
	}

	partitionID, ok := messagingQueue.Variables["partition"]
	if !ok {
		return nil, fmt.Errorf("partition not found in the request")
	}

	query := generateNetworkLatencyThroughputSQL(start, end, consumerGroup, partitionID, queueType)
	return &v3.ClickHouseQuery{
		Query: query,
	}, nil
}

func buildBuilderQueriesProducerBytes(
	unixMilliStart, unixMilliEnd int64,
	attributeCache *Clients,
) (map[string]*v3.BuilderQuery, error) {

View on GitHub (pinned to 5069bf80b0)

Solutions

  1. Include consumer_group in the request's variables map
  2. Set a default consumer_group in the dashboard template variable
  3. Validate required variables client-side before calling the API

Example fix

// before
Variables: map[string]string{"partition": "0"}

// after
Variables: map[string]string{"consumer_group": "my-group", "partition": "0"}
Defensive patterns

Strategy: validation

Validate before calling

if (!('consumer_group' in mq.Variables)) throw new Error('consumer_group required');

Type guard

func hasRequiredVars(v map[string]string, keys ...string) bool { for _, k := range keys { if _, ok := v[k]; !ok { return false } }; return true }

Prevention

When it happens

Trigger: Requesting Kafka network latency/throughput data (BuildQRParamsWithCache network context) without supplying a consumer_group variable in the request.

Common situations: Dashboard panels or API clients that omit template variables when the consumer group filter is unset/empty.

Related errors


AI-assisted analysis of SigNoz/signoz@5069bf80b0 (2026-08-28). Data as JSON: /api/errors/e349c1f240170aaa. Report an issue: GitHub.