apache/flink · error · FlinkRuntimeException
Parquet with case insensitive mode should have no duplicate
Error message
Parquet with case insensitive mode should have no duplicate key: {} What it means
Error "Parquet with case insensitive mode should have no duplicate key: {}" thrown in apache/flink.
Source
Thrown at flink-formats/flink-parquet/src/main/java/org/apache/flink/formats/parquet/ParquetVectorizedInputFormat.java:214
"{} does not exist in {}, will fill the field with null.",
fieldName,
parquetSchema);
types[i] =
ParquetSchemaConverter.convertToParquetType(
fieldName, projectedTypes[i], config);
unknownFieldsIndices.add(i);
} else {
types[i] = parquetSchema.getType(fieldName);
}
}
} else {
Map<String, Type> caseInsensitiveFieldMap = new HashMap<>();
for (Type type : parquetSchema.getFields()) {
caseInsensitiveFieldMap.compute(
type.getName().toLowerCase(Locale.ROOT),
(key, previousType) -> {
if (previousType != null) {
throw new FlinkRuntimeException(
"Parquet with case insensitive mode should have no duplicate key: "
+ key);
}
return type;
});
}
for (int i = 0; i < projectedFields.length; ++i) {
Type type =
caseInsensitiveFieldMap.get(projectedFields[i].toLowerCase(Locale.ROOT));
if (type == null) {
LOG.warn(
"{} does not exist in {}, will fill the field with null.",
projectedFields[i],
parquetSchema);
type =
ParquetSchemaConverter.convertToParquetType(
projectedFields[i].toLowerCase(Locale.ROOT),
projectedTypes[i],View on GitHub (pinned to 2f3c205e92)
Solutions
- Address the cause reported by the error message: Parquet with case insensitive mode should have no duplicate key: the reported value
- Verify the inputs, configuration values, and classpath/dependency setup related to this operation, then retry.
Example fix
Correct the condition described ("Parquet with case insensitive mode should have no duplicate key: the reported value") and rerun the job or command. When it happens
Trigger: Triggered at runtime when the operation fails because: Parquet with case insensitive mode should have no duplicate key: the reported value.
Common situations: Commonly caused by misconfiguration, missing dependencies or files, unsupported types or operations, or invalid user input leading to: Parquet with case insensitive mode should have no duplicate key: the reported value.
AI-assisted analysis of apache/flink@2f3c205e92 (2026-08-14).
Data as JSON: /api/errors/075e508064cdb7da.
Report an issue: GitHub.