{"record":{"id":"04860b9215d0adbd","repo":"apache/iceberg","slug":"unsupported-runtime-filter-04860b","errorCode":null,"errorMessage":"Unsupported runtime filter {}","messagePattern":"Unsupported runtime filter (.+?)","errorType":"console","errorClass":null,"httpStatus":null,"severity":"info","filePath":"spark/v4.2/spark/src/main/java/org/apache/iceberg/spark/source/SparkCopyOnWriteScan.java","lineNumber":121,"sourceCode":"        // so filter files only if it is beneficial\n        if (filteredLocations == null || fileLocations.size() < filteredLocations.size()) {\n          this.filteredLocations = fileLocations;\n          List<FileScanTask> filteredTasks =\n              tasks().stream()\n                  .filter(file -> fileLocations.contains(file.file().location()))\n                  .collect(Collectors.toList());\n\n          LOG.info(\n              \"{} of {} task(s) for table {} matched runtime file filter with {} location(s)\",\n              filteredTasks.size(),\n              tasks().size(),\n              table().name(),\n              fileLocations.size());\n\n          resetTasks(filteredTasks);\n        }\n      } else {\n        LOG.warn(\"Unsupported runtime filter {}\", predicate);\n      }\n    }\n  }\n\n  @Override\n  public boolean equals(Object o) {\n    if (this == o) {\n      return true;\n    }\n\n    if (o == null || getClass() != o.getClass()) {\n      return false;\n    }\n\n    SparkCopyOnWriteScan that = (SparkCopyOnWriteScan) o;\n    return table().name().equals(that.table().name())\n        && Objects.equals(table().uuid(), that.table().uuid())\n        && Objects.equals(snapshot, that.snapshot)","sourceCodeStart":103,"sourceCodeEnd":139,"githubUrl":"https://github.com/apache/iceberg/blob/86d9c8fc543e7c56c9f624eb725f76c9baff9570/spark/v4.2/spark/src/main/java/org/apache/iceberg/spark/source/SparkCopyOnWriteScan.java#L103-L139","documentation":"A WARN logged by SparkCopyOnWriteScan.filter when a Spark V2 runtime Predicate (pushed by the engine, e.g. from a DynamicFileFilter or shuffle-origin filter) cannot be converted or applied to narrow down the pre-planned tasks. The scan falls back to the unfiltered task set, so the query still returns correct results but loses the runtime-filter optimization.","triggerScenarios":"filter() receives a runtime predicate whose kind/name is not one SparkV2Filters.convert or the local filtering logic supports, or filterFilesOnMetadata is not applicable for the predicate type.","commonSituations":"Engine pushes a runtime filter on a non-partition or expression type Iceberg does not map; using Spark features that generate unsupported runtime predicates; upgrading Spark and encountering new predicate kinds.","solutions":["Verify the runtime filter targets a column type/partition field Iceberg can convert","Check the Iceberg/Spark version pair for supported runtime-filter kinds","Ignore safely if performance is acceptable — results remain correct"],"exampleFix":null,"handlingStrategy":"fallback","validationCode":null,"typeGuard":null,"tryCatchPattern":null,"preventionTips":["Keep Iceberg Spark runtime matched to your Spark version","Apply runtime filters only on supported primitive/partition columns","Benchmark scans without runtime filters to confirm the warning is harmless"],"tags":["spark","runtime-filter","performance"],"backgroundTag":"unsupported-operation","analyzedSha":"86d9c8fc543e7c56c9f624eb725f76c9baff9570","analyzedAt":"2026-09-12T00:46:39.097Z","contentChangedAt":"2026-09-12T00:46:39.097Z","schemaVersion":2},"datasetVersion":"2026-09-23T08:17:48.524Z"}