{"record":{"id":"04f39a8d82fb7cb8","repo":"apache/iceberg","slug":"unsupported-runtime-filter-04f39a","errorCode":null,"errorMessage":"Unsupported runtime filter {}","messagePattern":"Unsupported runtime filter (.+?)","errorType":"console","errorClass":null,"httpStatus":null,"severity":"info","filePath":"spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/source/SparkCopyOnWriteScan.java","lineNumber":156,"sourceCode":"        // so filter files only if it is beneficial\n        if (filteredLocations == null || fileLocations.size() < filteredLocations.size()) {\n          this.filteredLocations = fileLocations;\n          List<FileScanTask> filteredTasks =\n              tasks().stream()\n                  .filter(file -> fileLocations.contains(file.file().location()))\n                  .collect(Collectors.toList());\n\n          LOG.info(\n              \"{} of {} task(s) for table {} matched runtime file filter with {} location(s)\",\n              filteredTasks.size(),\n              tasks().size(),\n              table().name(),\n              fileLocations.size());\n\n          resetTasks(filteredTasks);\n        }\n      } else {\n        LOG.warn(\"Unsupported runtime filter {}\", predicate);\n      }\n    }\n  }\n\n  @Override\n  public boolean equals(Object o) {\n    if (this == o) {\n      return true;\n    }\n\n    if (o == null || getClass() != o.getClass()) {\n      return false;\n    }\n\n    SparkCopyOnWriteScan that = (SparkCopyOnWriteScan) o;\n    return table().name().equals(that.table().name())\n        && readSchema().equals(that.readSchema()) // compare Spark schemas to ignore field ids\n        && filterExpressions().toString().equals(that.filterExpressions().toString())","sourceCodeStart":138,"sourceCodeEnd":174,"githubUrl":"https://github.com/apache/iceberg/blob/86d9c8fc543e7c56c9f624eb725f76c9baff9570/spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/source/SparkCopyOnWriteScan.java#L138-L174","documentation":"SparkCopyOnWriteScan receives Spark runtime filters and tries to convert them to Iceberg expressions for task filtering; unsupported predicates are logged with this warning and skipped. The scan proceeds without that filter's benefit.","triggerScenarios":"filter() is called by Spark with a runtime predicate whose type SparkV2Filters.convert cannot translate (returns null).","commonSituations":"Runtime bloom/dynamic-pruning filters on complex expressions; CopL/CopU scans in MERGE/UPDATE/DELETE plans where Spark emits filter variants Iceberg doesn't map.","solutions":["Confirm the filter shape is one SparkV2Filters supports (simple column comparisons/IN)","Rewrite the statement so runtime filter keys are plain columns","Treat as informational unless scan performance regresses"],"exampleFix":null,"handlingStrategy":"fallback","validationCode":null,"typeGuard":null,"tryCatchPattern":null,"preventionTips":["Keep runtime filter keys as plain columns in MERGE/UPDATE/DELETE source joins","Accept the skipped filter if scan performance is adequate"],"tags":["spark","runtime-filter","copy-on-write","pushdown"],"backgroundTag":"unsupported-operation","analyzedSha":"86d9c8fc543e7c56c9f624eb725f76c9baff9570","analyzedAt":"2026-09-12T00:46:39.097Z","contentChangedAt":"2026-09-12T00:46:39.097Z","schemaVersion":2},"datasetVersion":"2026-09-23T08:17:48.524Z"}