pathwaycom/pathway · error · ValueError

All streams within the same 'pw.io.airbyte.read' must have t

Error message

All streams within the same 'pw.io.airbyte.read' must have the same 'sync_mode'

What it means

Error "All streams within the same 'pw.io.airbyte.read' must have the same 'sync_mode'" thrown in pathwaycom/pathway.

Source

Thrown at python/pathway/io/airbyte/__init__.py:100

    else:
        logging.info(f"Running connector {connector_name} as a Docker image")
        source = DockerAirbyteSource(
            connector=source_config["docker_image"],
            config=source_config.get("config"),
            streams=streams,
            env_vars=copy.copy(env_vars),
        )

    # Run airbyte connector locally and check streams
    global_sync_mode = None
    for stream in source.configured_catalog["streams"]:
        name = stream["stream"]["name"]
        sync_mode = stream["sync_mode"]
        if sync_mode != INCREMENTAL_SYNC_MODE and sync_mode != FULL_REFRESH_SYNC_MODE:
            raise ValueError(f"Stream {name} has unknown sync_mode: {sync_mode}")
        global_sync_mode = global_sync_mode or sync_mode
        if global_sync_mode != sync_mode:
            raise ValueError(
                "All streams within the same 'pw.io.airbyte.read' must have "
                "the same 'sync_mode'"
            )

    return source


class _AirbyteRecordSchema(Schema):
    data: dict


def read(
    config_file_path: os.PathLike | str,
    streams: Sequence[str],
    *,
    execution_type: str = "local",
    mode: Literal["streaming", "static"] = "streaming",
    env_vars: dict[str, str] | None = None,

View on GitHub (pinned to fa2f74a464)

Solutions

1. Use the same sync_mode for all streams of one pw.io.airbyte.read call, or split streams with different modes into separate reads.

Example fix

pw.io.airbyte.read(config_streams_with_same_sync_mode)

When it happens

Trigger: Thrown at python/pathway/io/airbyte/__init__.py:100 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of pathwaycom/pathway@fa2f74a464 (2026-08-15). Data as JSON: /api/errors/b2a35110c65e250a. Report an issue: GitHub.