pathwaycom/pathway · error · RuntimeError

Persistence in airbyte connector is supported only for the c

Error message

Persistence in airbyte connector is supported only for the case of a single stream. Please use several airbyte connectors with one stream per connector to persist the state.

What it means

Error "Persistence in airbyte connector is supported only for the case of a single stream. Please use several airbyte connectors with one stream per connector to persist the state." thrown in pathwaycom/pathway.

Source

Thrown at python/pathway/io/airbyte/logic.py:231

            time_elapsed = time.time() - time_before_start
            if time_elapsed < self.refresh_interval:
                time.sleep(self.refresh_interval - time_elapsed)

    def on_stop(self):
        self.source.on_stop()

    def _sync_mode(self):
        stream = self.source.configured_catalog["streams"][0]
        sync_mode = stream["sync_mode"]
        return sync_mode

    def _seek(self, state):
        self.destination.set_state(json.loads(state.decode("utf-8")))

    def on_persisted_run(self):
        if len(self.streams) != 1:
            raise RuntimeError(
                "Persistence in airbyte connector is supported only for the case of a single stream. "
                "Please use several airbyte connectors with one stream per connector to persist the state."
            )

View on GitHub (pinned to fa2f74a464)

Solutions

1. Read only one stream per pw.io.airbyte.read call when using persistence; create a separate connector per stream otherwise.

Example fix

pw.io.airbyte.read(config_with_single_stream, persistent_id='s1')

When it happens

Trigger: Thrown at python/pathway/io/airbyte/logic.py:231 when the library encounters an invalid state.

Common situations: See trigger scenarios.

AI-assisted analysis of pathwaycom/pathway@fa2f74a464 (2026-08-15). Data as JSON: /api/errors/72e37cf976a2c665. Report an issue: GitHub.