Skip to content

Duplicated rows / Updates are not deleted in iceberg table #318

@julien-alpaca

Description

@julien-alpaca

The sink is not deleting the previous key when receiving an update although I have those two options enabled:

    "iceberg.tables.cdc-field": "__op",
    "iceberg.tables.upsert-mode-enabled": "true",

I specified the key and partition like this:

...
    "iceberg.tables.default-id-columns": "id",
    "iceberg.tables.default-partition-by": "day(created_at)",

Looks like the sink connector won't delete records created by a debezium snapshot (__op = 'r').

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions