Skip to main content
Streamkap Connectors (where applicable) insert the following metadata columns into the data and destination tables:

​
Using Metadata Columns

Metadata columns enable several important patterns:
  • Delete handling: Use the __DELETED column to identify rows deleted at the source. See Delete Handling for configuration options and query patterns.
  • Deduplication: When using insert/append mode, use _STREAMKAP_TS_MS and _STREAMKAP_OFFSET to build deduplicated final-state tables. See Creating Final State Tables for examples with Snowflake Dynamic Tables, Tasks, and dbt.
  • Debugging: Use _STREAMKAP_SOURCE_TS_MS to determine when events occurred at the source, and _STREAMKAP_TS_MS to determine when Streamkap processed them. The difference indicates pipeline latency.