The BigQuery Data Transfer Service now supports incremental data transfers from Salesforce to BigQuery, available in Preview. Users can choose between Full or Incremental write preferences when configuring Salesforce transfers.
Transfer Options
- Full Transfer: Transfers all data from Salesforce datasets during each transfer.
- Incremental Transfer (Preview): Transfers only data changed since the last transfer, reducing the volume of data loaded.
Write Modes for Incremental Transfers
When using Incremental transfers, you must select either the Append or Upsert write mode to define how data is written to BigQuery.
Append Write Mode
- Inserts only new rows into the destination table.
- Strictly appends data without checking for duplicates, which may cause data duplication.
- Requires selecting a watermark column to track source changes.
- Recommended watermark column for Salesforce is one that only updates when a record is created (e.g.,
CreatedDate), not on subsequent updates.
For feedback or support regarding incremental transfers, users can contact dts-preview-support@google.com.
