Revision history [back]
 | 1 | initial version |
When transferring data from MySQL to BigQuery using Google Datastream, tables without a primary key's is_deleted field can be handled in the following ways:
The data can be loaded directly into BigQuery without any changes. In this case, Datastream will create a surrogate key for the table and insert a timestamp column to indicate when each record was deleted.
If the table does not have a primary key, you may consider adding one to make the data replication easier. This can be done by selecting a unique grouping of columns to act as the primary key.
If the table cannot have a primary key, you may consider adding a new column to the table with a default value of false. This column can be used to track the is_deleted flag for each record.
Another option is to add a separate table to the database to track the is_deleted flag for each record. This table can be joined to the primary table to retrieve the latest state of each record.
Ultimately, the best solution will depend on the specific needs of your application and data structure.