Persistent Staging is used in a data migration so that any changes to data is persisted between migrations, and you will be provided with a complete audit log of your persisted data. This means that with each persistent staging migration, when data is changed or modified, Loome Integrate will keep both a record of the time that the data was in a particular state and insert a new data record that will show the current state of the data.
This is facilitated by two views:
|History||This view is a history of your data that has been recorded in your database by persistent staging.|
|Current||This view is the current state of your data in your target and this should be the same as the data in the source.|
This allows for immutable extract and load.
You can also use both incremental and persistent staging in a data migration task, but please note that it will take away part of the functionality of persistent staging. Incremental will only load recently modified records. The records that persistent staging will keep a history of will not be persisted unless they are included in the selected incremental staging time period. So if you decide to use persistent staging with incremental staging, you will only persist the data in the time period you have defined.
Create a new task and select Persistent Staging as your task type.
Select your source and target connectors. For the example in the following image, I have selected SQL Server for the source and target.
Choose the tables that you would like to extract and load into your target using persistent staging. In the image below, I have chosen one table and it has moved into the target section.
To configure your persistent staging task and select your key column, you will have to click on the Persistent Staging button beside your selected table.
Select your key column, which Loome Integrate will use as the unique identifier for persisted records, and then select any ignore columns.
Submit the task and you can either run it now or create a schedule that will cause it to run at a time you have chosen.
TargetSchemaand a table of
TableNamethe following objects would be created.