10th of December, 2024

Service

User and Group support

We have added support for searching for and adding users and groups from Azure Active Directory in Loome. This will simplify the process of user management. For example, you can search for a user in your directory and add this user to an application role.

This new feature requires that your organization consent to new permissions to lookup users and groups on your behalf.

We will reach out to you over the coming weeks with instructions on how you can enable this feature.

Improvements

  • Added a new type of incremental data migration mode: Changes Only.
    • This mode is suited to output on to Azure Data Lake for ingestion by downstream systems such as Databricks as it only includes just the new rows, rather than incrementally appending rows to an existing file.
    • You must update your agent to use this mode, older agents will use the classic style of incremental migration if configured for this mode.
  • Added the ability to use row version columns from SQL as the currency column in an incremental data migration.
  • Added the ability to group on columns in most lists.
  • Added parquet as an intermediary option when migrating to Azure Synapse.
  • Author details are now shown for connections.

Fixes

  • Fixed a bug where the ‘Add Schedules’ button was visible during schedule creation.
  • Fixed an issue where a job may fail to retry when configured for multiple retries and become stuck in a running state.
  • Fixed a display issue with job executions where the job runs over two days.
  • Fixed an issue where viewing logs for a job that has never executed would throw an error.
  • Fixed an issue where filtering on error tasks in a job execution would fail to show errors.
  • Fixed a display issue where action buttons were not visible on small screens in the job executions page.
  • Fixed a bug where modifying API keys did not produce a toast notification.
  • Fixed an issue with users signing in with no access were not being redirected to sign up.

Agent

This update requires agent version - 2024.12.09.1

Please download a new install script and update your agent to use new features, improvements, and fixes.

Some features listed below have already been delivered via an agent hotfix.

Improvements

  • Added a new type of incremental data migration mode: Changes Only.
    • This mode is suited to output on to Azure Data Lake for ingestion by downstream systems such as Databricks as it only includes just the new rows, rather than incrementally appending rows to an existing file.
    • You must update your agent to use this mode, older agents will use the classic style of incremental migration if configured for this mode.
  • Added the ability to use row version columns from SQL as the currency column in an incremental data migration.
  • Improved Parquet file output to better handle various data types and scenarios.
  • Added parquet as an intermediary option when migrating to Azure Synapse.
  • Updated Google BigQuery and Storage drivers, this should result in improved performance.

Fixes

  • Fixed an issue where offline logging in the agent may cause an exception.
  • Fixed a bug where timestamp columns from Snowflake may not be mapped to DatetimeOffset in SQL.