Azure Synapse link for Dataverse - Introduction

Microsoft has made an announcement that Data Export Service (DES) will no longer be supported after November 2022. This may come as a surprise to many clients who rely on DES for data extraction, integration, and analytics purposes. Clients who depended on DES may now migrate to Azure Synapse link for Dataverse, a new option for extracting data from Dataverse environments, storing it in a data warehouse, and performing analytical and machine learning processing with the data. Azure Synapse is an enterprise analytics service that offers distributed query systems for T-SQL, streaming, and machine learning scenarios among other features. Azure Synapse link for Dataverse offers near-real-time insights on Dataverse data, as well as deep integration with other Azure services, such as CosmosDB and AzureML.

However, there are some factors to consider when switching to Azure Synapse link for Dataverse. Existing integration with external systems may require redesign, while investments in non-Microsoft analytics and ML solutions may need to be evaluated against the benefits offered by Azure Synapse. Additionally, the data engineering and analysis team will need to update their skills to be able to move to Azure Synapse. Microsoft has provided a playbook to ease the transition from DES to Azure Synapse link for Dataverse.

Overall, moving to Azure Synapse link for Dataverse can offer near-real-time insights on Dataverse data, together with big data and machine learning using Apache Spark for Azure Synapse. Clients may need to plan and budget for the move to Azure Synapse carefully.

Thanks for reading.