UTF-8 and Japanese collations support for Dedicated SQL pools is now GA!
We are excited to announce that support for UTF-8 and Japanese collations in Azure Synapse Dedicated SQL pools is now generally available!
What is UTF-8?
UTF-8 allows storing of multilingual characters in data types CHAR and VARCHAR. For UTF-16 to store those multilingual characters, the data types NCHAR and NVARCHAR were needed. This means your schema definition is with only needing to use CHAR and VARCHAR data types, even if you store multilingual characters!
Learning more about UTF-8
When your data has a mix of Latin alphabet characters and other multilingual characters, you will save space and improve performance by using UTF-8. This is because it is able to use less storage space for the Latin alphabet characters.
To learn more about UTF-8 and SQL, check out Introducing UTF-8 support for SQL Server from our SQL Server Team from when UTF-8 support was added for SQL Server.
New Japanese Character Collations
This following list of collations are now supported:
- Japanese_Bushu_Kakusu_140_BIN
- Japanese_Bushu_Kakusu_140_BIN2
- Japanese_Bushu_Kakusu_140_CI_AI_VSS
- Japanese_Bushu_Kakusu_140_CI_AI_WS_VSS
- Japanese_Bushu_Kakusu_140_CI_AI_KS_VSS
- Japanese_Bushu_Kakusu_140_CI_AI_KS_WS_VSS
- Japanese_Bushu_Kakusu_140_CI_AS_VSS
- Japanese_Bushu_Kakusu_140_CI_AS_WS_VSS
- Japanese_Bushu_Kakusu_140_CI_AS_KS_VSS
- Japanese_Bushu_Kakusu_140_CI_AS_KS_WS_VSS
- Japanese_Bushu_Kakusu_140_CS_AI_VSS
- Japanese_Bushu_Kakusu_140_CS_AI_WS_VSS
- Japanese_Bushu_Kakusu_140_CS_AI_KS_VSS
- Japanese_Bushu_Kakusu_140_CS_AI_KS_WS_VSS
- Japanese_Bushu_Kakusu_140_CS_AS_VSS
- Japanese_Bushu_Kakusu_140_CS_AS_WS_VSS
- Japanese_Bushu_Kakusu_140_CS_AS_KS_VSS
- Japanese_Bushu_Kakusu_140_CS_AS_KS_WS_VSS
- Japanese_Bushu_Kakusu_140_CI_AI
- Japanese_Bushu_Kakusu_140_CI_AI_WS
- Japanese_Bushu_Kakusu_140_CI_AI_KS
- Japanese_Bushu_Kakusu_140_CI_AI_KS_WS
- Japanese_Bushu_Kakusu_140_CI_AS
- Japanese_Bushu_Kakusu_140_CI_AS_WS
- Japanese_Bushu_Kakusu_140_CI_AS_KS
- Japanese_Bushu_Kakusu_140_CI_AS_KS_WS
- Japanese_Bushu_Kakusu_140_CS_AI
- Japanese_Bushu_Kakusu_140_CS_AI_WS
- Japanese_Bushu_Kakusu_140_CS_AI_KS
- Japanese_Bushu_Kakusu_140_CS_AI_KS_WS
- Japanese_Bushu_Kakusu_140_CS_AS
- Japanese_Bushu_Kakusu_140_CS_AS_WS
- Japanese_Bushu_Kakusu_140_CS_AS_KS
- Japanese_Bushu_Kakusu_140_CS_AS_KS_WS
- Japanese_XJIS_140_BIN
- Japanese_XJIS_140_BIN2
- Japanese_XJIS_140_CI_AI_VSS
- Japanese_XJIS_140_CI_AI_WS_VSS
- Japanese_XJIS_140_CI_AI_KS_VSS
- Japanese_XJIS_140_CI_AI_KS_WS_VSS
- Japanese_XJIS_140_CI_AS_VSS
- Japanese_XJIS_140_CI_AS_WS_VSS
- Japanese_XJIS_140_CI_AS_KS_VSS
- Japanese_XJIS_140_CI_AS_KS_WS_VSS
- Japanese_XJIS_140_CS_AI_VSS
- Japanese_XJIS_140_CS_AI_WS_VSS
- Japanese_XJIS_140_CS_AI_KS_VSS
- Japanese_XJIS_140_CS_AI_KS_WS_VSS
- Japanese_XJIS_140_CS_AS_VSS
- Japanese_XJIS_140_CS_AS_WS_VSS
- Japanese_XJIS_140_CS_AS_KS_VSS
- Japanese_XJIS_140_CS_AS_KS_WS_VSS
- Japanese_XJIS_140_CI_AI
- Japanese_XJIS_140_CI_AI_WS
- Japanese_XJIS_140_CI_AI_KS
- Japanese_XJIS_140_CI_AI_KS_WS
- Japanese_XJIS_140_CI_AS
- Japanese_XJIS_140_CI_AS_WS
- Japanese_XJIS_140_CI_AS_KS
- Japanese_XJIS_140_CI_AS_KS_WS
- Japanese_XJIS_140_CS_AI
- Japanese_XJIS_140_CS_AI_WS
- Japanese_XJIS_140_CS_AI_KS
- Japanese_XJIS_140_CS_AI_KS_WS
- Japanese_XJIS_140_CS_AS
- Japanese_XJIS_140_CS_AS_WS
- Japanese_XJIS_140_CS_AS_KS
- Japanese_XJIS_140_CS_AS_KS_WS
To learn more about collations in Synapse Dedicated SQL pools, check out Collation support - Azure Synapse Analytics.
Published on:
Learn moreWe can help you with UTF-8 and Japanese collations support for Dedicated SQL pools is now GA!
If you want help implementing, troubleshooting, or improving this product, contact us and we’ll point you in the right direction.
Related posts
We're moving!
We’re moving to the Analytics on Azure Tech Community! All new Azure Synapse Analytics content will be published there. In the next few days a...
Upgrade to Azure Synapse runtimes for Apache Spark 3.4 & previous runtimes deprecation
It is important to stay ahead of the curve and keep services up to date. That's why we encourage all Azure Synapse customers with Apache ...
ADF\Synapse Analytics - Replace Columns names using Rule based mapping in Mapping data flows
In real time, the column names from source might not be uniform, some columns will have a space in it, some other columns will not. For exampl...
Interpreting Script activity output json with Azure Data Factory\Synapse analytics
Script activity in Azure Data Factory\ Synapse analytics is very helpful to run queries against data sources mentioned here in this document.&...
Synapse Connectivity Series Part #4 - Advanced network troubleshooting and network trace analysis
Continuing the series of this blog posts I would like to go more advanced on troubleshooting connectivity issues. I would like to thank also&n...
Boost your CICD automation for Synapse SQL Serverless by taking advantage of SSDT and SqlPackage CLI
Introduction Azure Synapse Analytics Serverless SQL is a query service mostly used over the data in your data lake, for data discovery,...
Metadata-Based Ingestion in Synapse with Delta Lake
Overview The crucial first step in any ETL (extract, transform, load) process or data engineering program is ingestion, w...
Missing Fields Added to Dedicated SQL pool Diagnostic Settings Logs
Over the past year, customers have informed the team there were a set of key columns missing in the standalone Dedicated SQL pools (formerly S...
Using Azure DevOps with Synapse Workspaces to create hot fixes in production environments
Have you ever deployed a release to production only to find out a bug has escaped your testing process and now users are being severely impact...
Azure Synapse MVP Corner - March 2023
About this blog series Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the ...