Loading...

ADF\Synapse Analytics - Replace Columns names using Rule based mapping in Mapping data flows

ADF\Synapse Analytics - Replace Columns names using Rule based mapping in Mapping data flows

In real time, the column names from source might not be uniform, some columns will have a space in it, some other columns will not.

For example,

  • Sales Channel
  • Item Type,
  • Region
  • Country
  • Unit Price

It is a good practice to replace all the spaces in a column name before doing any transformation for easy handling. This also helps with auto mapping, when the sink column names do not come with spaces!

 

Select transformation in data flow makes it simpler to automatically detect spaces in column names and then remove them for the rest of the dataflow.

 

Consider the below source, with the given column names.

 

Screenshot 2024-01-25 at 3.11.13 PM.png

 

Here as we can see, few columns have spaces, few columns like Region and Country do not have spaces in it. 

 

Using the below configuration in select transformation, we can get rid of the spaces in the column names with a simple expression. 

 

In the Input columns, Click on Add mapping button, and choose Rule-based Mapping.

Screenshot 2024-02-22 at 4.42.57 PM.png

Then give the below expression:

on Source1's column: true()

on Name as column: replace($$,' ','')

 

Screenshot 2024-01-25 at 3.10.04 PM.png

What it does?

It will return true() for all the columns which have ' ' (space) in it and replace it with '' (no space).

Upon data preview, we get to see the below result,

 

Screenshot 2024-01-25 at 3.17.50 PM.png

 

As we are seeing here, all the columns with spaces are coming without spaces in between. 

If not for the Rule based mapping, one would have to manually remove space from all the columns. It would be a nightmare if the number of columns are more! Thanks to rule-based mapping!

Published on:

Learn more
Azure Synapse Analytics Blog articles
Azure Synapse Analytics Blog articles

Azure Synapse Analytics Blog articles

Share post:

Related posts

#PowerPlatformTip 133 – ‘SharePoint Updates with Power Automate – No Required Fields Needed’

The content provides a solution for updating specific fields in SharePoint using Power Automate without dealing with HTTP requests or unnecess...

4 hours ago

How To Extract Data From Web Page Using Power Automate

Power Automate cloud flows can be used to extract data from a web page. You ... The post How To Extract Data From Web Page Using Power Automat...

2 days ago

Dynamics 365 Business Central: Can we timely synchronize Dataverse entity changes without Power Automate? Yes, but……

Hi, Readers.Today I would like to talk about an interesting question I was asked recently, can we timely synchronize Dataverse entity changes ...

7 days ago

Using Power Automate Desktop to do automated testing Power Apps

Power Apps studio includes test tools, however these are not available when you use co-authoring. So how about automated testing your Canvas A...

7 days ago

How To Get Over 25 Emails In Power Automate

The Outlook – Get Emails (V3) action in Power Automate can get a maximum of ... The post How To Get Over 25 Emails In Power Automate app...

9 days ago

Power Automate – Use a simplified OData editor in actions like Get items and Get files

We are announcing the Use a simplified OData editor in actions like Get items and Get files feature for Power Automate. This feature introduce...

12 days ago

HTTP vs Send an HTTP Request in Power Automate

HTTP vs Send an HTTP Request in Power Automate One of my favourite actions in Power Automate is the HTTP action. However it is premium, while...

12 days ago

Power Automate – Copilot in Power Automate for desktop

We are announcing the Copilot in Power Automate for desktop feature. This feature integrates Copilot into Power Automate for desktop, giving u...

15 days ago
Stay up to date with latest Microsoft Dynamics 365 and Power Platform news!
* Yes, I agree to the privacy policy