I have a pipeline in ADF where I am fetching data from a Common Data Model (CDM) and this pipeline has been working fine for a long time. We updated one of the Entities in the CDM with a new column of type string which I am now trying to fetch. When I import the new schema into ADF Source I find the new column but all data fetched for that column only returns null.

I have confirmed the following:

All other columns are working as before and returns data. The CSV file referred to by the CDM has values that are not null in the new column, so data exists.Data type in the schema matches the data type specified in the CDM for the new column (string)

Does anyone have an idea of what could be the issue?

I saw this post with similar issue but the data type in that case is date: https://learn.microsoft.com/en-us/answers/questions/942876/column-is-always-getting-null-values-in-adf-data-f 

​I have a pipeline in ADF where I am fetching data from a Common Data Model (CDM) and this pipeline has been working fine for a long time. We updated one of the Entities in the CDM with a new column of type string which I am now trying to fetch. When I import the new schema into ADF Source I find the new column but all data fetched for that column only returns null. I have confirmed the following:All other columns are working as before and returns data. The CSV file referred to by the CDM has values that are not null in the new column, so data exists.Data type in the schema matches the data type specified in the CDM for the new column (string)Does anyone have an idea of what could be the issue? I saw this post with similar issue but the data type in that case is date: https://learn.microsoft.com/en-us/answers/questions/942876/column-is-always-getting-null-values-in-adf-data-f   Read More

​