We have four SharePoint lists, where two of these lists contain lookup columns that reference data from the other two lists within the same SharePoint site. When transferring data from SharePoint to Azure Data Lake Storage using Azure Data Factory (ADF), the lists with lookup columns are not being written or saved as Parquet files in the Data Lake location. In contrast, the other SharePoint lists, which do not have lookup columns, are successfully written to the Data Lake location.

​We have four SharePoint lists, where two of these lists contain lookup columns that reference data from the other two lists within the same SharePoint site. When transferring data from SharePoint to Azure Data Lake Storage using Azure Data Factory (ADF), the lists with lookup columns are not being written or saved as Parquet files in the Data Lake location. In contrast, the other SharePoint lists, which do not have lookup columns, are successfully written to the Data Lake location.  Read More

​