Synapse Link Cosmos db – hierarchical partition key
Hi,
We are trying to implement the Synapse Link to Cosmos db. All has gone well until one container. We set the process off for this container about 7 hours ago, it still has not finished and the progress bar at the bottom has disappeared.
On the Azure Synapse Link blade, the container in question is greyed out.
The container is quite large – about 2 million documents with about 10 top level attributes which would become columns in Synapse but hundreds more attributes in complex objects.
The only other detail that I think is significant is that it has a hierarchical partition key. This has caused all sorts of issues already which is why I suspect that this is the reason that the link is either taking a very long time to enable or is going to not complete at all.
Firstly, is there any way to view the progress information other than the Azure Synapse Link blade?
Secondly, is the hierarchical nature of the partition key going to prevent us enabling the Synapse link on this container?
Finally, if the answer to my second point is no, then how long should I expect it to take to enable the link on a container of the size I have outlined?
(The container is displayed in the Synapse workspace but if I try to query it, I get the following message:
“Resolving CosmosDB path has failed with error ‘The analytical storage of collection ‘ServiceQuotes’ is pending migration at 0% completion. Please try again once the migration is complete.’.”
this is after 7 hours! I do know that progress bars can be notoriously inaccurate, but no progress at all in 7 hours!)
Any help would be much appreciated because this container is the most important of all the containers. In fact, it is the main reason we are enabling the link – so that we can view the financial information that it holds in near real-time.
Regards,
Chris
Hi, We are trying to implement the Synapse Link to Cosmos db. All has gone well until one container. We set the process off for this container about 7 hours ago, it still has not finished and the progress bar at the bottom has disappeared.On the Azure Synapse Link blade, the container in question is greyed out.The container is quite large – about 2 million documents with about 10 top level attributes which would become columns in Synapse but hundreds more attributes in complex objects.The only other detail that I think is significant is that it has a hierarchical partition key. This has caused all sorts of issues already which is why I suspect that this is the reason that the link is either taking a very long time to enable or is going to not complete at all. Firstly, is there any way to view the progress information other than the Azure Synapse Link blade?Secondly, is the hierarchical nature of the partition key going to prevent us enabling the Synapse link on this container?Finally, if the answer to my second point is no, then how long should I expect it to take to enable the link on a container of the size I have outlined? (The container is displayed in the Synapse workspace but if I try to query it, I get the following message:”Resolving CosmosDB path has failed with error ‘The analytical storage of collection ‘ServiceQuotes’ is pending migration at 0% completion. Please try again once the migration is complete.’.”this is after 7 hours! I do know that progress bars can be notoriously inaccurate, but no progress at all in 7 hours!) Any help would be much appreciated because this container is the most important of all the containers. In fact, it is the main reason we are enabling the link – so that we can view the financial information that it holds in near real-time. Regards,Chris Read More