Hi all,

We have a pipeline scheduled to run at night and there have been many timed out errors. The dataflow usually only takes only 7 minutes but it failed after 2 hours by timing out. But it is sucessful when re-ran and the dataflow took only 6 min 45 sec. I can only see below details. 

The dataflow has source as table in databricks and target as synapse. Source has 198K records and target has 82.1M. What can be the cause?

​Hi all, We have a pipeline scheduled to run at night and there have been many timed out errors. The dataflow usually only takes only 7 minutes but it failed after 2 hours by timing out. But it is sucessful when re-ran and the dataflow took only 6 min 45 sec. I can only see below details. The dataflow has source as table in databricks and target as synapse. Source has 198K records and target has 82.1M. What can be the cause?  Read More

​