Extracting ~5m rows from D365 F&O to Fabric.

Hi, I have a table containing around 5m rows. i am connecting to that table through OData feed.

i need help with the following:

when connecting to it with a dataflow gen2, it takes around 7-8 hours which then fails due to the timeout.

when i tried connecting through a data pipeline, i create a cloud gateway following the documentation on Set up your OData connection from microsoft. i set the authentication method to OAuth2 and set up the organizational credentials, the same ones i used to connect within my dataflow gen2. when i tried connecting on my pipeline, i could not find that created connection gateway.

how can i achieve a sucessful connection?

6 comments