I am currently working on fetching data from an API endpoint structured as follows: http://api.com/api/placements/{placementsid}. This endpoint allows me to retrieve data for a specific placement by using a unique placementsid.

The challenge I am facing is:

When I specify a single placementsid in the URL, the API returns data for only that specific placement.However, my objective is to retrieve data for all placements available in the system. Questions:

How can I modify my approach to fetch all placement IDs from this API endpoint?

Is there a specific method or endpoint that allows me to get a list of all placementsid values? Once I have all the placement IDs, how do I structure my pipeline to iterate over each ID and fetch the corresponding data?

What should I specify in the “Relative URL” field of my data source configuration to ensure I can dynamically fetch data for each placement ID? What are the best practices for aggregating or storing the fetched data in Azure Data Factory (ADF)?

Should I use a particular activity or sequence of activities in ADF to handle this process efficiently?

​I am currently working on fetching data from an API endpoint structured as follows: http://api.com/api/placements/{placementsid}. This endpoint allows me to retrieve data for a specific placement by using a unique placementsid.The challenge I am facing is:When I specify a single placementsid in the URL, the API returns data for only that specific placement.However, my objective is to retrieve data for all placements available in the system. Questions:How can I modify my approach to fetch all placement IDs from this API endpoint?Is there a specific method or endpoint that allows me to get a list of all placementsid values? Once I have all the placement IDs, how do I structure my pipeline to iterate over each ID and fetch the corresponding data?What should I specify in the “Relative URL” field of my data source configuration to ensure I can dynamically fetch data for each placement ID? What are the best practices for aggregating or storing the fetched data in Azure Data Factory (ADF)?Should I use a particular activity or sequence of activities in ADF to handle this process efficiently?  Read More

​