If you use Azure Data Factory, Power Automate or Logic Apps you’ll be familar with the REST and HTTP connectors. These permit you to connect to remote APIs and process the result in your pipeline.

The challenge comes when it’s time to debug. Unlike local development, we can’t run Fiddler or Charles to debug headers. Instead we’re running blind.

We spent a bunch of time last year trying to figure out why the ADF REST datasource wouldn’t work with an API when Postman did. Finally we got our vendor to look in their logs: they wanted application/x-javascript. ADF sends application/json. We were trying to override, but ADF was silently ignoring the override - this restriction is now helpfully documented.