After several discussions with the Microsoft team and chatting with Sunil Sabat about the testing I was conducting, the conclusion was that Microsoft Fabric isn't designed for this type of singular operation. Its strength comes from the many API layers and the ability to spread tasks across many servers. Uncompressing a 10GB file doesn't fall under that area, nor does extracting over 600k smaller compressed files.
ADF Copy is a serverless PaaS solution built on various services for data movement. Fabric Copy is a SaaS version of ADF Copy, but neither can really be compared to or used for this type of singular action.
Comments