Er, I guess that should be possible but it may indeed involve quite a few changes. Since that stack is specifically set up to be used on AWS and use its DynamoDB as its database.
Remix have another stack which is specifically configured for Fly, and to use its database: the blues stack. Would you be able to instead use that stack? That takes care of all the Fly-related stuff already: