The 'family': '6' config option is almost definitely what you need! my-redis.internal only returns IPv6 addresses, and ioredis looks for IPv4 records by default.
You can simulate your app’s DNS lookup with the fly dig command:
fly dig aaaa redis-app-name.internal -a backend-app-name