How to set up a custom domain with A record?

Your DNS records are right, and looks like you’ve issued (many) wildcard TLS certs (via Lets Encrypt / ISRG), too.

What’s terminating TLS? Fly edge or your application?

If you’re okay, can you also share your app’s fly.toml and the language/runtime of your application?