Not possible today.
You can however deploy two Fly apps (one that uses Fly-terminated TLS and the other that doesn’t). That’s what we do.
It’d be rad to be able to do so, but requires changes to the way Fly proxy works. Possibly, sniffing SNI (optionally, making it compliant with the ECH standard) and deciding whether to terminate TLS or pass it through.
cc: @jerome