You’ll need to do these redirects at an app or webserver level.
If you’re using say Rails, it’ll have an option to redirect non SSL requests to SSL (you may need to get it to pay attention to the x-proxy forward header so it can figure out the original request address).
Another option (this is what I do) is to setup some S3 buckets with redirects enabled on them then point the domain names that you want directed to them.