If you turn off the http handler you get TCP level load balancing. This isn’t as reliable as HTTP load balancing in our infra (we do a lot of clever stuff with retries that hide issues with the apps), but it should work decently well.
Out of curiosity, what do you gain by doing your own TLS termination?