Do local deploys work for you? Especially if you’re located further away from us-east-1, your remote builder may be having trouble fetching layers from heroku’s buildpacks. You might also try destroying your builder— this will create another one for your organization, and you might have better luck with it.
You might have already seen this, but you can check out a similar problem in the following thread: