Are you able to run the docker image locally without getting the ModuleNotFoundError: No module named 'tflite_runtime' error?
A 4gb+ image should be fine but a single 2gb+ layer is likely the problem. I tried to reproduce but docker keeps crashing on my machine 
What is the app doing? What type of data are you putting in the image?