"app oom'd" emails - did app really OOM though?

1

Example, the email tells me this:

Out of memory: Killed process 275 (reflex) total-vm:429228kB, anon-rss:107920kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:344kB oom_score_adj:0

I provided about 512MB RAM.

(Appreciate these emails btw!)

In the meantime gonna bump the RAM to 1GB to get things up.

2

Yes. Linux kernel had to kill the reflex process, because the machine didn’t have enough memory.

3

Hi! thanks for the response. Looking through our logs a bit more… could there be two things happening here?

  • some of our apps legitimately use too much memory, get killed by OOM. Understandable.
  • other apps do not (as far as we know!). It looks as if such small apps shutdown apparently gracefully (as part of auto-stop initiated by fly). AND THEN the OOM killer log line shows up (if we were to trust the log line ordering).

Is it likely that this is the sequence of events?

  • Small app runs fine, well under memory
  • auto stop is triggered (sigint, etc)
  • app spikes memory usage ON THE WAY DOWN
  • OOM killer joins the party… kills the app (that is on the way down anyways).

I have seen multiple apps exhibit the behavior where the OOM email shows up exactly when auto-stop happens…

I’m wondering if there are any other possiblities… like “auto-stop” causing a downsizing of the VM memory on the fly… OOM then kicks in not because of app spiking mem, but the VM spiking DOWN memory capacity. Seems far fetched, but would like to rule out.

In the meantime, we just gave all our apps more memory. Just more for understanding… any tidbit of info you can offer would be really helpful.

4

Auto-stop (or shutting-down VMs) wouldn’t downsize the memory of the VM itself. However, apps may take more memory during shutdown. It really depends on the way apps work though.

I’d take some memory profile first to understand the memory usage of the apps.

5

Awesome thanks, we will pursue this further on our side.

6

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.