Redis instances shut down?

Questions / Help
1

Hi. My project has 2 separate app instances running redis (I set them up following the redis docs). They were both shut down last night very near the same time. I just tried to fly apps restart one of them and the deploy is just hanging.

Here’s the last log lines from one of them:

2022-06-14T03:13:37.010 app[7354e5de] dfw [info] 532:M 14 Jun 2022 03:13:37.010 * Background saving started by pid 4549
2022-06-14T03:13:37.012 app[7354e5de] dfw [info] 4549:C 14 Jun 2022 03:13:37.012 * DB saved on disk
2022-06-14T03:13:37.013 app[7354e5de] dfw [info] 4549:C 14 Jun 2022 03:13:37.012 * RDB: 0 MB of memory used by copy-on-write
2022-06-14T03:13:37.111 app[7354e5de] dfw [info] 532:M 14 Jun 2022 03:13:37.111 * Background saving terminated with success
2022-06-14T03:18:38.084 app[7354e5de] dfw [info] 532:M 14 Jun 2022 03:18:38.083 * 100 changes in 300 seconds. Saving...
2022-06-14T03:18:38.084 app[7354e5de] dfw [info] 532:M 14 Jun 2022 03:18:38.084 * Background saving started by pid 4550
2022-06-14T03:18:38.086 app[7354e5de] dfw [info] 4550:C 14 Jun 2022 03:18:38.086 * DB saved on disk
2022-06-14T03:18:38.086 app[7354e5de] dfw [info] 4550:C 14 Jun 2022 03:18:38.086 * RDB: 0 MB of memory used by copy-on-write
2022-06-14T03:18:38.184 app[7354e5de] dfw [info] 532:M 14 Jun 2022 03:18:38.184 * Background saving terminated with success
2022-06-14T03:23:33.656 runner[7354e5de] dfw [info] Shutting down virtual machine
2022-06-14T03:23:33.723 app[7354e5de] dfw [info] Sending signal SIGINT to main child process w/ PID 524

I’m not sure how to determine what happened here. Can someone help?

2

We’re looking at this, just so you know, it’s not quite clear what happened just yet.

3

These got shutdown because of phantom capacity issues. The host they were on thought it was underwater on CPU. It wasn’t, though.

We’ve corrected it and, I think, made sure it won’t happen again. Are you Redis instances back?

4

Yep! Everything looks good now.