Yes, midwest.social was down this morning

3 years ago by seahorse [Ohio] to c/main

I've been trying to fix the CPU issues with the database for weeks now and I felt I had gotten close. I ran these migrations manually and the delete query deleted somewhere around 400k rows. Somehow that I've been monitoring the CPU for about an hour now and it seems to be behaving. It would spike when I upvoted anything and stay there a while. I don't want to jinx it but try out the site and let's see if it stays responsive.

My deepest apologies for the downtime and the irritating slowness of the instance since you all joined.

load all comments

gdj209 11 points 3 years ago

Appreciate the work you are doing to keep this up for us. I did want to acknowledge that the site is super fast and responsive now!

save

path: 0 224094, hotness: undefined, score: 11, children: 2

seahorse 14 points 3 years ago

Thanks! Honestly, this was the most difficult to track software issue I've ever done lol. I'm still a bit traumatized. Every time the site takes a half second longer to load my heart skips a beat because like 5 times this issue has seemed to go away but come back quickly.

save

path: 0 224094 224420, hotness: undefined, score: 14, children: 1

gdj209 4 points 3 years ago

Yeah, I totally understand that feeling!

save

path: 0 224094 224420 224816, hotness: undefined, score: 4, children: 0