I tried to upload an image, but got the error IO error: Os { code: 28, kind: StorageFull, message: "No space left on device" }
I'm assuming it's a different storage area than the main database, otherwise this will fail too...
I tried to upload an image, but got the error IO error: Os { code: 28, kind: StorageFull, message: "No space left on device" }
I'm assuming it's a different storage area than the main database, otherwise this will fail too...
Turns out there is a bug with pictrs which doesn't clean up temp files. So we had ~88GB of temp data!
And since we moved to a dedicated pictrs server (so the main Lemmy procesees & DB could benefit) I didnt add that server to our monitoring š«¢
It's fixed now and I'll be adding disk monitoring once I get a moment away from $job
That's how it goes, if this was a universe where you'd monitored that, the bug wouldn't exist. Thanks for fixing š
@reddthat.com
This community is for us to chat about anything and everything, including support topics!
There is no defining specific rules for this community and it can be anything from "I do not like the weather" to "I've won the jackpot and want to give all the money away to charity!" š
Before posting, have you read the rules?
For anything else, try a search and see what turns up, if not post away!
go to feed...
@reddthat.com
This community is for us to chat about anything and everything, including support topics!
There is no defining specific rules for this community and it can be anything from "I do not like the weather" to "I've won the jackpot and want to give all the money away to charity!" š
Before posting, have you read the rules?
For anything else, try a search and see what turns up, if not post away!
go to feed...
What! We use a s3-like service for that :( Investigating
save