How quickly will a lemmy instance eat up storage?

3 years ago by i_lost_my_bagel to c/selfhosted

Just started self hosting this instance. Nothing on the docs mentioned anything about storage considerations.

ruud 288 points 3 years ago

This is lemmy.world after 4 weeks:

58G	pictrs
34G	postgres

save

path: 0 784410, hotness: undefined, score: 288, children: 25

i_lost_my_bagel 82 points 3 years ago

Considering this is going to be around a 5 user instance at most I think I'll be good for awhile. Thanks!

save

path: 0 784410 784481, hotness: undefined, score: 82, children: 15

manitcor 59 points 3 years ago

im running 50 users right now, subbed to A LOT of communities, seeing db growth of about 100mb per day.

save

path: 0 784410 784481 784671, hotness: undefined, score: 59, children: 12

Dran_Arcana 16 points 3 years ago

Question if you know: does a lemmy instance have to be publically accessable to work? Like, if I make an instance on my homelab can the instance "fetch" content and serve it faster locally? Could I reply to a post and have others see it? Etc

save

path: 0 784410 784481 805379, hotness: undefined, score: 16, children: 1

HappyHam 19 points 3 years ago

Now I wonder how viable it would be to support video hosting. The answer is almost certainly "God no!"

save

path: 0 784410 819480, hotness: undefined, score: 19, children: 1

GatoB 1 point 3 years ago

It is viable through other hostings

save

path: 0 784410 819480 1030847, hotness: undefined, score: 1, children: 0

Grimr0c 17 points 3 years ago

Honestly, Less than I thought!

save

path: 0 784410 785178, hotness: undefined, score: 17, children: 0

mruczek 14 points 3 years ago

Interesting, I thought it would be waaayyy more

save

path: 0 784410 784870, hotness: undefined, score: 14, children: 1

BigWigglyStyle 16 points 3 years ago

At the end of the day the vast majority of what needs to be saved is text. If media content is embedded, the the server just has to save the path to the file not the file itself.

save

path: 0 784410 784870 785375, hotness: undefined, score: 16, children: 0

myersguy 11 points 3 years ago

Wow, that is surprisingly not bad given the size of the instance!

save

path: 0 784410 815507, hotness: undefined, score: 11, children: 0

bdonvr 11 points 3 years ago

Yeah lemmy seems to use just about nothing for data storage.

save

path: 0 784410 786785, hotness: undefined, score: 11, children: 0

lightrush 5 points 3 years ago

Feels like this will benefit from some sort of fuzzy deduplication in the pictrs storage. I bet there are a lot of similar pics in there. E.g. if one pic or a gif is very similar to another, say just different quality or size, or compression, it should keep only one copy. It might already do this for the same files uploaded by different people as those can be compared trivially via hashing, but I doubt it does similarity based deduplication.

save

path: 0 784410 819716, hotness: undefined, score: 5, children: 0

jukes 1 point 3 years ago

That's not super terrible given the size of lemmy.world.

save

path: 0 784410 1670017, hotness: undefined, score: 1, children: 0