My home server setup

3 years ago by Behohippy to c/selfhosted

Ryzen 5900X, 64 gig DDR4-3200, 2tb ssd,10tb hdd and an RTX2070. Hosting Stable Diffusion, various llama.cpp instances with python bindings, jellyfin, sonarr, multiple modded minecraft servers, and a network file share.

Late_Settler 5 points 3 years ago

Certainly blows my collection of old junk out of the water.

Has running Stable Diffusion had a big impact on the other stuff running? I'm thinking the Minecraft servers in particular.

save

path: 0 74152, hotness: undefined, score: 5, children: 1

behohippy 2 points 3 years ago

SD mostly uses the GPU, so it's pretty light on everything else. The largest process is probably web-chat-ui with Wizard-30b model running.

save

path: 0 74152 76409, hotness: undefined, score: 2, children: 0

proycon 3 points 3 years ago

Nice, you must be into deep learning with such a setup, any particular reason the deep deep learning models and GPU run in your server rather than in a powerful desktop system? Maybe you're actively offering AI services to the outside world?

save

path: 0 96603, hotness: undefined, score: 3, children: 4

azuth 3 points 3 years ago

It is a powerful desktop system as in it's housed in a desktop case and uses a "non-server" CPU.

Which like any computer can be a server. Being a server is more of a role than a form factor even if there are form factors specifically aimed at servers (rack mounted).

save

path: 0 96603 97119, hotness: undefined, score: 3, children: 0

behohippy 2 points 3 years ago

save

path: 0 96603 98653, hotness: undefined, score: 2, children: 1

solidarity 1 point 3 years ago

Looks tidy buddy! Have fun 😊

save

path: 0 96603 98653 99362, hotness: undefined, score: 1, children: 0

behohippy 1 point 3 years ago

Yup, mostly running pretrained models for text embedding and some generative stuff. No real fine tuning.

save

path: 0 96603 167747, hotness: undefined, score: 1, children: 0

Alpagu 1 point 3 years ago

I'm very ignorant about it. I wonder if I can buy a cheap computer and turn it into a server that I can only use by keeping it on all the time?

save

path: 0 119772, hotness: undefined, score: 1, children: 4

LordChaos82 5 points 3 years ago

@Alpagu @behohippy Sure, that's how we all started. An old computer, throw proxmox in there, a few VMs and/or a docker host and you have yourself a pretty sweet homelab.

save

path: 0 119772 120723, hotness: undefined, score: 5, children: 1

Alpagu 1 point 3 years ago

Thank you for answer

save

path: 0 119772 120723 120762, hotness: undefined, score: 1, children: 0

behohippy 2 points 3 years ago

Yup, typically we get into it after upgrading an older PC or something and instead of selling the parts, just turn it into a server. You can also find all sorts of cheap/good stuff on ebay from office off-lease.

save

path: 0 119772 167728, hotness: undefined, score: 2, children: 1

Alpagu 1 point 3 years ago

Thanks for answer

save

path: 0 119772 167728 167813, hotness: undefined, score: 1, children: 0