What's the most cost-effective way to serve lots of large files
3 years ago by omegastick to c/experienced_devs
I'm looking at starting a service that involves hosting a lot of LLM models, which are often going to be 16GB+ (compressed). I did a bit of searching for cloud storage providers with cheap egress, and the cheapest I could find is $0.01 per GB, which would still be $0.16+ per download.
How do sites like Huggingface or CivitAI do it? Lots of VC funding?
@programming.dev
A community for discussion amongst professional software developers.
Posts should be relevant to those well into their careers.
For those looking to break into the industry, are hustling for their first job, or have just started their career and are looking for advice, check out:
go to feed...
@programming.dev
A community for discussion amongst professional software developers.
Posts should be relevant to those well into their careers.
For those looking to break into the industry, are hustling for their first job, or have just started their career and are looking for advice, check out:
go to feed...
R2 by cloudfare does not charge egress costs. It's 0.015$/GB/month for storage. Read operations are 0.36$ per million.
I do have a hard time believing that they will remain this cheap though, but who knows.
save