What could be the 'gcc' of the LLM era?

4 days ago by Life is Tetris to c/programming

In the 1980's, there were no freely available C compilers (I guess Borland was inexpensive, but not free). The GNU C Compiler was the first such. The project focused on being bootstrappable, reproducibility from source with a fixed dependency chain.

Corporates took advantage of GCC, and continue to, but have also been happy that LLVM came along with its permissive licensing. LLVM was a free lunch for GPU deployment, letting corporates customize it to compile shaders without having to release the sources.

In the LLM era of mostly closed weights, closed and pirated datasets and inaccessible compute requirements, what would, or does, an open alternative look like? Or should something else be done?

Colloidal 8 points 4 days ago

Corporates took advantage of GCC

How so?

path: 0 26356291, hotness: undefined, score: 8, children: 13
tetrislife 0 points 4 days ago

Seriously? Lots of corporate software runs on Linux (or BSD). What are they, or the runtimes of their language platform, compiled using?

path: 0 26356291 26356328, hotness: undefined, score: 0, children: 12
Colloidal 20 points 4 days ago

That's not taking advantage, that's using the product as intended.

path: 0 26356291 26356328 26356360, hotness: undefined, score: 20, children: 11
alpine_jim 9 points 4 days ago

"taking advantage of" something doesn't necessarily have a negative connotation.

it often does when applied to people, but not things.

path: 0 26356291 26356328 26356360 26356682, hotness: undefined, score: 9, children: 3
Colloidal 11 points 4 days ago

It was definitely the meaning conveyed by the context though.

path: 0 26356291 26356328 26356360 26356682 26356804, hotness: undefined, score: 11, children: 2
tetrislife 5 points 3 days ago

The tragedy of the commons seems reasonable to you.

If a corporate saves $$$ by using GCC, they should give atleast $$ back (to GNU/FSF, and to SFC etc. for the other software they use), shouldn't they? And they don't. That is taking advantage in a negative sense.

path: 0 26356291 26356328 26356360 26362685, hotness: undefined, score: 5, children: 6
Colloidal 3 points 3 days ago

I see what you mean. But anyone using free software would be seen as taking advantage by that logic. While that is just how the license intended.

Just like when Intel used MINIX to create their shadow OS, the IME. MINIX is a BSD licensed project, so they were free to do with it as they pleased without returning anything to the developer or the community. Any opinions to the contrary are just developer regret in choosing the license.

path: 0 26356291 26356328 26356360 26362685 26367514, hotness: undefined, score: 3, children: 5
hendrik 7 points 3 days ago

A giant, properly ethical sourced dataset of training material, along with an AI architecture that comes without "hallucination" and an affordable GPU which can train such a model in a few weeks?

path: 0 26359402, hotness: undefined, score: 7, children: 0
mvirts 3 points 2 days ago

These peeps https://eleuther.ai/

I think there are a few similar groups but I don't follow these things closely.

path: 0 26383066, hotness: undefined, score: 3, children: 1
tetrislife 1 point a day ago

👍 the website makes a lot of the right noises.

path: 0 26383066 26395633, hotness: undefined, score: 1, children: 0
leanleft 1 point 3 days ago

not answering the question:
but i stumbled across this https://huggingface.co/...
Granite Switch 4.1 8B is a modular LLM that composes a base model, multiple adapters and an encoder together so that a single hosted endpoint can move between natural-language responses, general and specialized decisions, and speech-to-text.

path: 0 26363534, hotness: undefined, score: 1, children: 0
programming
programming

@programming.dev

login for more options
28869
3735
3332

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev


go to feed...