cross-posted from: https://lemmy.world/post/52826581
cross-posted from: https://lemmy.world/post/52826581
Yeah. It's some if statements and some loops but with CUDA and matrix multiplication
Here you go: Let's build GPT: from scratch, in code, spelled out.
GPT is basically a machine that builds machines.
We understand how the machine builder works. We don't understand how the output of the machine works. Like mechanically we understand each individual sub-component works e.g. a single matrix multiplication, but we don't understand why specific weights are the value they are, or the broader macrostructure.
I don't think you realize that acting like "No we actually do understand how it works" just reveals that you don't understand the question, it does not show that the question has an answer.
Please explain what this one specific weight is, and why that value shouldn't be higher or lower.
Explain to me how a weight = an IF statement or a FOR loop
Ha, in fact it's all GOTO jumps like on a trampoline.
It's just a series of 10 trillion floats. And we don't really know what the individual floats represent and changing them degrades performance but hey
Technically. It's just if statements.
YandereGPT
It's all just NAND gates?
It was better when it was just ifs and for loops and runs on potatoes and does actually useful things.
@programming.dev
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
go to feed...
@programming.dev
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
go to feed...
And the human brain is just fatty tissue and neurons.
save