2
37
nulldev

@lemmy.vepta.org

nulldev 65 points 3 years ago

A significant number of subreddits shifting to private caused some expected stability issues, and we’ve been working on resolving the anticipated issue.

How in the world does setting a bunch of subs to private crash the website?

path: 0 110111, hotness: undefined, score: 65, children: 15
nulldev 45 points 3 years ago path: 0 476985 477402 478403 479954, hotness: undefined, score: 45, children: 2
nulldev 20 points 3 years ago

JPEG XL came after WebP. It's more of a successor and less of a competitor.

That said, in the world of standards, a successor is still a competitor.

path: 0 1724625 1724859 1730760, hotness: undefined, score: 20, children: 0
nulldev 16 points 3 years ago

I don't think this is a problem. It's the same on reddit where you can have multiple gaming subreddits or multiple news subreddits. Eventually the communities will consolidate.

path: 0 97606, hotness: undefined, score: 16, children: 4
nulldev 16 points 3 years ago

I see the potential but Lemmy in its current state is very buggy. There needs to be a huge uptick in dev activity to iron out all the bugs and usability issues before June 30th hits. Otherwise, I see little hope of adoption.

The performance issues also need to fixed ASAP. Sure, you could just "use a different instance" but you can't even federate with overloaded instances!

EDIT: Looks like there are a lot of fixes coming in this PR: https://github.com/LemmyNet/lemmy-ui/pull/1081

path: 0 96039, hotness: undefined, score: 16, children: 0
nulldev 13 points 3 years ago

No, you want it for scrolling. Scrolling feels much more responsive at 120Hz. It does drain battery more but not by enough to be a deal breaker for most people.

It's useless for videos as most videos are 60Hz.

path: 0 1594951 1602167, hotness: undefined, score: 13, children: 0
nulldev 8 points 3 years ago

BTW that still uses Google's proprietary gesture typing library internally: https://github.com/...

There's still no good FOSS alternative to Google's library though so it is what it is.

path: 0 1721058 1731376, hotness: undefined, score: 8, children: 4
nulldev 8 points 3 years ago path: 0 175576 182169, hotness: undefined, score: 8, children: 0
nulldev 8 points 3 years ago path: 0 1257807 1258148 1265293, hotness: undefined, score: 8, children: 2
nulldev 7 points 3 years ago

Doesn't Reddit have multireddits? Lemmy can implement the same feature.

OP mentioned this.

path: 0 97606 106671 107062, hotness: undefined, score: 7, children: 2
nulldev 7 points 3 years ago

I think there have been some API changes so you need both the new backend and the new frontend.

path: 0 290519 291776 291821 293686, hotness: undefined, score: 7, children: 0
nulldev 6 points 3 years ago

It's still bad compared to modern lossless algorithms. PNG is very old and even though PNG encoders have evolved, it is still fundamentally a decade behind modern lossless compression algorithms.

For example: JPEG XL in lossless mode compresses at least 30% better than PNG.

Also, PNG is not actually lossless in many cases. PNG only supports RGB colorspaces. If you try to store anything that's not in an RGB colorspace (e.g. a frame of a video) in a PNG, you will lose some color information as colorspace conversion is not lossless. Example of someone running into this issue: https://stackoverflow.com/q/35399677

JPEG XL supports non-RGB colorspaces so you don't have this problem.

path: 0 1724924 1727129 1727895 1730223 1731179, hotness: undefined, score: 6, children: 5
nulldev 5 points 3 years ago

New user registrations closed until tomorrow

Warning: Be careful, this might trigger this bug here: https://github.com/...

path: 0 702876, hotness: undefined, score: 5, children: 0
nulldev 5 points 3 years ago

it just predicts the next word out of likely candidates based on the previous words

An entity that can consistently predict the next word of any conversation, book, news article with extremely high accuracy is quite literally a god because it can effectively predict the future. So it is not surprising to me that GPT's performance is not consistent.

It won't even know it's written itself into a corner

It many cases it does. For example, if GPT gives you a wrong answer, you can often just send an empty message (single space) and GPT will say something like: "Looks like my previous answer was incorrect, let me try again: blah blah blah".

And until we get a new approach to LLM's, we can only improve it by adding more training data and more layers allowing it to pick out more subtle patterns in larger amounts of data.

This says nothing. You are effectively saying: "Until we can find a new approach, we can only expand on the existing approach" which is obvious.

But new approaches come all the time! Advances in tokenization come all the time. Every week there is a new paper with a new model architecture. We are not stuck in some sort of hole.

path: 0 1257807 1258148 1259742 1263944 1265986, hotness: undefined, score: 5, children: 7
nulldev 5 points 3 years ago

The issue here is that you are describing the goal of LLMs, not how they actually work. The goal of an LLM is to pick the next most likely token. However, it cannot achieve this via rudimentary statistics alone because the model simply does not have enough parameters to memorize which token is more likely to go next in all cases. So yes, the model "builds up statistics of which tokens it sees in which contexts" but it does so by building it's own internal data structures and organization systems which are complete black boxes.

Also, going "one token at a time" is only a "limitation" because LLMs are not accurate enough. If LLMs were more accurate, then generating "one token at a time" would not be an issue because the LLM would never need to backtrack.

And this limitation only exists because there isn't much research into LLMs backtracking yet! For example, you could give LLMs a "backspace" token: https://news.ycombinator.com/item?id=36425375

Have you tried that when it’s correct too? And in that case you mention it has a clean break and then start anew with token generation, allowing it to go a different path. You can see it more clearly experimenting with local LLM’s that have fewer layers to maintain the illusion.

If it's correct, then it gives a variety of responses. The space token effectively just makes it reflect on the conversation.

We’re trying to make a flying machine by improving pogo sticks. No matter how well you design the pogo stick and the spring, it will not be a flying machine.

To be clear, I do not believe LLMs are the future. But I do believe that they show us that AI research is on the right track.

Building a pogo stick is essential to building a flying machine. By building a pogo stick, you learn so much about physics. Over time, you replace the spring with some gunpowder to get a mortar. You shape the gunpowder into a tube to get a model rocket and discover the pendulum rocket fallacy. And finally, instead of gunpowder, you use liquid fuel and you get a rocket that can go into space.

path: 0 1257807 1258148 1259742 1263944 1265986 1270187 1272981, hotness: undefined, score: 5, children: 5
nulldev 5 points 3 years ago

Whoops, meant to say: "In many cases, they can accurately (critique their own work)". Thanks for correcting me!

path: 0 1257807 1258148 1265293 1266995 1267481, hotness: undefined, score: 5, children: 0
nulldev 4 points 3 years ago

Have you even read the article?

IMO it does not do a good job of disproving that "humans are stochastic parrots".

The example with the octopus isn't really about stochastic parrots. It's more about how LLMs are not multi-modal.

path: 0 1257807 1258148 1260222 1260408 1260498 1260767 1266472, hotness: undefined, score: 4, children: 0
nulldev 4 points 3 years ago

Get any equalizer app (e.g. Poweramp Equalizer).

path: 0 2308451, hotness: undefined, score: 4, children: 4
nulldev 3 points 3 years ago

I believe all comments on all communities you interact with are saved locally.

path: 0 75966 94447 96681, hotness: undefined, score: 3, children: 0
nulldev 3 points 3 years ago

The default Lemmy nginx config should handle websockets properly. Are you putting it behind a second nginx layer?

path: 0 101403, hotness: undefined, score: 3, children: 3

thanks for using Leebra!

go to feed...