YSK: If you're going to use AI for knowledge work, make it disagree with you
10 days ago by Artisian to c/youshouldknow
We're seeing a lot of students, teachers, and scientists produce more, and worse, outputs because of improper AI use. It's possible to use it better: Have it imitate a critic. Learning and creativity come from getting criticism and experiencing friction.
We found that when knowledge workers intentionally use AI to challenge their ideas β to generate friction β they can significantly improve their performance. Previous research on human-AI collaboration for loan evaluations had similar results.
A study I was not involved with found that creative writers produce better copy when they use AI as a sounding board rather than to ghostwrite.
Using it for learning stuff that's already well known (e.g. beginner level coding) is fine.
Using it for "knowledge work" is a bad idea idea, because AI pushes toward the mean, while research by definition is focused on new edges of knowledge. This is is exactly the space where AI will introduce biases and untruths that will be very hard to spot. Using it also reduces critical thinking ability which is critical in this space.
If you're doing knowledge work, you are an expert. You're very likely to catch biases and untruths (and those you don't catch, humanity couldn't catch. These concerns are just as applicable to a human by themselves.)
Sorry, but that's just not true. Researchers might be experts in teir field generally, but day-to-day work is very rarely focused on well-known parts of their domain, because the whole point is to obtain new knowledge.
Source: I'm a climate scientist, have been in and around academia for nearly 20 years.
Someone else I know said this in a conference and I disagree. You should instruct it to not do any extraneous language and give back data in the most impartial way possible. You should use it for things you know well so that you can see how it fails and double check any results you are going to use. Having it purpsefully be adversarial is not going to improve what you get out of it and will just waste time.
oh I won't go to links off the fediverse.
yeah. I mean copy paste is so easy. 100% agree.
Dunno, does that help other people? Every time I use it for programming and don't specifically tell it what to do, it'll just come up with assumptions. Might go the right direction. Or some random other direction and miss what'd be important factors.
Telling it for example to find issues with the following algorithm / implementation (and then copy-pasting my initial idea) has indeed helped me to find edge cases and stuff like that.
I also think there's an issue with XY-Problems. Either AI suggested X to me. Or it was my fault because I asked for X. But I've ended up in several wild goose chases before, and it's rare AI stops and points out I'm on the wrong path because I need Y.
Extraneous drivel is very annoying, though. Seems to me especially ChatGPT likes to spam multiple solutions to any question and you can often disregard the first two pages of "ideas" it came up how to NOT do it.
Or better yet, don't! Think for yourself while you still can.
yeah but you're very biased about what you think
it actually is really refreshing to get a LLM to break down your arguments and ideas
cognitive friction really gets the best out of your brain even if the AI is only averagely good at disproving your ideas
thinking for yourself and using AI isn't mutually exclusive
This is what peer review, teacher feedback, and group workshops are for. In college I didn't need an llm to critique my work. That was the job of my classmates, and mine for their writing. And for those outside of college, you can still just seek out writing circles, either irl or online. It takes some work, but you'll get better feedback from real humans who can actually feel the emotion in your writing. You can also seek out similar communities for other hobbies. The only reason for someone to pick an ai critique over a human one is convenience and the cost is way too high to justify that
I'm sure the subjects of the research mentioned in the article do all that.
I can say AI is being used for a lot of stupid wasteful things. I don't know what it costs for AI to seemingly improve our knowledge workers, but to me that is worth something.
Knowledge work is generally pretty expensive; it's done in dense places, uses a lot of air travel, has pretty big long-term consequences. Even the high-end estimates on AI costs are probably worth modest gains for knowledge workers.
don't antromorphize the computer sycopathy is just how they programmed the thing all the information to heavily challenge your ideas is in there
try it
tell it you think using an AI to challenge your ideas is great (the opposite of what you think)
I've done this. Hilariously frustrating when it starts doubling down on hallucinations.
I'm not walking around touting it, cause this is a time of battling cults. But I have been using an AI as a tutor to teach me how to write C code, with an eye towards kernel contributions and other things that require that speed. Obviously it's a more marketable dev skill, even in this time, than the Python I know. It is very good at teaching, actually. Too bad about us all perishing by asphyxiation.
(Why is consciousness required to tell true/false statements? I think I'd even say 'that sign is dishonest/wrong/a liar', regardless of the fact that the sign is very much dead.)
Programming is a very non-fuzzy topic; it's no surprise that as the great delusion shakes out, generated art is too despised to be a significant revenue stream, and so far as I can tell the generated human text is still amateurishly bad.
But it's a fact that these models have been trained on just about every bit of publicly-available code, which by and large, is good, working code. Not every bit of it, but enough that I have yet to see the thing spit out bad syntax... though it catches my bad syntax every time.
I have not and will never try to use it to write code for me, but it's a smashing tutor, and I could certainly see an experienced dev who knows exactly what they want, handing off the building of tedious functions and stuff, piece by piece, and getting back good, compact code. I believe that the problems we're having are to do with someone handing off the building of an entire website, or an entire app, that's where you end up with runaway dependencies, bloated and badly-written functions, etc.
Now, it still goes idiot all the time. I point out that my push function is failing because the ringbuffer_is_full check is returning true every time (I'm very dumb when I'm first starting out on anything), it "sees" the problem and tells me correctly what to do to fix it, but it talks about the function returning false every time. Correct answer, but the dressing on the salad is wrong. This only happens, though, after I've been in the same chat for a while (context window overflow).
In other words, it's a tool that humans can use, while keeping an eye for that kinda thing, but it certainly will not replace anyone, though we're going to absorb a lot of damage from stupid rich people trying.
In other news, I had a dream last night where I was hanging out with an old ex, and when she showed up, she (somehow) told me that not only had she gone blind since we last talked, she had then gotten a brain tumour and had her head amputated. So I was walking around with my headless ex all day in this dream. I don't dislike this ex, we were just walking around (how?) and talking to people (HOW?).
I wonder if this is a product of me conversing with something that has no consciousness so much this last week. Or maybe it's the Ed Gein series we're watching, I dunno.
I've actually been able to shape GPT this way via a bunch of global settings I've invoked over the years. Don't get me wrong-- it's a PITA, and pretty much a never-ending process, but I think I have two dozen settings now it follows as best it can in order to provide something like a 'pros and con' list for any opinion it spits out. This cuts way down on its classic tendency to hallucinate bullshit and spit out half-baked / incorrect replies.
(ready for the downvotes now assuming that I love AI as a general concept π )
@lemmy.world
The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:
All posts must begin with YSK. If you're a Mastodon user, then include YSK after @youshouldknow. This is a community to share tips and tricks that will help you improve your life.
In your post's text body, you must include the reason "Why" YSK: Itβs helpful for readability, and informs readers about the importance of the content.
Do not seek mental, medical and professional help here. Breaking this rule will not get you or your post removed, but it will put you at risk, and possibly in danger.
That's it.
Posts and comments which, instead of being of an innocuous nature, are specifically intended (based on reports and in the opinion of our crack moderation team) to bait users into ideological wars on charged political topics will be removed and the authors warned - or banned - depending on severity.
Provided it is about the community itself, you may post non-YSK posts using the [META] tag on your post title.
If you harass or discriminate against any individual member, you will be removed.
If you are a member, sympathizer or a resemblant of a movement that is known to largely hate, mock, discriminate against, and/or want to take lives of a group of people and you were provably vocal about your hate, then you will be banned on sight.
For further explanation, clarification and feedback about this rule, you may follow this link.
Let everyone have their own content.
Unless included in our Whitelist for Bots, your bot will not be allowed to participate in this community. To have your bot whitelisted, please contact the moderators for a short review.
Disinformation, trolling, and being misleading will not be tolerated. Repeated or egregious attempts will earn you a ban. This also applies to filing reports: If you continually file false reports YOU WILL BE BANNED! We can see who reports what, and shenanigans will not be tolerated. We are not here to ban people who said something you don't like.
Video only posts are responsible for an outsized portion of rules violations. Your post must contain text and meet the requirements of the previous rules.
You can view our partnered communities list by following this link. To partner with our community and be included, you are free to message the moderators or comment on a pinned post.
For inquiry on becoming a moderator of this community, you may comment on the pinned post of the time, or simply shoot a message to the current moderators.
Our icon(masterpiece) was made by @clen15!
go to feed...
@lemmy.world
The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:
All posts must begin with YSK. If you're a Mastodon user, then include YSK after @youshouldknow. This is a community to share tips and tricks that will help you improve your life.
In your post's text body, you must include the reason "Why" YSK: Itβs helpful for readability, and informs readers about the importance of the content.
Do not seek mental, medical and professional help here. Breaking this rule will not get you or your post removed, but it will put you at risk, and possibly in danger.
That's it.
Posts and comments which, instead of being of an innocuous nature, are specifically intended (based on reports and in the opinion of our crack moderation team) to bait users into ideological wars on charged political topics will be removed and the authors warned - or banned - depending on severity.
Provided it is about the community itself, you may post non-YSK posts using the [META] tag on your post title.
If you harass or discriminate against any individual member, you will be removed.
If you are a member, sympathizer or a resemblant of a movement that is known to largely hate, mock, discriminate against, and/or want to take lives of a group of people and you were provably vocal about your hate, then you will be banned on sight.
For further explanation, clarification and feedback about this rule, you may follow this link.
Let everyone have their own content.
Unless included in our Whitelist for Bots, your bot will not be allowed to participate in this community. To have your bot whitelisted, please contact the moderators for a short review.
Disinformation, trolling, and being misleading will not be tolerated. Repeated or egregious attempts will earn you a ban. This also applies to filing reports: If you continually file false reports YOU WILL BE BANNED! We can see who reports what, and shenanigans will not be tolerated. We are not here to ban people who said something you don't like.
Video only posts are responsible for an outsized portion of rules violations. Your post must contain text and meet the requirements of the previous rules.
You can view our partnered communities list by following this link. To partner with our community and be included, you are free to message the moderators or comment on a pinned post.
For inquiry on becoming a moderator of this community, you may comment on the pinned post of the time, or simply shoot a message to the current moderators.
Our icon(masterpiece) was made by @clen15!
go to feed...
Or don't use AI for knowledge work when being correct is important.
save