AI companies have stopped warning you that their chatbots aren’t doctors
a year ago by misk to c/technology
Well, I won’t make up numbers (like you did) but two things
- wrong diagnosis are a thing, won’t argue about that
- you mostly hear the people who complain about false diagnosis. Just because a group of people is “loud” does not mean they are in the majority.
The thing that LLMs are great at is taking a LOT of datapoints and coming to a conclusion based on all of them.
Humans can look at a few but get overwhelmed.
if you feed a ton of diagnostic data including past incidents, blood test, perhaps DNA tests, i'm pretty sure LLMs will be able to better figure out a diagnosis than a doctor using traditional methods.
When users self-diagnose, they're often wrong, because they don't know what the fuck they're doing. Garbage in garbage out regardless of the entity trying to process it.
This study is one that put doctors against a LLM, 90% accuracy for chatgpt, 74% for doctors not using LLM tool. https://www.advisory.com/...
So chatgpt wrong 10% of the time, doctor wrong 26% of the time. 2.6x worse failure rate by real docs... for that one anyway. The better the data for chatgpt, the better it's diagnosis. Humans probably won't get much better, but LLMs? I bet they will.
We're likely to have an intermediary step where HCPs handle the symptoms, testing, etc and then it's fed into a medical focused LLM. The LLM will output potential diagnosis for a doctor to review for sanity, even though the doctor is probably less accurate it will make everyone feel better, and then the doc will slap a diagnosis on their profile.
LLMs will be infinitely better than humans at figuring out drug interactions (it's just a big fucking database), allergies (they can't forget you're allergic to NSAIDs like my wife is, and who routinely has been given them by HCPs who fuck up.) Who knows what else.
@lemmy.zip
News community around technology, social media platforms, information technology and governmental policy surrounding it.
What doesn't fit here?
The core of the story has to be technology focused.
- If article mentions "AI" in a sentence and then talks about business economics that doesn't make it tech news.
- Gaming is too many layers removed from technology. There are many dedicated communities that are a better fit for it.
- Transporation is too many layers removed from technology. EVs while use many cool technologies have many dedicated communities that are a better fit for it.
- Entertainment is too many layers removed from technology. While sometimes it can fit here, business or cultural aspects of it are a better fit for dedicated communities.
- Cybersecurity. While it heavily focuses on technology, most of the time it's too technical for most people who are not already invested in it. Should be posted in a dedicated communities unless it has broader connection to other tech areas.
Post guidelines
Title format
Post title should mirror the news source title. If you don't like the title of article, look for an alternative source instead of editorializing it.
URL format
Post URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
[Opinion] prefix
Opinion (op-ed) articles must use [Opinion] prefix before the title. Opinion articles refer to articles that their publisher doesn't explictly endorse.
Country prefix
Country prefix can be added to the title with a separator (|, :, etc.) if the news is from a local publisher who doesn't clearly mention the country.
Rules
1. English only
Title and associated content has to be in English.
2. Use original link
Post URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communication
All communication has to be respectful of differing opinions, viewpoints, and experiences.
4. Inclusivity
Everyone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacks
Any kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangents
Stay on topic. Keep it relevant.
7. Instance rules may apply
If something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.
Companion communities
!globalnews@lemmy.zip
!interestingshare@lemmy.zip
Icon attribution | Banner attribution
If someone is interested in moderating this community, message @brikox@lemmy.zip.
go to feed...
@lemmy.zip
News community around technology, social media platforms, information technology and governmental policy surrounding it.
What doesn't fit here?
The core of the story has to be technology focused.
- If article mentions "AI" in a sentence and then talks about business economics that doesn't make it tech news.
- Gaming is too many layers removed from technology. There are many dedicated communities that are a better fit for it.
- Transporation is too many layers removed from technology. EVs while use many cool technologies have many dedicated communities that are a better fit for it.
- Entertainment is too many layers removed from technology. While sometimes it can fit here, business or cultural aspects of it are a better fit for dedicated communities.
- Cybersecurity. While it heavily focuses on technology, most of the time it's too technical for most people who are not already invested in it. Should be posted in a dedicated communities unless it has broader connection to other tech areas.
Post guidelines
Title format
Post title should mirror the news source title. If you don't like the title of article, look for an alternative source instead of editorializing it.
URL format
Post URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
[Opinion] prefix
Opinion (op-ed) articles must use [Opinion] prefix before the title. Opinion articles refer to articles that their publisher doesn't explictly endorse.
Country prefix
Country prefix can be added to the title with a separator (|, :, etc.) if the news is from a local publisher who doesn't clearly mention the country.
Rules
1. English only
Title and associated content has to be in English.
2. Use original link
Post URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communication
All communication has to be respectful of differing opinions, viewpoints, and experiences.
4. Inclusivity
Everyone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacks
Any kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangents
Stay on topic. Keep it relevant.
7. Instance rules may apply
If something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.
Companion communities
!globalnews@lemmy.zip
!interestingshare@lemmy.zip
Icon attribution | Banner attribution
If someone is interested in moderating this community, message @brikox@lemmy.zip.
go to feed...
I feel like this is the self driving car thing again.
How often are human doctors wrong in their diagnoses?
How often are LLM doctors wrong in their diagnoses?
I'm pretty sure the former is close to 75%, and the latter substantially less. I've heard of so many people go to doctor after doctor and not get the right diagonsis or treatment for whatever they have going on, and it takes 5+ to find the one who figures it out and gets them treated.
save