Using an AI Agent Makes You a Sucker for Phishing Emails: "The real flaw is that the model can’t tell the difference between text it’s supposed to read and instructions it’s supposed to follow."
a day ago by eicker to c/technology
Yeah no shit, 20 years of gmails ‘s complete inability to determine spam from real email is testament to this
Well we are also trusting an advertising company to filter out ads.
they have an interest in filtering out ads they weren't paid for tho
Considering that most of the difference between "wanted" and "unwanted" content depends entirely on the user, I'm surprised systems like these even work as well as they do.
In no small part because of adversarial training.
That's a very interesting take. Gmail has always had one of the better spam filters in my experience. I absolutely remember when common wisdom was that if you were inundated with spam, one way to help was to forward email to a gmail box and have its spam filters run on it.
Even today, I see very few false positives and false negatives.
YMMV of course.
Why use AI to read emails? My rules are that if in Inbox and unread for a week, move to Purgatory. If in Purgatory for more than a month, delete.
If you want me to read an email, you better text me that you emailed me. Receipts, updates, and all that jazz already have filters and rules.
Why would you use your AI Agents to check emails? I only use my locally run AI Agents to send me incredibly insulting messages on Matrix and Signal because I'm into that kinda thing.
Unless you go in and specifically turn them off they are on by default in some email systems like Google's (and I think Microsoft's).
@lemmy.world
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
go to feed...
@lemmy.world
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
go to feed...
We spent decades teaching people not to click suspicious links, then handed our inboxes and payment permissions to a chatbot that treats »ignore previous instructions« as a promotion to management. The phishing email no longer needs to fool you: It just needs to fool your very expensive autocomplete intern.
save