Your AI Girlfriend Is a Data-Harvesting Horror Show

3 years ago by Flying Squid to c/technology

The privacy mess is troubling because the chatbots actively encourage you to share details that are far more personal than in a typical app.
BetaDoggo_ 263 points 3 years ago

This is why you should always selfhost your AI girlfriend.

path: 0 7536601, hotness: undefined, score: 263, children: 28
pennomi 152 points 3 years ago
path: 0 7536601 7537084, hotness: undefined, score: 152, children: 6
foggy 23 points 3 years ago

I ain't got that kinda GPU to spare. If it's the games or my AI girlfriend...

path: 0 7536601 7537084 7544084, hotness: undefined, score: 23, children: 3
Oha 8 points 3 years ago

you dont need that much power. something like a rx 6600xt/rtx 3060/rx580 is plenty

path: 0 7536601 7537084 7544084 7553507, hotness: undefined, score: 8, children: 2
neutron 7 points 3 years ago

Is support for AMD cards better these days? Last time I checked it involved checking ROCM compatibility because CUDA needs nvidia cards exclusively.

path: 0 7536601 7537084 7544084 7553507 7555341, hotness: undefined, score: 7, children: 1
CouncilOfFriends 7 points 3 years ago

I'd have to actually test my backup strategy

path: 0 7536601 7537084 7553449, hotness: undefined, score: 7, children: 0
iquanyin 6 points 3 years ago

🤣

path: 0 7536601 7537084 7544967, hotness: undefined, score: 6, children: 0
match 52 points 3 years ago

I'd only date someone fully independent, so my AI joyfriend operates their own cloud cluster through a combination of a crypto wallet and findom

path: 0 7536601 7537304, hotness: undefined, score: 52, children: 3
anarchrist 17 points 3 years ago

They sound fun

path: 0 7536601 7537304 7537396, hotness: undefined, score: 17, children: 0
iquanyin 2 points 3 years ago

🤣

path: 0 7536601 7537304 7599033, hotness: undefined, score: 2, children: 0
neutron 1 point 3 years ago

I'm interested. So you rent a cluster to run an instance instead of self hosting?

path: 0 7536601 7537304 7555684, hotness: undefined, score: 1, children: 0
werefreeatlast 36 points 3 years ago

I think my wife is cheating on me with my self hosted AI girlfriend's boyfriend that lives in the same database file. What do I do?

path: 0 7536601 7537697, hotness: undefined, score: 36, children: 3
AZERTY 19 points 3 years ago

Delete system32 obviously

path: 0 7536601 7537697 7538458, hotness: undefined, score: 19, children: 0
Murdoc 17 points 3 years ago

For as long as everyone is using a virus checker, maybe you could try an open source relationship.

path: 0 7536601 7537697 7546997, hotness: undefined, score: 17, children: 0
DrWeevilJammer 14 points 3 years ago

Sounds like a job for Little Bobby Tables

path: 0 7536601 7537697 7543000, hotness: undefined, score: 14, children: 0
z00s 10 points 3 years ago

That'll make you go blind

path: 0 7536601 7547821, hotness: undefined, score: 10, children: 1
RGB3x3 7 points 3 years ago

And give you hairy palms

path: 0 7536601 7547821 7555693, hotness: undefined, score: 7, children: 0
yildolw 9 points 3 years ago

Now consider the number of normal people in the world who do not have a server rack in their closet, and how much they are about to be defrauded and blackmailed

path: 0 7536601 7557545, hotness: undefined, score: 9, children: 1
UnderpantsWeevil 13 points 3 years ago
  • My Canadian Girlfriend

Broke, Busted, Burned Out

  • My Canadian Server-Farm Girlfriend

Smart, Sexy, Superconductive

path: 0 7536601 7557545 7558039, hotness: undefined, score: 13, children: 0
wabafee 6 points 3 years ago

Let me go buy some milk.

path: 0 7536601 7556068, hotness: undefined, score: 6, children: 0
NigelFrobisher 2 points 3 years ago

You have to at least move out of your AI parents’ server rack before letting your AI girlfriend move in.

path: 0 7536601 7600827, hotness: undefined, score: 2, children: 0
TakiMinase 0 points 3 years ago

Nvidia^TM

path: 0 7536601 7537943, hotness: undefined, score: 0, children: 0
DarkThoughts -2 points 3 years ago

You need a little gpu server farm for proper models & context sizes though. Single consumer gpus don't have enough vram for that.

path: 0 7536601 7537971, hotness: undefined, score: -2, children: 5
glowie 17 points 3 years ago

Might as well just pay for a prostitute

path: 0 7536601 7537971 7538256, hotness: undefined, score: 17, children: 4
DarkThoughts 9 points 3 years ago

Yeah, I heard they're also very privacy friendly.

path: 0 7536601 7537971 7538256 7538300, hotness: undefined, score: 9, children: 2
captainlezbian 5 points 3 years ago

Unless you piss them off

path: 0 7536601 7537971 7538256 7538300 7539597, hotness: undefined, score: 5, children: 1
neutron 2 points 3 years ago

Locally hosted AI sucking down on our dick through usb plugged dildos. This is the future.

path: 0 7536601 7537971 7538256 7555722, hotness: undefined, score: 2, children: 0
Gork 71 points 3 years ago

Are there any Open Source girlfriends that we can download and compile?

path: 0 7536985, hotness: undefined, score: 71, children: 19
herrcaptain 57 points 3 years ago

Hey now, I don't want anyone looking at my girlfriend's source code. That's personal!

path: 0 7536985 7537093, hotness: undefined, score: 57, children: 1
demonsword 30 points 3 years ago

I don’t want anyone looking at my girlfriend’s source code

it's okay, dude, we all already did...

path: 0 7536985 7537093 7537617, hotness: undefined, score: 30, children: 0
DarkThoughts 16 points 3 years ago

The bots (what the actual girlfriends or whatever other characters are) aren't the problem. You can find them on chub.ai for example or write them yourself fairly easily. The issue the software, and even more so the hardware. You need something like the mentioned Kobold.ccp or oobabooga, and then you'd also need a trained LLM model that you can get on huggingface.co, which is already where it gets complicated (they'll be loaded within kobold or oobabooga). You also need to understand how they work in regards to context sizes & bytes, because they need a lot, and I mean A LOT of vram to work properly. Basically, the more vram you have, the better the contextual understanding, their memory is. Otherwise you'd have a bot that maybe knows to only contextualize the last couple messages. For paid services like novelai.net you basically have your bots run through big ass server farms with lots of GPUs that bundle their vram and processing power, giving you "decent" context sizes (imo the greatest weak point of LLMs and it is deeply rooted in how they work) and decent speed. NovelAI also supports front-ends like SillyTavern which is great for local bot management and settings, regardless if you self host or use a paid service (NOT EVERY PAID SERVICE HAS AN API FOR THIS! OpenAI's ChatGPT technically does too but they do not allow NSFW content and can ban you for that if caught).
There's a bunch of "free" online services too, like janitorai.com but most of them have slow speeds and the chat degrades significantly after just a few messages, because they have low context sizes. The better / paid models suffer from this degradation too but it is slower and less noticeable, at least at first. You can use that to get an idea of how LLMs work though.

Edit: Should technically self explanatory / common sense, but I would advise not to share ANY personal information through online service chats that could identify you as a person!

path: 0 7536985 7537920, hotness: undefined, score: 16, children: 8
Gork 19 points 3 years ago

Does it make it faster if the GPU has waifu stickers on it?

path: 0 7536985 7537920 7538011, hotness: undefined, score: 19, children: 3
DarkThoughts 13 points 3 years ago

I don't know, I'm not a weeb.

path: 0 7536985 7537920 7538011 7538239, hotness: undefined, score: 13, children: 0
Turun 3 points 3 years ago

Define "it"

Because waifu stickers may indeed speed up "it" for some definition of "it"

path: 0 7536985 7537920 7538011 7584560, hotness: undefined, score: 3, children: 0
HelloHotel 1 point 3 years ago

itll do the opposite im afraid, OW! Hot... umm whats that awful smell of burning plastic.

path: 0 7536985 7537920 7538011 7600097, hotness: undefined, score: 1, children: 0
SwampYankee -1 points 3 years ago

Basically, the more vram you have, the better the contextual understanding, their memory is. Otherwise you’d have a bot that maybe knows to only contextualize the last couple messages.

Hmm, if only there was some hardware analogue for long-term memory.

path: 0 7536985 7537920 7553735, hotness: undefined, score: -1, children: 3
OKRainbowKid 2 points 3 years ago

What are you trying to say? Do you understand what the problem is?

path: 0 7536985 7537920 7553735 7574126, hotness: undefined, score: 2, children: 1
SwampYankee 1 point 3 years ago

I guess I'm wondering if there's some way to bake the contextual understanding into the model instead of keeping it all in vram. Like if you're talking to a person and you refer to something that happened a year ago, you might have to provide a little context and it might take them a minute, but eventually, they'll usually remember. Same with AI, you could say, "hey remember when we talked about [x]?" and then it would recontextualize by bringing that conversation back into vram.

Seems like more or less what people do with Stable Diffusion by training custom models, or LORAs, or embeddings. It would just be interesting if it was a more automatic process as part of interacting with the AI - the model is always being updated with information about your preferences instead of having to be told explicitly.

But mostly it was just a joke.

path: 0 7536985 7537920 7553735 7574126 7609961, hotness: undefined, score: 1, children: 0
DarkThoughts 1 point 3 years ago

Yes, databases (saved on a hard drive). SillyTavern has Smart Context but that seems not that easy to install so I have no idea how well that actually works in practice yet.

path: 0 7536985 7537920 7553735 7621011, hotness: undefined, score: 1, children: 0
pennomi 11 points 3 years ago
path: 0 7536985 7537107, hotness: undefined, score: 11, children: 3
TipRing 8 points 3 years ago

Also for an interface, I'd recommend KoboldLite for writing or assistant and SillyTavern for chat/RP.

path: 0 7536985 7537107 7537345, hotness: undefined, score: 8, children: 0
DarkThoughts 4 points 3 years ago

I tried oobabooga and it basically always crashes when I try to generate anything, no matter what model I try. But honestly, as far as I can tell all the good models require absurd amounts of vram, much more than consumer cards have, so you'd need at least like a small gpu server farm to local host them reliably yourself. Unless of course you want like practically nonexistent context sizes.

path: 0 7536985 7537107 7537614, hotness: undefined, score: 4, children: 1
exu 4 points 3 years ago

You'll want to use a quantised model on your GPU. You could also use the CPU and offload some parts to the GPU with llama.cpp (an option in oobabooga). Llama.cpp models are in the GGUF format.

path: 0 7536985 7537107 7537614 7537751, hotness: undefined, score: 4, children: 0
e-ratic 4 points 3 years ago path: 0 7536985 7537622, hotness: undefined, score: 4, children: 0
itsAsin 2 points 3 years ago

i second this request. please

path: 0 7536985 7537026, hotness: undefined, score: 2, children: 1
DarkThoughts 1 point 3 years ago

See my other reply for some basic info & pointers.

path: 0 7536985 7537026 7537938, hotness: undefined, score: 1, children: 0
j4k3 1 point 3 years ago
path: 0 7536985 7537067, hotness: undefined, score: 1, children: 0
jabathekek 58 points 3 years ago

path: 0 7547363, hotness: undefined, score: 58, children: 0
leaky_shower_thought 52 points 3 years ago

Hey Sugar, which of these pics have traffic lights on them?

bots gotta help each other

path: 0 7539691, hotness: undefined, score: 52, children: 0
TheFriar 40 points 3 years ago

Yeah. Saw that one coming.

path: 0 7544042, hotness: undefined, score: 40, children: 5
UnderpantsWeevil -6 points 3 years ago

Isn't this what every app on your phone is already doing? Why would "AI Girlfriend App" be any better than Facebook or Google?

path: 0 7544042 7558017, hotness: undefined, score: -6, children: 4
mishielda1234 12 points 3 years ago

It's even more insidious because these apps ask for the data upfront under the guise of "getting to know you better"

How can your AI girlfriend truly love you back unless you give it your real name, age, photos of your face, mother's maiden name, social security number, and genetic material? /s

path: 0 7544042 7558017 7583882, hotness: undefined, score: 12, children: 0
TheFriar 8 points 3 years ago

lol it’s not. That’s the point. It’s all the same sort of companies putting these fucking things out. Google and Facebook are both working on their own AI. It’s been shown over and over how they’re scraping all available data—public or private when available—so why the fuck would a newer tech company be any different? It’s the state of capitalism. The markets are focusing more on hyper focused data, so that’s what any profitable tech company is doing. Invading your fucking privacy.

That’s why it’s not a surprise. Because Facebook and google helped set the trend and determine the current tech market. And that’s the world these new ā€œAI girlfriendsā€ are existing in.

path: 0 7544042 7558017 7558418, hotness: undefined, score: 8, children: 1
UnderpantsWeevil 4 points 3 years ago

path: 0 7544042 7558017 7558418 7561427, hotness: undefined, score: 4, children: 0
averyfalken 1 point 3 years ago

Idk all my apps are open source and most don't connect to internet except ones that need it like eternity for reddit

path: 0 7544042 7558017 7621239, hotness: undefined, score: 1, children: 0
EdibleFriend 37 points 3 years ago

Incels warned us about females

path: 0 7536853, hotness: undefined, score: 37, children: 7
FlyingSquid 33 points 3 years ago

As did Ferengi.

path: 0 7536853 7536864, hotness: undefined, score: 33, children: 6
EdibleFriend 20 points 3 years ago

Giving the AI clothing was a mistake.

path: 0 7536853 7536864 7537202, hotness: undefined, score: 20, children: 5
disheveledWallaby 14 points 3 years ago

path: 0 7536853 7536864 7537202 7537777, hotness: undefined, score: 14, children: 4
EdibleFriend 9 points 3 years ago

I, honestly, have absolutely no idea what that GIF has to do with my post yet... I fully accept this response. You have brought light into my life and I thank you.

path: 0 7536853 7536864 7537202 7537777 7538263, hotness: undefined, score: 9, children: 3
drahardja 28 points 3 years ago

I thought this was a new Chuck Tingle novel.

path: 0 7550142, hotness: undefined, score: 28, children: 3
dwemthy 7 points 3 years ago

Pounded in the Butt by my Data Stealing AI Girlfriend

path: 0 7550142 7585400, hotness: undefined, score: 7, children: 0
BreadOven 5 points 3 years ago

Fooled again, it's Chuck Testa.

path: 0 7550142 7595783, hotness: undefined, score: 5, children: 0
Ozymati 4 points 3 years ago

He's on social media. This could probably be arranged.

path: 0 7550142 7596685, hotness: undefined, score: 4, children: 0
TheOakTree 25 points 3 years ago

24 thousand tracker calls in one minute.

That's impressively gross.

path: 0 7583069, hotness: undefined, score: 25, children: 0
maynarkh 21 points 3 years ago

The entire internet is a data harvesting horror show. It's good for the economy though, so we don't do anything against it.

path: 0 7537546, hotness: undefined, score: 21, children: 0
ivanafterall 20 points 3 years ago

Like I could ever get an AI girlfriend. They'd never have me.

path: 0 7536840, hotness: undefined, score: 20, children: 2
NewAgeOldPerson 4 points 3 years ago

You need Lucy Lou bot.

path: 0 7536840 7549439, hotness: undefined, score: 4, children: 1
SwampYankee 4 points 3 years ago

It's amazing the way you NOTICE TWO THINGS.

path: 0 7536840 7549439 7553762, hotness: undefined, score: 4, children: 0
Brutticus 14 points 3 years ago

this is the title of my next light novel

path: 0 7544063, hotness: undefined, score: 14, children: 0
orbit 13 points 3 years ago

People panned the game but this was the whole point of the NG Resonance character in Deus Ex Invisible War. People would basically tell this AI pop star intimate details about their lives and then the data was used against them and their local communities.

path: 0 7537446, hotness: undefined, score: 13, children: 3
Murdoc 4 points 3 years ago

I always wondered though, how many of those people were aware that it was an ai and not the real NG Resonance? (Have to admit, she did get me in trouble with the Omar. My bad. šŸ˜…)

path: 0 7537446 7546574, hotness: undefined, score: 4, children: 2
KingThrillgore 4 points 3 years ago

The shit I do for a discount on non-PiezoChem functionality.

path: 0 7537446 7546574 7596360, hotness: undefined, score: 4, children: 0
orbit 3 points 3 years ago

I think they knew and it didn't matter to them which is oddly prophetic when I look at the state of the world today lol

path: 0 7537446 7546574 7557402, hotness: undefined, score: 3, children: 0
Petter1 13 points 3 years ago

If you not self-host your girlfriend, it is just prostitution. /s

path: 0 7537272, hotness: undefined, score: 13, children: 3
FaceDeer 4 points 3 years ago

Indeed. She's not really your girlfriend unless you own her completely and can control everything she thinks.

path: 0 7537272 7537427, hotness: undefined, score: 4, children: 2
DarkThoughts 3 points 3 years ago

"AI" is funny anyway because you're basically gaslighting them the whole time to have them behave as they're supposed to.

path: 0 7537272 7537427 7537542, hotness: undefined, score: 3, children: 1
FaceDeer 3 points 3 years ago

And their whole purpose in return is to try to guess exactly what you want to hear from them.

AI is so human!

path: 0 7537272 7537427 7537542 7537845, hotness: undefined, score: 3, children: 0
Kolanaki 11 points 3 years ago

I'm not sure what kind of use collecting all my most fucked up thoughts can be.

path: 0 7538647, hotness: undefined, score: 11, children: 5
captainlezbian 14 points 3 years ago

Either advertisers or the cops, possibly both want that information very much

path: 0 7538647 7539699, hotness: undefined, score: 14, children: 0
neptune 12 points 3 years ago

Making a better chat bot AI girlfriend, informing porn directors, leaking it to the Russians,

path: 0 7538647 7538835, hotness: undefined, score: 12, children: 3
Kolanaki 7 points 3 years ago

Making a better chat bot AI girlfriend

Cool.

informing porn directors

Neat.

leaking it to the Russians

My thoughts aren't fucked up enough to be useful to them.

path: 0 7538647 7538835 7538985, hotness: undefined, score: 7, children: 2
Siegfried 6 points 3 years ago

When a a NSFWICBM hits Kiev and every ukrainian starts masterbating furiously to our fucked up thoughts, we will know

path: 0 7538647 7538835 7538985 7539912, hotness: undefined, score: 6, children: 1
Kolanaki 6 points 3 years ago

"You see, Ivan, if you make them horny for feet, they will gladly lay down their arms at yours."

path: 0 7538647 7538835 7538985 7539912 7540723, hotness: undefined, score: 6, children: 0
autotldr 10 points 3 years ago

This is the best summary I could come up with:


According to a new study from Mozilla’s *Privacy Not Included project, AI girlfriends and boyfriends harvest shockingly personal information, and almost all of them sell or share the data they collect.

ā€œAlthough they are marketed as something that will enhance your mental health and well-being, they specialize in delivering dependency, loneliness, and toxicity, all while prying as much data as possible from you.ā€

Every single one earned the Privacy Not Included label, putting these chatbots among the worst categories of products Mozilla has ever reviewed.

You’ve heard stories about data problems before, but according to Mozilla, AI girlfriends violate your privacy in ā€œdisturbing new ways.ā€ For example, CrushOn.AI collects details including information about sexual health, use of medication, and gender-affirming care.

One of the more striking findings came when Mozilla counted the trackers in these apps, little bits of code that collect data and share them with other companies for advertising and other purposes.

EVA AI Chat Bot & Soulmate pushes users to ā€œshare all your secrets and desires,ā€ and specifically asks for photos and voice recordings.


The original article contains 545 words, the summary contains 177 words. Saved 68%. I'm a bot and I'm open source!

path: 0 7536461, hotness: undefined, score: 10, children: 0
Deceptichum 8 points 3 years ago

My what now?

path: 0 7537193, hotness: undefined, score: 8, children: 0
nutsack 7 points 3 years ago

damn someone else besides me figured this out I thought I was a genius or something

path: 0 7538506, hotness: undefined, score: 7, children: 0
KingThrillgore 6 points 3 years ago

Why don't these people do what perfectly mentally unhealthy people do and just abuse the super chat of your local vtuber?

path: 0 7596393, hotness: undefined, score: 6, children: 2
Asudox 5 points 3 years ago

At least the VTuber is a real human behind an anime figure.

path: 0 7596393 7597956, hotness: undefined, score: 5, children: 0
PipedLinkBot 1 point 3 years ago

Here is an alternative Piped link(s):

abuse the super chat

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.

path: 0 7596393 7596426, hotness: undefined, score: 1, children: 0
NegativeLookBehind 6 points 3 years ago

You’re just jealous of our love.

path: 0 7537509, hotness: undefined, score: 6, children: 0
RobotToaster 4 points 3 years ago

I didn't realise they are that realistic.

path: 0 7537201, hotness: undefined, score: 4, children: 0
thorbot -1 points 3 years ago

Can we please stop posting Gizmodo shit posts? It's just pure garbage

path: 0 7536778, hotness: undefined, score: -1, children: 1
dephyre 0 points 3 years ago
path: 0 7536778 7536939, hotness: undefined, score: 0, children: 0
GilgameshCatBeard -2 points 3 years ago

ROFL! There country be a more hilarious headline! I love it!

path: 0 7548660, hotness: undefined, score: -2, children: 0
technology
technology

@lemmy.world

login for more options
88816
22222
14686

This is a most excellent place for technology news and articles.

Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


go to feed...