Meta to start capturing employee mouse movements, keystrokes for AI training data

6 months ago by Lee Duna to c/technology

Meta is installing new tracking software on U.S.-based employees’ computers ​to capture mouse movements, clicks and keystrokes for use in training its artificial intelligence models, part of a broad initiative to build AI agents ‌that can perform work tasks autonomously, the company told staffers in internal memos seen by Reuters.

load all comments
LogicOverFeelings 28 points 6 months ago

I wasn't understanding what use keystrokes and mouse-clicks would have without also capturing what's happening on screen. Turn out, they are also capturing that:

The tool, called Model Capability Initiative (MCI), will run on work-related apps and websites and will also take occasional snapshots of the content on employees’ screens

path: 0 23341943, hotness: undefined, score: 28, children: 2
AlecSadler 6 points 6 months ago

FWIW, a lot of websites do pretty much the same thing. It isn't too hard and, for the most part, doesn't require user permission.

It does if you want full screenshot / video recording, but it doesn't if you just track mouse movements and what is typed and virtually recreate the DOM.

path: 0 23341943 23347055, hotness: undefined, score: 6, children: 1
LogicOverFeelings 1 point 6 months ago

Interesting, I didn't consider they could do it this way, but it make perfect sense. Thanks for bringing this up.

path: 0 23341943 23347055 23396108, hotness: undefined, score: 1, children: 0
technology
technology

@lemmy.world

login for more options
88756
22225
14620

This is a most excellent place for technology news and articles.

Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


go to feed...