X updates its Terms to prohibit crawling/scraping of its data
3 years ago by skilledtothegills to c/technology
But what if you do? Will you get caught?
It’s not even clear that it’s illegal to scrape publicly available data, so I don’t know what the TOS would be enforcing.
It didn't have to be illegal for them to sue you for violating its policies. It would be a civil suit for damages.
Unfortunately, they have more money to blow on legal fees. The threat of a suit is enough to keep most perks from fucking around and finding out.
It's not publicly available anymore. If you're not logged in you don't see anything anymore except tweets you have a direct link to. Even then you don't see any replies and the amount of tweets per day you can see is limited.
Lol this has the same energy as those NFT idiots crying about people taking screenshots of their stupid monkeys.
Noooo, stop scraping my dataaaa!
Never waste an opportunity to use "muh" in place of "my"
And the next generation of AI probably only needs a fraction of the data it needs now so the need to scrape the data is gone.
Might as well go whole hog and do the entire alphabet. Then do one for every iteration of every letter combination.
He's still mad at those researchers for scraping the data that shows that ever since he took over, the antisemitism, racism and general bigotry has gone up on the platform.
Let the Supreme Court enforce it ;)
Accessing the website is often viewed as accepting the terms, so that wouldn't hold up. Not that they'd have a legal standpoint on the issue.
Accessing the website is often viewed as accepting the terms
The scraping bot can't read the terms
But even if it could, it wouldn't give a damn :-)
“Our interns spent 500 hours collecting the raw data”.
deleted by creator
I thought this was an article about the X Windows system based on the preview for the article. Boy are those two similar-looking.
Or just stop using X all together.
Just update robot.txt coward!
Took a look at their robots.txt, it appears to block all bots except Google.
Crawling for me, not thee!
don't!
You heard him, scrape more.
So he’s going to sue google then?
When Elon bought Twitter I was hopeful- I strongly believe the world needs an open, free-speech based, 'public square'. The problem with the Internet right now is many 'public squares' are privately owned, and those private companies cater to advertisers more than users.
Sadly I don't think it's worked out that well. I think Twitter is probably better off than they were, but you can't have a public square without openness. And while Twitter/X is now more free, it's also less open.
Yeah, well, Elon showed you how much he actually values free speech.
More free in that the moderation doesn't have a bias. I think any bias is harmful, be it Left or Right leaning. I much prefer the current approach of fact checking posts with community notes over hiding posts that are deemed undesirable.
@lemmy.world
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
go to feed...
@lemmy.world
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
go to feed...
If it's publicly accessible it's scrape-able. He already tried to make tweets not publicly accessible and look how long that lasted.
save