/c/data-is-not-beautiful
Estimated share of global web traffic generated by humans and bots (2018-2025)
5 months ago by Innerworld to c/dataisbeautiful
Many consider AI bots as very bad because they ignore established guidelines when crawling a given site. There is a well known and respected way sites can tell good bots how to behave, called robots.txt. Any website can create one and expect good bots (Google, Bing, Facebook, etc) to honor it. For example https://lemmy.world/robots.txt tells bots what paths it should NOT crawl, and the maximum speed at which it should crawl the site.
Many AI bots have been seen completely disregarding this established standard.
How was work there? Why'd you leave?
It's a huge company, and I worked in a small subsection of it. For the most part, our team was fairly detatched from the main operations. It was good working there, the corporate BS didn't touch us too much and the people were great. I left for a job that was more Linux and networking focused. Not sure if that was a good move entirely, looking back. But if I stayed, I'd probably be getting bored if I didn't move into a different role
Google's search indexer.
I’d consider search engine bots from the likes of Google, Microsoft, etc. to be benign. They provide a useful service to websites and honor robots.txt directives.
Bots that impersonate Google etc. and/or ignore robots.txt are considered bad bots.
@lemmy.world
A place to share and discuss visual representations of data: Graphs, charts, maps, etc.
DataIsBeautiful is for visualizations that effectively convey information. Aesthetics are an important part of information visualization, but pretty pictures are not the sole aim of this subreddit.
A place to share and discuss visual representations of data: Graphs, charts, maps, etc.
A post must be (or contain) a qualifying data visualization.
Directly link to the original source article of the visualization
Original source article doesn't mean the original source image. Link to the full page of the source article as a link-type submission.
If you made the visualization yourself, tag it as [OC]
[OC] posts must state the data source(s) and tool(s) used in the first top-level comment on their submission.
DO NOT claim "[OC]" for diagrams that are not yours.
All diagrams must have at least one computer generated element.
No reposts of popular posts within 1 month.
Post titles must describe the data plainly without using sensationalized headlines. Clickbait posts will be removed.
Posts involving American Politics, or contentious topics in American media, are permissible only on Thursdays (ET).
Posts involving Personal Data are permissible only on Mondays (ET).
Please read through our FAQ if you are new to posting on DataIsBeautiful. Commenting Rules
Don't be intentionally rude, ever.
Comments should be constructive and related to the visual presented. Special attention is given to root-level comments.
Short comments and low effort replies are automatically removed.
Hate Speech and dogwhistling are not tolerated and will result in an immediate ban.
Personal attacks and rabble-rousing will be removed.
Moderators reserve discretion when issuing bans for inappropriate comments. Bans are also subject to you forfeiting all of your comments in this community.
Originally r/DataisBeautiful
Please Enjoy our Partner Community:
go to feed...
@lemmy.world
A place to share and discuss visual representations of data: Graphs, charts, maps, etc.
DataIsBeautiful is for visualizations that effectively convey information. Aesthetics are an important part of information visualization, but pretty pictures are not the sole aim of this subreddit.
A place to share and discuss visual representations of data: Graphs, charts, maps, etc.
A post must be (or contain) a qualifying data visualization.
Directly link to the original source article of the visualization
Original source article doesn't mean the original source image. Link to the full page of the source article as a link-type submission.
If you made the visualization yourself, tag it as [OC]
[OC] posts must state the data source(s) and tool(s) used in the first top-level comment on their submission.
DO NOT claim "[OC]" for diagrams that are not yours.
All diagrams must have at least one computer generated element.
No reposts of popular posts within 1 month.
Post titles must describe the data plainly without using sensationalized headlines. Clickbait posts will be removed.
Posts involving American Politics, or contentious topics in American media, are permissible only on Thursdays (ET).
Posts involving Personal Data are permissible only on Mondays (ET).
Please read through our FAQ if you are new to posting on DataIsBeautiful. Commenting Rules
Don't be intentionally rude, ever.
Comments should be constructive and related to the visual presented. Special attention is given to root-level comments.
Short comments and low effort replies are automatically removed.
Hate Speech and dogwhistling are not tolerated and will result in an immediate ban.
Personal attacks and rabble-rousing will be removed.
Moderators reserve discretion when issuing bans for inappropriate comments. Bans are also subject to you forfeiting all of your comments in this community.
Originally r/DataisBeautiful
Please Enjoy our Partner Community:
go to feed...
/r/data-is-not-beautiful :(
save