That post seems to be missing.
tal 20 points 3 years ago

In all seriousness, Google needs to get on providing an easier way to specify that a search should hit the Fediverse. site:reddit.com works for Reddit, but there is presently no analogous operator on Google's search for a distributed system that spans many domains.

I mean, it's great that you've made this, don't get me wrong, but they really should do that as well.

path: 0 333994, hotness: undefined, score: 20, children: 3
Cinner 11 points 3 years ago path: 0 333994 334979, hotness: undefined, score: 11, children: 0
0x1C3B00DA 3 points 3 years ago

but there is presently no analogous operator on Google's search for a distributed system that spans many domains.

Because that's just a basic search. A search engine searches across multiple domains by default. If you're specifically looking for only results from ActivityPub enabled services, that's pretty much an impossibility since there's no way to know (from a web crawl) if a page is served by a server that supports ActivityPub. Another problem is that a lot of fediverse instances purposefully block search engine crawlers because they don't want to appear in search results.

path: 0 333994 358978, hotness: undefined, score: 3, children: 0
Polymath 1 point 3 years ago

I like the idea of scrapping Google altogether, and just having "better" search engines here that account for federated decouplings/distributions

Not entirely the same, but I switched over to Presearch a year or so ago, just to get away from Google and the "big tech" corporations

path: 0 333994 2546714, hotness: undefined, score: 1, children: 0
EmpathicVagrant 16 points 3 years ago

Won’t let me upvote so I’m commenting to show love instead.

path: 0 333440, hotness: undefined, score: 16, children: 0
Horik 10 points 3 years ago

Nice UI, thx.

path: 0 333455, hotness: undefined, score: 10, children: 0
TGRush 10 points 3 years ago

Hm, I find it somewhat annoying that right now, this is not really searching the Fediverse, but rather what we've come to call "the Threadiverse", which is all about Reddit-like content aggregators.

In other words, I'd love an option to search different kinds of content, like instead of Threadiverse-stuff searching the most popular mastodon, misskey, or pleroma instances just to name a few.

path: 0 334503, hotness: undefined, score: 10, children: 6
TenorTheHusky 7 points 3 years ago

I'm hoping to expand the project to hopefully be a bit more robust - I'll definitely keep this on my radar

path: 0 334503 334548, hotness: undefined, score: 7, children: 1
TGRush 4 points 3 years ago

Thank you so much for the consideration! <3

path: 0 334503 334548 334764, hotness: undefined, score: 4, children: 0
Kichae 5 points 3 years ago

Searching Mastodon is a bit of a.... contentious issue. A lot of smaller Mastodon-based sites are full of traumatized vulnerable people who really just want to do their own thing, and they'll rattle cages if they find out someone's indexing their sites or posts. If anyone's making third party search tools, it's best to be careful to respect discoverability and indexing flags.

path: 0 334503 334966, hotness: undefined, score: 5, children: 3
stochasticity 2 points 3 years ago

I find this to be incredibly fair, but also makes it much harder to dive into the fediverse. Where is the middle ground do you think?

path: 0 334503 334966 336664, hotness: undefined, score: 2, children: 2
Kichae 3 points 3 years ago

Mastodon has flags for opting in to discoverability features (being featured in the profile directory, and having posts be searchable via Mastodon's search bar) and for search engine indexing (for Google, bing, etc.).

Just don't return posts from users that have opted out of those, and things should be mostly ok.

path: 0 334503 334966 336664 337052, hotness: undefined, score: 3, children: 1
0x1C3B00DA 1 point 3 years ago

Just don't return posts from users that have opted out of those, and things should be mostly ok.

This is the main problem I see. User settings are part of the mastodon API. If you're building a general-purpose search engine, you use a crawler to index pages and your crawler has no idea those flags even exist.

path: 0 334503 334966 336664 337052 359232, hotness: undefined, score: 1, children: 0
dosidosankofa 9 points 3 years ago

dig it, works great

path: 0 333497, hotness: undefined, score: 9, children: 0
NumbersCanBeFun 8 points 3 years ago
path: 0 333858, hotness: undefined, score: 8, children: 0
techviator 8 points 3 years ago

Very cool! Thanks!
Suggestion: add Brave Search (search.brave.com) as an option as well. It's a smaller search engine but they have their own index and does not track users.

path: 0 334221, hotness: undefined, score: 8, children: 1
TenorTheHusky 4 points 3 years ago

Will do o7

Edit: It seems Brave doesn't support chaining site specifiers, so my current method won't work with their search

path: 0 334221 334289, hotness: undefined, score: 4, children: 0
lixus98 7 points 3 years ago

Pretty cool, thank you!

path: 0 334027, hotness: undefined, score: 7, children: 0
couragethecowardlydog 6 points 3 years ago

Good work bruv

path: 0 333895, hotness: undefined, score: 6, children: 0
arkcom 6 points 3 years ago

add kbin-link to your browser to make this even better!

path: 0 334282, hotness: undefined, score: 6, children: 0
wave_walnut 6 points 3 years ago

Simple and handy, thanks!

path: 0 334391, hotness: undefined, score: 6, children: 0
babelspace 6 points 3 years ago

Awesome. Though I notice very little shows up from kbin.social; content I know is there is missing when I search for it. That may have more to do with the recency of the site growth or the cloudflare protection that was up a few days ago.

path: 0 333751, hotness: undefined, score: 6, children: 1
TenorTheHusky 6 points 3 years ago

I would guess that it is the cloudflare protection, since that will have prevented crawlers from indexing the site while it was enabled.

path: 0 333751 334198, hotness: undefined, score: 6, children: 0
LetThereBeDwight 5 points 3 years ago

Seems like you could probably use this strategy and get rid of the limits by turning this into an extension that would tack on the site list to the search directly(though, I'm unsure if there are such limits directly via the search box on Google or whomever).

I'd also, just from a code quality perspective, bust the list out into it's own property (which could later become smarter), and build the query string out at runtime.

path: 0 334843, hotness: undefined, score: 5, children: 0
WebCrawlerReborn 5 points 3 years ago

Simple and to the point. Nice work!

path: 0 334313, hotness: undefined, score: 5, children: 0
VE3VVS 4 points 3 years ago

very nicely done!

path: 0 337898, hotness: undefined, score: 4, children: 0
Tywele 4 points 3 years ago

Would be great to have ecosia.org as an option for the search engine :)

path: 0 346536, hotness: undefined, score: 4, children: 0
JurassicPork 4 points 3 years ago

Amazing! Great job! And thanks!

path: 0 334164, hotness: undefined, score: 4, children: 0
catsarebadpeople 2 points 3 years ago

Thank you!

path: 0 353436, hotness: undefined, score: 2, children: 0
-- 2 points 3 years ago

thx

path: 0 339407, hotness: undefined, score: 2, children: 0
Icarus 2 points 3 years ago

have you considered redirecting to whoogle or searx ? you can use farside.link which automatically redirects to a working instance. it would be helpful for people who want to avoid using Google

path: 0 387961, hotness: undefined, score: 2, children: 1
TenorTheHusky 3 points 3 years ago

I will absolutely check this out, thanks for the suggestion!

Edit: I can't get searx working at all for me, but I went ahead and implemented whoogle support

path: 0 387961 387972, hotness: undefined, score: 3, children: 0
brasilikum 1 point 3 years ago

Down for me

path: 0 335236, hotness: undefined, score: 1, children: 0
redhydride 1 point 3 years ago

That's fantastic! Thank you!

path: 0 339555, hotness: undefined, score: 1, children: 0
Poot 1 point 3 years ago

Thank you!!

path: 0 353433, hotness: undefined, score: 1, children: 0
dekkzz76 1 point 3 years ago path: 0 342064, hotness: undefined, score: 1, children: 2
TenorTheHusky 4 points 3 years ago

Each one has its upsides and downsides. Kbin's search is more convenient for certain use cases, but it suffers from the same problem as Reddit's search - it always sorts by new no matter what. In addition, it can only index instances with which kbin has federated. FediSearch should in theory index every instance, regardless of federation status, and do so in such a way that the most useful posts show first (assuming Google does its job).

path: 0 342064 342065, hotness: undefined, score: 4, children: 1
dekkzz76 1 point 3 years ago path: 0 342064 342065 426012, hotness: undefined, score: 1, children: 0
Utzmetah 1 point 3 years ago

Thank you! good idea!

path: 0 342565, hotness: undefined, score: 1, children: 0
kzhe 1 point 3 years ago

You should make this be able to be used as a search engine with a certain address with the search text in some part of it redirecting to the search of that, so like for example as a vivaldi user with many search engines I could add it.

path: 0 335497, hotness: undefined, score: 1, children: 0

thanks for using Leebra!

go to feed...