My Open Search Engine is Going Well

22 days ago by ki4jgt to c/opensource

About a week ago, I created a post detailing a web index I was working on.

I've implemented a few policy changes, after realizing I want this to be more like a library than a search engine.

I remember walking through library shelves as a kid, finding all the subjects I could learn about fascinating. And I'd really like to recreate that experience with this site. An infinitely scrollable catalog that transitions from subject to subject to subject, treating individual domains as books, with rankings (0-9) determined by a mixture of author authority and cultural relevance.

Current Plans:

  • I'm removing the index.json requirement, and allowing users to simply submit domains for inclusion within the catalog.
  • Domains are sorted via an alphanumeric XXX.XXX.XXX format (so cultural anthropology would be SCI.ANT.CUL)
  • I also have plans to put the entire catalog on IPFS, for public accountability.
  • I'm also no longer referring to it as an index, but a catalog.

You could even have a plethora of local results: USA.KTY.BWG, DEU.BER.MIT

Here is the current UX: https://imgur.com/a/QdXTmbz I'm looking for suggestions to make it a better experience. The name is just a placeholder.

IanTwenty 6 points 21 days ago

Reminds me of early days Alta Vista and Yahoo that had directories of sites organised by subject. Google changed all that but now their search has atrophied thanks to seo and slop and here we are back at the start.

Web rings too seem to have returned. https://indieweb.org/webring

The human effort to maintain this seems overwhelming. Would you have editors looking after categories like wikipedia to manage the load?

The screenshots pasted in the other comments don't show any browsing through domains or categories, what would that look like?

path: 0 26003430, hotness: undefined, score: 6, children: 1
ki4jgt 2 points 21 days ago

The site would have a very Google-esque feel. The listings would look similar.

That's the plan. Moderators for categories.

path: 0 26003430 26003603, hotness: undefined, score: 2, children: 0
eager_eagle 6 points 22 days ago

I can't open imgur links, can you paste the image inline?

path: 0 25997895, hotness: undefined, score: 6, children: 2
ki4jgt 4 points 22 days ago

path: 0 25997895 25998021, hotness: undefined, score: 4, children: 0
Rentlar 3 points 22 days ago
images

screenshot of wiffle website

screenshot of wiffle website

screenshot of wiffle website

path: 0 25997895 25998023, hotness: undefined, score: 3, children: 0
eldavi 4 points 22 days ago

So it takes submissions instead of crawling?

path: 0 26001486, hotness: undefined, score: 4, children: 1
ki4jgt 4 points 21 days ago

Pretty much.

It also doesn't catalog individual pages. It lists domains and their descriptions.

path: 0 26001486 26001629, hotness: undefined, score: 4, children: 0
opensource
opensource

@lemmy.ml

login for more options
49531
3007
4347

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

  • Posts must be relevant to the open source ideology
  • No NSFW content
  • No hate speech, bigotry, etc

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

go to feed...