It is becoming near impossible to find relevant information from search engines. Duckduckgo, SearXNG, Bing, Google, and so many more mainstream engines have a significantly high noise to signal ratio, and it is getting worse.
Here are a collection of the best search engines I know, please add more to the list.
- Forum Search Engine: https://crowdview.ai/
- Non-commercial Search: https://search.marginalia.nu/
- Libre Meta Search Engine: https://librey.devol.it/
- Golden Age Search Engine: https://www.wiby.org/
- Yandex: https://yandex.com/
If no more high quality search engines exist, would it be possible to host your own?
I will blow my brains out if I hear a Kagi astroturf one more time. Why pay for a search engine?
Use or Self-host a SearxNG instnace and even invite some of your friends to use your instance, or make it public. Why pay your way when you can use a perfectly awesome open source meta-search engine.
astroturfing is when users like a product recommend it now?
Technically the best one was Altavista.
But they are long gone because they came from the old academic & idealistic internet and they never learned to survive in that internet where money rules.
Altavista was ahead of their time. The modern internet desperately needs a technical search engine.
From a very old memory, Google blew AltaVista out of the water no?
I mean we all switched for a reason and it wasn’t the cute logo.
I find all the kagi mentions to be very suspicious
Why? It’s a great search engine that a lot of people find extremely useful.
I’m glad I’m finally not the only one feeling this way. I’ve been seeing them aggressively pushed seemingly out of the blue for months now. Especially for what is such an awful deal and zero evidence to their claims, just citing the marketing page at face value.
I always fear it comes across that way when I recommend it to people here. I’m just a very happy user and want to see them succeed.
I find it expensive for what it is (given that I still get a limited number of searches) and I’m not comfortable with some of their ways (I don’t want anything to do with AI, and I the idea they have of being nonpolitical seems dangerously naive to me). I also don’t like supporting non-FOSS projects all that much.
Still, it’s the best search I’ve found, and I’m paying every month until I find something better. It’s worth it.
It’s not, really, I switched from Google some years ago and had accepted my faith with DuckDuckGo, but then tried out Kagi. I use search so much daily for work, the relief of getting quality results again is immense and probably saves me hours per week. I get much better results from Kagi than I got at the end from Google, and I can tune them to my liking:
- block Pinterest results when I search for images,
- downprioritize shopping results,
- rewrite all Reddit links to go to old.reddit.com,
- unamp google AMP links
- summarize long texts / documents
- quick answer from the top 5 results
…and so on and so on. It’s just so effective.
… suspicious
If I had stock/investments in a search engine, you better fucking believe Id also have a bunch of bots crawling for the terms “What is the best search engine” and immediately hijack the convo with bots upvoting my search engine.
I cannot explain how easy it is to do this.
Your comment belongs higher. When given the opportunity to make money by social media advertising sometimes in the thousands or millions, companies, share holders, and conflict of interest groups take it. Cablemod’s burning adapters, cryptocurrency scams, payed positive youtube reviews are some great examples. In general there is no honor system and its best to assume anything that can be abused will.
Also manipulating votes is incredibly effective towards swaying public opinion due to the bandwagon effect. Spend a days worth of effort making fake accounts and downvoting any opinion you see as undesirable and most people will follow suit. This is especially bad in echo chambers like on twitter, reddit, etc.
I wish a broader audience could be aware of this. The best I can do is try to spread the word.
Sources:
- The Problem with Linus Tech Tips: Accuracy, Ethics, & Responsibility: https://www.youtube.com/watch?v=FGW3TPytTjc
- Cablemod Recall: https://old.reddit.com/r/cablemod/comments/18o7bnv/planned_voluntary_safety_recall_of_cablemod/
- FTX Scandal: https://en.wikipedia.org/wiki/Bankruptcy_of_FTX
- Bandwagon Effect: https://en.wikipedia.org/wiki/Bandwagon_effect
- Echo Chamber: https://en.wikipedia.org/wiki/Echo_chamber_(media)
Brave Search works really well for me, and they have AI responses at the top of the page now that are really good.
Not sure why you got downvoted like crazy, but Brave legitimately has a great search engine. It also uses its own crawlers unlike DDG, Startpage or Kagi who are really just meta search engines piggybacking off other companies’ results.
I’ve found duckduckgo works fine for things that aren’t recent.
Controversially the bing gpt chat bot works alarming well.
The bing chat bot scares me a bit. I don’t want to use bing out of principle, but at this point they’re just flirting too damn hard.
Kagi
I mostly use bing now. I like that it can answer complex queries and provides sources.
Don’t have much trouble not finding things.
Its nice when you are deep in Microsoft already from your company and get BingChat Enterprise included anyways.
Its slower than OpenAI GPT4 at times and its alot more restricted, but it gets the job done mostly.
You need to hack the UI to make it nice, unlock longer inputs, disable search tool at-will, disable synthetic streaming responses (consistent token speed, but takes longer overall)Simple query via DDG, complex stuff and ChatBot stuff via BingChat Enterprise.
I thought the AI assistant was free? I just downloaded the bang app and I just use the AI assistant whenever I search for anything now.
I don’t use any sort of enterprise, or full disclosure know what any of the other things you said are, any of those options or parameters.
But bing’s really impressed me lately, haha, so I still use it.
Actually on my desktop, I just use the regular Bing search, which I do now find superior to Google for just finding quick accurate answers for basic stuff.
It’s still crazy to me a year later after switching all my default search engines to Bing after using Google for so long, but Google search is just such trash now, it’s insane.
It is free, but the Enterprise version doesnt store anything (not even usage statiwtics) and runs on separate systems (allegedly) aswell as having no limits.
Come on over to Kagi! You do have to pay but I use a search engine dozens of times per day so I’m not too bothered by it.
The owner of Kagi is a homophobic piece of shit.
Just use searxng.
Where did you get that from?
It’s all over the Mastodon side of the Fediverse, shouldn’t be too hard to find with a quick search. I’m not at my pc atm so cbf using a phone to find some links sorry.
The controversy was about Kagi using search API from Brave, whose CEO is supposedly homophobic. Not Kagi’s CEO himself being homophobic.
No, it is also the Kagi founder as per the Mastodon topics.
Can you show some evidence of that?
The sources I find are solely from mastodon threads, and date from this month and the Brave thing. This is the best thing I’ve found
If you are going to look for perfect companies, you will look forever, and probably use Google while you are looking.
It’s not worth it. Just use something better than Google even if it’s flawed, because everything had flaws.
Just use searxng.
Don’t give money to homophobes, we have an open source and better alternative already.
Kagi isn’t homophobic. Apparently the “controversy” is that it employs brave search as well; which is indeed made by a company with a homophobic ceo.
Though by that logic virtually everyone in the world is. Because at some point in time, in some place, someone built a piece of modern civilization upon knowledge or resources belonging to a homophobic person, I’m fairly sure.
No, that’s a seperate controversy. The Kagis owners views became talked about a lot more during that event though.
So many people here are quick to defend and normalise homophobia, yet refuses to just use an open source free alternative that’s without this baggage.
Are you sure none of the developers of the open source free alternative aren’t homophobic, transphobic, or in some other way bad people?
I think it’s perfectly understandable that some people are homophobes, so it doesn’t worry me. You still have people being afraid of black people in this age even.
You can dislike that of course, but that’s the real world. You can walk up to any older person and they are likely to be a lot less open to gay marriage than a younger person also.
You interpret that as them being hostile. I think it’s more about being afraid of something that doesn’t feel natural to them.
Yeah, get fucked mate :)
I think it’s perfectly understandable that some people are homophobes
No it’s not. It’s not a justifiable position. It’s not unexpected sadly, but it is not understandable because it’s not a position based on anything other than ingrained hatred and fear
Not when they collaborate with brave. Fuck that!
They don’t “collaborate” with Brave, just use its search API.
Even though there’s a small monthly cost, the results have been consistent for Kagi. But consistency meets only half of my needs for search: I also want to make decisions quickly from what I find within the contents. If I were to to go to a link, wait for it to load, scroll the content, etc. – does that listed forum post have the answer I am looking for? Does this news article cover the nuances I have been tracking and would like to read more of? Kagi offers an AI-based summarize feature that helps. And that been meeting the other half of my needs, as well.
Lol kagi bots spotted!
A 7 months old random fediverse account is a bot? You know that the entirety of the fediverse is like 0.001 percent of the user base of the social media giants?
That would be money really badly spent on astro-turfing bots.
I self host a searxng instance and I find the combination of bing, duckduckgo and qwant as the source engines to return decent results. You can use a public instance and choose those engines in settings.
Yandex was way better for searches in russian sources, but it came to shit just like google and also excludes whatever russian government don’t like at that point. I searched for some software in it multiple timea and the first link was some noname, probably malware site. It also promotes it’s own malware like browser with questionable russian security sertificates and their own Alexa. I’d honestly not include it in any list.
I like DDG and don’t switch from it that much. I’ve also heard Kagi as paid search engine is good, but I’ve never tried it.
Many people keep asserting that DuckDuckGo is as useless as Google, but I haven’t had a single issue with it. Could it be a regional thing?
Ddg cannot filter out results. If you don’t want pages containing the term, term you add -term to your search and those results should not be included.
Ddg doesn’t do this. I did a brief test of many search engines, and only google and mojeek filtered results correctly.
Edit: yadex seems to have working filtering.
I don’t live in the US and the regional results for my country are worse on DuckDuckGo than on Google.
But still, I noticed Google’s quality drastically falling down in recent years.
DDG is ok for most searches, but they have definitely hit a plateau. Programming search results are quite poor, for instance.
I’ve started paying for kagi. Their results are just way better at this point.
This site collects quite a few web search engines: https://www.searchenginemap.com/
Here are some options I use in my rotation.
Brave Search (skip the browser)
Mojeek
Qwant (French)
Yandex (Russian)
Mullvad Leta (Mullvad VPN subscription required)
Metager (German meta search)
Startpage (Private Google Results)
DuckDuckGo (Private Bing Results)
SearXNG and similar self hosted options are awesome, but I’ve found them unreliable.
Be skeptical of Kagi… It’s promoted pretty heavily around here for something that’s not FOSS.
I’m convinced at this point that Kagi is astroturfing on Lemmy, it’s unnatural. All they do is just cite the marketing page when questioned about the quality, or as to why they supposedly think it’s worth paying for compared to much more mature as-driven services that do respect your privacy.
I’ve been using Kagi for 3 months now I think? And I’ve found it to be extremely useful for research…to a point, my only real issue is that after the first or so series of results it either doesn’t offer anything further or just no longer is showing relevant results to my search. Honestly though I’ve been very happy with Kagi and continue to pay the 10/month but if I do find something even better I’d happily switch. I’m not married to any particular search engine (well …least not to the extent of using Google services).
If you’re skeptical just give it a try I think they have a trial system in place.
I like the french one “qwant”.