… by running your own instance of the free and open-source federated metasearch engine SearXNG on OpenBSD!
Does the url not resolve on certain browsers or something? I usually just copy/paste or use a firefox plugin to generate posts for lemmy/piefed/fediverse.
Or how about YaCy. It’s self-hostable & you can have your own web index and start your own web-crawler.
It’s peer-to-peer too
I personally love yacy.
I used to self-host searxng for a while, but somehow the search results were always off and mixed with to much non-relevant results :/.
It’s not about searxng itself… Rather how the most relevant info gets drown into AI slope and non-sense bullshit. The best blogposts/info are transmitted from people to people…
I’m kinda sad to admit that stupid AI “solved” this issue and had better results :/
You can self host that too ;)
OpenWebUI + Ollama + SearxNG. OpenWebUI can do llm web search using the engine of your choice (even self hosted SearxNG!). From there it’s easy to set the default prompt to always give you the top (10, 20, whatever) raw results so you’re not confined to ai results. It’s not quite duck.ai slick but I think I can get there with some more tinkering.
Is there a guide on how to do this on Linux + 16GB Radeon?
I mean, I could write one! I kind of just pieced it together from guides on the three individuals
Edit: back of the napkin guide below is basically in the OpenWebUI docs already! I use NixOS (btw) but docker/podman should work well.
OpenWebUI + Ollama setup – tl;dr
docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:mainOpenWebUI SearXNG guide – a little more involved, but not difficult.
Ohoho? That’s interesting. I don’t have the horse power to selfhost an AI, but that’s good to know !
Thanks for the pointer !!!
I used to self-host searxng for a while, but somehow the search results were always off and mixed with to much non-relevant results :/.
I mean, getting non-relevant results happens with every search engine anymore.
The days of your search results being relevant, and what you want on the first page, are long dead thanks to SEO and other factors.
Yeah you’re right ! However, ages ago, I still remember how you could go to page 20+ and still find some really interesting things !
Here, past page 2 it’s just some random shit…
Most of its just AI generated websites. Search for any topic and you’re likely to get 50 AI generated website that give a similar bulletpoint presentation of what search item X is according to the AI that generated the site.
Brave is a search engine?
That’s news to me.Brave have they’re own search engine
it’s no kagi, but its ok
look at that domain name! respect
Usually its a sign of a scale. Looks like a ransomware c2 domain
If you’re interested in this, the term you’re looking for is punycode
There is also a list of publicly operated SearXNG instances at https://searx.space/. We host the one at https://search.freestater.org/, and there are plenty of other good ones.
Who says they are securely operated and don’t store any data??
who says that about any search engine? can you trust them? searXNG is usually run by random people who are less likely to use your data than a larger search company
At least with Google it wont be an individual that can open my data (most likely).
Probably only the AI or whatever can actually read any of it directly.
If you’re using a shared IP, it doesn’t matter.
You are using a VPN or Tor, right?!?
It’s not federated tho?
Why do they mean when they call it that?
I still don’t understand how Searx is able to operate for free. Don’t the API calls cost money?
If I had to guess, they probably don’t use the APIs, inside using scrapping of some sort.
My understanding is it scrapes what it can’t meaningfully get out of an API. Public instances run into rate limiting, but private instances don’t really have that problem.
From what I’ve read, I believe it’s a combination of donations. sponsors, volunteer hosting from like minded organizations.
I run it in a container on Kubernetes. Definitely recommend.
Is metasearch really the best we can do? What about YaCy, or something else more like that?
Thanks for posting, both a great reminder to try setting this up on my unraid, and also to add the RSS feed of that site to Feeder.
I just added it too, I had read a few articles of them already
