Not THAT far. But 32GB RAM is getting more common, though I haven’t heard of many people using 64, let alone more than that.

Also, storage is usually not that extreme, though multiple terabytes are also getting more common on the higher end.

Just this month, I upgraded to 16GB RAM and 1TB SSD so it isn’t that extreme for most people.

CPU and GPU - wise, most people aren’t running the best of the best, and there are still plenty of people using 10-series Nvidia GPUs, with most people seemingly using 20-series or 30-series GPUs, (and usually not the best cards for these generations)

Cool, but is there any reason to use this over Searx?

I second that. Even my lower-midrange laptop from 3 years ago (8GB RAM, Integrated AMD GPU) can run a few of the smaller LLMs, and it’s true that you don’t even need a GPU as they can run in RAM. And depending on how much RAM you have and what GPU, you might find models performing better in RAM instead of on the GPU. Just keep in mind that when a model says, for example, 8GB Memory required, if you have 8GB RAM, you can’t run it cuz you also have your operating system and other applications running. If you have 8GB video memory on your GPU though, you should be golden (I think).

I completely forgot about the Linux Upskill Challenge! I should have mentioned I’ve been running Linux as my desktop operating system for almost 3 years, and I’ve been tinkering with it quite a lot throughout so I’m quite familiar and very comfortable with the command line. I shoukd go through the Linux upskill challenge so I can fill in any knowledge gaps though. Thanks for reminding me!