If i can figure it out I’ll be sure to post something lol.
So far, i found a python project that is supposed to enable RAG but i have yet to try it and after a reinstall of my linux pc to Popos, im having less than success getting ollama to run.
Me personally, i use my AMD 7700XT to run ollama on my main pc. Can be helpful for troubleshooting as the internet gets worse amd worse to search especially if i dont know what the issue is. Thats my main use case for it but id like to set up something with RAG and use it to help me with documentation if i have questions.
I don’t think its super worth it to use a VPS for an LLM if you already have a decrnt gpu that you can run it on. If yoy dont already have the hardware, plenty of older gpus can run the models pretty well. My 1070ti still kicks ass all these years later and you can find them for $100 bucks or less on ebay used. Ive used it for ollama as well and it does just fine.
Will it be super fast or a really big model? No, but if its for personal use, i dont see any benefit to paying a monthly subscription for it and like i said, works well enough for me.
Its also more secure and private to host it yourself if thats worth anything to you. Thats one of the biggest reasons i self host.
I expected a rhyme and this a crime! This happens almost every time. The meme makes word play but doesnt finish the lines. Such is often the case for memes of felines.
I was recently looking for something like this and couldn’t find what i was looking for, so thanks!
I tried umbrel and wasnt super impressed. It seemed like it would function alright for the small amount of things i was trying to do but broke shortly after installing. I set up pihole and i think jellyfin since i was just testing it out on an older laptop.
I’ve heard decent things about CasaOS but have not used it myself.
Yea you’re not wrong. Kinda fed up with most smartphone manufacturers these days. Its all so restrictive. And to your point that Google is one of the only manufacturers that allows the bootloader to be relocked, thats for now. No telling what will happen in the future which is another part of my issue.
At one point i was considering making a small pc out of a raspberry pi or something to replace my phone just cause i dont like the way phone manufacturing in general is going lol.
Kinda silly but i still think about it.
Thats pretty cool! My only gripe is I dont really wanna buy a pixel phone and I think there are unofficial roms for other android devices but idk if its worth the hassle.
I dont use Graphene OS but my understanding was that it allows the user to sandbox Google play apps: https://grapheneos.org/usage#sandboxed-google-play
So this gives Google play less access than it normally would. I think thats probably the biggest draw of it other than security updates for longer periods of time for older hardware i imagine.
Again, I’m not a user of it so i cant say for sure but I’ve beem interested in trying it out as it seems up my alley as I’m getting more pivacy conscious as the years go by.
88 x 8TB drives? 704 TB of storage?
You got a whole damn data center lol. Good stuff dude. Was this off of ebay or direct from a company? I’m curious to know the total cost.
I love this idea, because I often have questions like this as I transition away from proprietary software to open source alternatives
I think listing what software equivalents it might replace listed in the card.
I do see its listed when you click on the info card in the main list, but having it be visible before that might be helpful.
I know a lot of people won’t like the little ad cards when you do click on a software to review its page, but I think the way you implementted it is good. Its not intrusive and clearly states its an ad.
Edit: removed bit about categories.