It’s a bit strange. On one side you talk about a project you work on, so I expect a repo on github or something, on the other side the link you post redirect to a product or a service you seems to sell.
It’s cool if you can make money with it, but to be more effective you might have to clarify your point.
I don’t even understand what that guy is trying to sell. Is it some kind of picture of a monkey ?
Poor internet connection/no internet at all, network latency too high for their needs, specific fine tuned LLM ?
Off course, main reason is privacy. My company host its own GPT4 chatbot, and forbid us to use public ones. But I suppose there are other legit use case to host its own LLM.
Maybe worth to mention that bitwarden also propose bitwarden.eu to host data in Europe. I’ve used bitwarden.com for years, and switch to bitwarden.eu a few month ago because of reasons, you know…
Dad: “I don’t have my wallpaper anymore on my desktop !”
Me: “Ok, what’s in C:\User.…\Pictures” ?
Dad: "I don’t have C:, I juste have D:"
Me: “WTF ? You don’t have a C:\Windows folder ?”
Dad: “No, I just have a D:\ drive. Windows is installed on D”
How th fuck did he managed to not have a C drive ???
The point of self hosting is not to engage people going in your server. The point of self hosting is to have control over your infrastructure. It’s like renting or buying a home.
When you buy a home, you don’t complain that no one wants to sleep in your home 😆