Also, I’m going to plug the AI Horde, which is basically the Fediverse for AI self hosting: https://aihorde.net/
It’s awesome! Though a bit sparsely populated, like Lemmy, heh.
Ping me, and I can host a medium-sized model to try for a few hours (via those linked web UIs), if you want. The options are limitless, from something STEM-focused like Nemotron 49B, to a long context model like Bytedance’s new 36B, to, dungeonmaster finetunes, to horny as heck roleplaying models, lol. But they should be significantly better than whatever 8B ollama downloads by default.
Yep!
Also, I’m going to plug the AI Horde, which is basically the Fediverse for AI self hosting: https://aihorde.net/
It’s awesome! Though a bit sparsely populated, like Lemmy, heh.
Ping me, and I can host a medium-sized model to try for a few hours (via those linked web UIs), if you want. The options are limitless, from something STEM-focused like Nemotron 49B, to a long context model like Bytedance’s new 36B, to, dungeonmaster finetunes, to horny as heck roleplaying models, lol. But they should be significantly better than whatever 8B ollama downloads by default.