This. Llama.cpp with Vulkan backend running in docker-compose, some Qwen3-Coder quantization from huggingface and pointing Opencode to that local setup with a OpenAI-compatible is working great for me.
- 0 Posts
- 2 Comments
Joined 8 months ago
Cake day: June 5th, 2025
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
jan.ai with some local model