Thank you for sharing. I'm running Gemma4:12b and qwen-coder-next MoE on my local RTX5080 (yes, 16Gb). Using them for local agentic tasks with tools and MCP tools usage. Both hallucinating on my setup. Do you have a rating for most appropriate local models for local agenting tasks? I also tried kimi2.6, qwen3.6 - no luck.
I'd try Qwen 3.6 35B-A3B or 27B with a temperature of around 0.6. You'd need to offload some of it to RAM though. I've had okay luck with Gemma 4 12B with a temperature of 1.0 but it will miss things a lot :(
Thank you for sharing. I'm running Gemma4:12b and qwen-coder-next MoE on my local RTX5080 (yes, 16Gb). Using them for local agentic tasks with tools and MCP tools usage. Both hallucinating on my setup. Do you have a rating for most appropriate local models for local agenting tasks? I also tried kimi2.6, qwen3.6 - no luck.
I'd try Qwen 3.6 35B-A3B or 27B with a temperature of around 0.6. You'd need to offload some of it to RAM though. I've had okay luck with Gemma 4 12B with a temperature of 1.0 but it will miss things a lot :(