4 points | by amaitu 13 hours ago ago
2 comments
How's your experience with 4bit quant ? Does the code output remain decent enough ?
TBH, still trying it out. Some early tests indicate it's on par with something like Gemini 2 flash.
How's your experience with 4bit quant ? Does the code output remain decent enough ?
TBH, still trying it out. Some early tests indicate it's on par with something like Gemini 2 flash.