INT2 KV-cache quantization is getting surprisingly good

(arxiv.org)

1 points | by yunuyean 7 hours ago ago

1 comments