Laguna XS 2.1 33B on a RTX 3090: 296 tok/s peak, 152 tok/s at 256K context

(lucebox.com)

5 points | by GreenGames 7 hours ago ago

No comments yet.