New inference engine faster than vLLM, SGLang, TRT-LLM

(layerscale.ai)

2 points | by logotype 6 hours ago ago

1 comments