ZML/LLMD alpha – cross platform LLM server

3 comments

• dannyw 6 hours ago

  Exciting to see! How well does it work on the DGX Spark and Strix Halo?

• micaudn 6 hours ago

  Wow, token debit looks nice, is there any bench on spark?

• futurecat 5 hours ago

  Congrats!