French Startup ZML Releases Free Tool to Accelerate Inference Across Multiple AI Chips
AI News Brief: French AI startup ZML has officially launched its inference server software LLMD, aiming to let major open-source LLMs run at near-native or beyond-native peak speeds across chips from various vendors. Supported hardware covers Nvidia GPUs, AMD, Google TPU, Apple Metal, and Intel Arc. Founder Steeve Morin said AI inference is gradually surpassing model training in importance, but the software-architecture divide locks enterprises into specific vendors. ZML’s core pitch is to let enterprises and cloud providers mix and match chips from different sources, cutting costs or energy use to make large-scale AI adoption possible.