The world of AI is abuzz with excitement as Inferact, a startup born from the popular open-source project vLLM, has secured a massive $150 million in seed funding! This news has sent ripples through the tech industry, especially as it follows closely on the heels of another AI project's commercialization.
The AI Inference Revolution: Unlocking the Power of AI Applications
In a bold move, the creators of vLLM have transformed their project into a VC-backed startup, Inferact. This decision comes at a pivotal moment as the AI landscape shifts its focus from training models to deploying them in real-world applications, a process known as inference.
And here's where it gets controversial: Inferact's journey mirrors that of RadixArk, another AI project that recently spun out as a commercial entity. Both vLLM and RadixArk (formerly SGLang) were incubated in the same UC Berkeley lab, showcasing the potential for groundbreaking AI innovations to emerge from academic settings.
The key to their success? Making AI tools run faster and more affordably. As Simon Mo, Inferact's CEO and one of the original creators of vLLM, told Bloomberg, existing users of vLLM include Amazon's cloud service and a popular shopping app.
This shift towards inference and the commercialization of AI tools is a hot topic in the industry. With technologies like vLLM and SGLang gaining investor attention, the question arises: Are we witnessing the beginning of a new era in AI deployment?
And this is the part most people miss: The inference market is exploding, and these startups are at the forefront. With their innovative technologies, they're making AI more accessible and efficient.
So, what do you think? Is this the future of AI, or is there a catch we're missing? We'd love to hear your thoughts in the comments!
