Much of the conversation around AI today is focused on building cloud capacity and massive data centers to run models. Companies like Apple and Qualcomm are in the early stages of making on-device AI more useful. Amid all that, the 14-person technical team of London-based Mirai is working to improve how models run on phones and laptops.
Mirai, which is backed by a $10 million seed round led by Uncork Capital, was founded by Dima Shvets and Alexey Moiseenkov last year. Both founders have experience in building scalable consumer apps. Shevts co-founded face-swapping app Reface, which was backed by a16z. Shevts later also became a scout for the venture firm. Moiseenkov was CEO and co-founder of the last decade’s viral AI filters app, Prisma.
As consumer developers, both had been thinking about AI and machine learning on devices even before generative AI became popular, Shvets said.
“When we met together in London, we started to chat about technology, and we realized that within the hype of gen AI and more AI adoption, everybody speaks about cloud, about servers, about AGI coming. But the missing piece is on-device [AI] for consumer hardware,” he told TechCrunch.
Shevts and Moiseenkov wanted to use AI to create a pipeline that would allow them to enable complex tasks on the phone, which led them to start Mirai. When they asked others who developed consumer apps, they heard that many wanted better cost optimization and margin per token usage, too.
Co-founders Alexey Moiseenkov and Dima Shvet Image Credits: Mirai
Today, Mirai is developing a framework for models so they can perform better on devices. The company has built an inference engine for Apple Silicon that optimizes on-device throughput. With its upcoming SDK, developers can integrate the runtime in their apps with only a few lines, the company says.
“One of the visions why we started the company was that we wanted to give developers, like this Stripe-like, eight …