What We Know About Nvidia's Latest Competitor, HAILO

Nvidia might be dominating the headlines with its slew of generative AI hardware and software solutions, but it’s not the only player in town. Emerging from the bustling tech scene in Israel, Hailo is quickly becoming a name to reckon with, especially with its latest innovation that’s set to challenge the status quo. The Hailo-10, an energy-efficient gen AI accelerator specifically designed for edge devices, is making waves and for good reasons. Unlike typical processors that rely on cloud data centers, the Hailo-10 is equipped to run generative AI applications directly on devices like automobiles and commercial robots. This leap in technology promises not only enhanced performance but also notable cost and energy savings.

Recent developments see Hailo extending its Series C funding round, adding a noteworthy $120 million to its coffers, now valuing the company at an impressive $1.2 billion. This financial boost spells an ambitious future for Hailo, paving the way for further innovation and the expansion of generative AI into new territories. According to Orr Danon, Hailo’s co-founder and CEO, this move “enables us to leverage all the exciting opportunities in our pipeline while setting the stage for our long-term future growth.”

But what exactly does the Hailo-10 gen AI accelerator bring to the table? Apart from reducing reliance on cloud data centers and thus minimizing latency issues commonly associated with edge computing, the chip is remarkably efficient. Running generative AI models like Llama2-7B and Stable Diffusion 2.1 at impressively low power consumption levels, it showcases Hailo’s innovative approach to performance, cost, and energy efficiency.

Key Features & Benefits of Hailo-10

High Performance Processing: The Hailo-10 gen AI accelerator stands out for its ability to handle generative AI models, including large language models (LLMs), with minimal impact on CPU/GPU loads. This capability ensures that devices can run complex AI models without compromising on speed or functionality.
Powerful AI Accelerators: Powered by the Hailo-10H, which delivers an astounding 40 Tera-Operations Per Second (TOPS), it underscores Hailo’s commitment to pushing the boundaries of what’s possible in AI acceleration.
Real-time, Low Latency AI Inferencing: Designed for real-time applications, the Hailo-10 enables swift and efficient AI inferencing on PCs, smart cars, and other edge devices. This ensures timely responses crucial for applications requiring instant decision-making.
Unmatched Cost Efficiency: When it comes to TOPS per dollar, the Hailo-10 distinguishes itself from competitors, offering unparalleled value and making it an attractive option for companies looking to integrate AI capabilities without incurring exorbitant costs.
Best-in-Class Power Efficiency: The Hailo-10’s energy consumption is remarkably low, under 3.5W typically. This efficiency not only benefits the environment but also significantly reduces operational costs for devices powered by Hailo’s technology.
Quick Time to Market: The adoption of a standard M.2 form factor for the Hailo-10 module facilitates a fast time to market for devices integrated with Hailo’s technology, streamlining the deployment process for manufacturers.
Scalability: The technology’s scalable nature allows for the simultaneous processing of multiple models without degradation in performance, ensuring that devices can keep up with the demand of multitasking in AI-driven applications.
Robust Software Suite: Hailo provides a comprehensive software suite designed to support the most advanced deep learning models and generative AI applications, ensuring developers and manufacturers can easily integrate and leverage these capabilities in their products.

The tech world has its eyes on Hailo as it promises to deliver at least twice the performance at half the power of Intel’s Core Ultra NPU. With a unique dataflow-based architecture, Hailo stands out for its ability to support a wide array of AI-based applications across various modalities, all at a fraction of the power consumption typically required. This positions Hailo as a strong contender in the edge AI market, offering a promising alternative to existing solutions, including those from giants like Nvidia and Intel.

In essence, Hailo is not just upending conventional approaches to edge AI computing but is also setting the stage for a future where generative AI’s potential is fully realized in a multitude of settings, from everyday gadgets to industrial machines. With Hailo-10, the company is inching closer to making this future a reality, and it’s a development worth watching.

LA STARTUPS

Website | + posts

LAStartups.com is a digital lifestyle publication that covers the culture of startups and technology companies in Los Angeles. It is the go-to site for people who want to keep up with what matters in Los Angeles’ tech and startups from those who know the city best.