AI chipmaker Hailo rolls out acceleration modules for edge devices

The Israeli company's modules are said to outperform Intel’s Myriad-X modules by 26 times and Google’s Edge TPUs by 13 times Frames Per Second (FPS) on average across multiple standard Neural Network benchmarks

Photo: Hailo

Leading AI chipmaker Hailo announced today the launch of its M.2 and Mini PCIe high-performance AI acceleration modules for empowering edge devices. Integrating the Hailo-8TM processor, the modules can be plugged into a variety of edge devices to provide superior AI capabilities for smart cities, smart retail, industry 4.0, smart homes and other fields. 

The modules offer a more flexible and optimized solution for accelerating a large range of deep learning-based applications with high efficiency, optimizing time to market with a standard form factor, the company said.  

Hailo's AI acceleration modules seamlessly integrate into standard frameworks, such as TensorFlow and ONNX, which are both supported by Hailo's comprehensive Dataflow Compiler. Customers can quickly port their Neural Networks (NNs) into the Hailo-8 processor, ensuring high-performance, enabling smarter AI products, and accelerating time-to-market, according to the company.

The plug-in solutions come at a time when industries are increasingly utilizing edge devices that are both high-performing and cost-effective. For example, fanless AI edge boxes are in high demand as they allow many cameras or sensors to be connected to a single intelligent processing device in outdoor deployment. Hailo’s modules – with their high-performing Hailo-8 AI processor delivering 26 Tera-Operations Per Second (TOPS) and high-power efficiency of 3 TOPS/W – can be plugged into any existing edge device with the appropriate M.2 or Mini PCIe sockets, delivering unprecedented performance while reducing latency and improving privacy, the company said. 

A comparison between the Hailo-8 average Frames Per Second (FPS) with competitors across multiple standard NN benchmarks (based on the latest published figures), Hailo said, shows that the company's AI modules achieve a FPS rate 26 times higher than Intel’s Myriad-X(1) modules and 13 times higher than Google’s Edge TPU(2) modules.

“Manufacturers across industries understand how crucial it is to integrate AI capabilities into their edge devices. Simply put, solutions without AI can no longer compete,” said Orr Danon, CEO of Hailo. “Our new Hailo-8 M.2 and Mini PCIe modules will empower companies worldwide to create new powerful, cost-efficient, innovative AI-based products with a short time-to-market – while staying within the systems’ thermal constraints. The high efficiency and top performance of Hailo’s modules are a true gamechanger for the edge market.”