Hailo-10 is designed to run generative AI services directly on targeted devices, enhancing their current and future CPUs. The chip can deliver up to 40 TOPS (tera operations per second), a new performance standard for edge AI accelerators, according to Hailo. The company claims that Hailo-10 is more effective for inferencing than a GPU-based solution in terms of cost and power consumption. The initial industries to be targeted when Hailo-10 begins shipping are the PC and auto infotainment categories.
Key takeaways:
- Hailo, an Israel-based startup, has launched a new energy-efficient gen AI accelerator for edge devices called Hailo-10, designed to deploy gen AI applications across edge devices without relying on cloud data centers.
- The company has also extended its series C round with an additional investment of $120 million, valuing the company at $1.2 billion.
- Hailo-10 is designed to run gen AI services directly on targeted devices, enhancing their current and future CPUs without straining the CPU or draining the battery.
- The new chip will begin shipping in Q2 2024, initially targeting the PC and auto infotainment categories.