Artificial intelligence (AI) has found its way into every industry and is one of the megatrends that will shape future applications. In mobile machinery, AI is predominantly used to enhance safety, operability, and efficiency, and enable more autonomous operations. TTControl’s FusionAI supports AI-enhanced functionality for off-highway vehicles. It is a multi-screen, multi-interface computing platform integrating human-machine interface (HMI), AI, internet gateway, and infotainment in a complete solution. As AI-enhanced applications require a lot of data to be read, processed, and analyzed in real-time, FusionAI integrates the Hailo-8 AI Accelerator to enable real-time, low latency, and highly efficient AI inferencing.
FusionAI was designed especially for edge AI applications in the off-highway sector. It combines robust operator interface capabilities with AI acceleration for advanced image and sensor data processing and supports advanced assistance systems and highly automated working functions. FusionAI can drive up to four displays and offers integrated safety mechanisms and versatile connectivity options via CAN and Ethernet. FusionAI is already being used for AI-enhanced applications in agriculture and in special vehicles for plant/object detection and image processing.
Hailo.ai is a leading manufacturer of AI processors, designed to run advanced machine learning applications on the edge for use across a range of industries – from smart cities, to automotive, manufacturing, agriculture, and more. TTControl and Hailo.ai have been working together since 2021, when TTControl was developing FusionAI. Due to the high processing requirements of AI applications, normal CPUs are inefficient or too slow; therefore, AI accelerators are needed. These are specialized processors, optimized for the calculations necessary for the execution of AI algorithms.
FusionAI combines high processing power with relatively low energy consumption, which is especially important for applications in mobile machinery. The integrated Hailo-8 AI Accelerator offers high performance of up to 26 tera-operations per second (TOPS), a requirement for advanced analytics, high-resolution, and high-frame-rate video streams. These ensure reliable, highly accurate detection even of small objects and fast-moving elements, thus reducing false alerts and ensuring safe operation.
Safe and efficient AI-enhanced operations across industries
FusionAI can be applied in different industries to enhance efficiency and safety through AI-driven solutions. The main use is to process camera images with AI. In agriculture, FusionAI enables precision farming by distinguishing weeds from crops and thus helping reduce pesticide usage and environmental impact. For municipal vehicles, AI sensors detect curbs autonomously, improving performance, and preventing damage. In special vehicles, AI-powered object detection identifies obstacles and hazards, alerting operators to minimize accidents and boost productivity.
Users benefit from pre-trained AI algorithms from Hailo.ai that are optimized for execution on the Hailo-8 AI Accelerator. These can be used as is or further trained and optimized for the customers’ use cases. The processing results are compiled by Hailo.ai’s software tooling and then used directly for the desired application on FusionAI.
Find out more:
- FusionAI product page
- Hailo.ai’s Hailo-8 AI Accelerator
- Agricultural use case: HORSCH uses FusionAI to further develop AI functionality in its spot spraying solution
