| Listen to this article |
Automation in the Age of IT-OT Convergence
Companies are constantly looking for better ways to augment their existing operational workloads, optimize production processes, and reduce overall Carbon Dioxide (CO2) emissions. The use of Operational Technology (OT) and Information Technology (IT) has helped enterprises better control their operations by monitoring valuable assets, reducing repetitive and routine tasks, and enhancing quality control. However, IT and OT have been traditionally developed separately with no ability to exploit operations and production data to make more informed decisions for more optimized workflow and well-planned production and maintenance processes.
The emergence of the Internet of Things (IoT) in recent years blurs the boundaries between the two systems, leading to a more convergent solution. IoT devices belonging to the IT domain can collect operational and production data from the field and communicate them to the OT systems.
The convergence of IT and OT will allow workers to do more and go further with their improvements, striking the right balance between the cost of business and strategic technology investment. Furthermore, this convergence will enable enterprises to accelerate their digital transformation and optimize their existing workflows, all without needing to scale up rapidly.
Graphics Processing Units (GPUs) have proven ideal for executing the data processing based on Machine Learning (ML) algorithms, allowing robots to perform object recognition and sensor fusion. Further advances have come from developing Application-Specific Integrated Circuit (ASIC) that excel in specific ML applications, such as video processing and speech recognition.
Robotics Automation
One of the technologies that best represent IT-OT convergence is operations management through robotics automation. With automated processes, companies can analyze data, obtain valuable insights, and gain improved visibility of their production sites’ performance, helping them make data-driven decisions. However, robotics development has traditionally been very complex and challenging. As demand for robots is expected to increase rapidly, the current rate of innovation can be accelerated with the proper hardware and software offerings.
The Rise of Robotics
In general, the deployment of robots has led these devices to host new functions aiming to increase workforce safety, reduce strenuous and hazardous tasks for human employees, accelerate e-commerce fulfillment and delivery, and enhance business flexibility and resilience. These new functions require the implementation of high-accuracy sensors that fulfill functional safety and risk prevention requirements, cameras for detection, localization, and navigation, and robotics middleware for application onboarding. In recent years, key advancements in robotics hardware allow robotics Original Equipment Manufacturers (OEMs) to develop robots that can see and sense their environments:
At the same time, advancements in software and services also deserve much attention:
Through these key advancements, robots can now work alongside a human safely and reliably. Apart from industrial robotics arms, more form factors have emerged in recent years, such as Collaborative Robots (cobots), AGVs, AMRs, Automated Storage and Retrieval Systems (ASRS), and Unmanned Aerial Vehicles (UAVs).
A common denominator across all these robots is their ability to perceive and make sense of their surrounding environment. This autonomy is enabled through several ML models found in the robots, such as object detection and segmentation, localization and collision avoidance, motion planning for navigation and manipulation, pose estimation, and sensor integration.
Edge ML enables robotics users to make sense of the mountain of data they collect from their assets and make much better business decisions based on daily operation, usage trends, and customer behaviors.
Edge ML in Robotics
Robotics OEMs have embedded edge ML into their robots to help with performing critical functions, including sensor processing, odometry, localization and mapping, vision and perception, and path planning. These ML models hosted inside robots automatically process data collected by the robots and generate an output that dictates the robots’ actions. Edge ML holds several key advantages over its cloud counterpart:
Edge ML enables robotics users to make sense of the mountain of data they collect from their assets and make much better business decisions based on daily operation, usage trends, and customer behaviors. To achieve seamless edge ML deployment, robotics OEMs require the right type of processors to resolve concerns around data privacy, power efficiency, and low latency, while providing strong on-device computing performance. In addition, OEMs rely on edge ML software support from these processor suppliers to accelerate edge ML deployment. A comprehensive edge ML solution from established vendors can reduce complexity, and accelerate edge ML design and operations, while also providing workload orchestration, training and testing simulation, and model retraining support.
That said, edge ML deployment in robots remains complex. Higher computational capability alone is not sufficient. Companies need pre-trained models, application development and optimization, and ML applications for more hands-on end users.
Tools and Services Speeding Robotics Development
Advanced industrial robotics are packed with multiple features capable of executing a number of mission-critical functions. The execution and the orchestration of these functions require highly sophisticated, densified, and scalable processing solutions that can process multiple concurrent applications, workloads, and AI inference pipelines without the constant reliance on cloud computing resources. These solutions should also support high-speed interfaces to handle the multiple sensors featured in modern industrial robots.
NVIDIA is one of the key processor platform suppliers to dedicate particular attention to this area. At GTC 2022, NVIDIA launched the Jetson AGX Orin developer kit and System-on-Module (SOM) based on the Ampere GPU architecture with up to 2,048 parallel CUDA cores, up to 64 Tensor Cores, and up to 2 Deep Learning Accelerator (DLA) engines. This solution is designed to handle the ever-increasing workload and multi-concurrency demands by enabling up to 275 Tera Operations per Second (TOPS) of processing power, 8X higher than Jetson AGX Xavier, its predecessor.
To accelerate time-to-market, NVIDIA also offers Isaac Nova Orin, which features two Jetson AGX Orin SOMs that provide up to 550 TOPS of AI compute, and a sensor suite consisting of up to six cameras, three LiDAR sensors, and eight ultrasonic sensors. This provides a reference design for companies that want their robots to leverage the full capabilities of Jetson AGX Orin.
That said, edge ML deployment in robots remains complex. Higher computational capability alone is not sufficient. Companies need pre-trained models, application development and optimization, and ML applications for more hands-on end users. First launched in 2018, NVIDIA Isaac was designed to support robotics development through an application framework, software packages with ML algorithms, an upgraded robotics simulation platform, and various reference designs. In September 2021, NVIDIA and Open Robotics, the developer of ROS, entered into an agreement enabling interoperability between Open Robotics’ Ignition Gazebo and NVIDIA Isaac Sim. In addition, for developers that look at existing models to simplify their model development process, the NVIDIA TAO Transfer Learning Toolkit makes it easier for them to further adapt pre-trained ML models by NVIDIA for specific use cases.
With the software support from NVIDIA, robotics OEMs and end users train and optimize robots for a breadth of tasks virtually. Isaac Sim provides a realistic environment to train navigation and manipulation models. In the cases where real-world data are rare and hard to obtain, accurate data can be augmented with synthetic data to reduce the time for model training. Companies operating a large fleet of AMRs at production sites can use the NVIDIA DeepMap platform’s cloud-based Software Development Kit (SDK) to speed robot mapping of extensive facilities from weeks to days, NVIDIA cuOpt Application Programming Interface (API) to enable near real-time routing optimizations, and NVIDIA Metropolis platform to integrate off-the-shelf video cameras and sensors with AI-enabled video analytics.
In addition, NVIDIA has built a growing ecosystem that possesses domain expertise in building robots with the Jetson platform. This includes 105 companies specializing in AI software, hardware and application design services, sensors and peripherals, developer tools, development systems, and more, providing complementary and value-added solutions and services. Leading partners include SICK, LIPS, FRAMOS, Universal Robots, and e-con Systems. Through this ecosystem, robotics OEMs and end users can expect end-to-end, integrated, and tailored experiences based on a deep understanding of their needs.
The intralogistics market for mobile robots is expected to grow from US$9 billion in 2022 to top US$36 billion by 2030. Both AGVs and AMRs are deployed in brownfield and greenfield warehouses for material handling.
Commercial Opportunities Abound
While still heavily centralized in the industry, technological innovations across hardware, software, and business models accelerate robotic deployment across all major market verticals. As a result, the intralogistics market for mobile robots is expected to grow from US$9 billion in 2022 to top US$36 billion by 2030. Both AGVs and AMRs are deployed in brownfield and greenfield warehouses for material handling.
Now, AMRs and forklifts are used for material handling and mobile manipulation in manufacturing, which is expected to go from US$2.3 billion in 2022 to US$36.4 billion by 2030. Moving forward, AMRs and quadruped robots are expected to become more prominent in delivery, data collection, security, and cleaning. The last-mile delivery and retail robotics market are expected to grow from less than US$1 billion and US$1.3 billion in 2022 to US$16.2 billion and US$8.4 billion by 2030, respectively.
Robotics and ML
As companies continue to digitalize and automate their current workflows, they should not overlook the importance of robotics and ML-based automation. The emergence of a data-driven business environment, edge ML technologies, dedicated robotics development platform, and robust partner ecosystem is creating new opportunities for accepting and adopting robots across various markets.
Undoubtedly, current and immediate robotics adoption is heavily weighted toward larger companies. Still, emerging technologies present an opportunity for robotics providers to successfully lower the adoption barrier for small and medium businesses. A comprehensive hardware and software solution, like the one offered by NVIDIA, makes these technologies more accessible to both robotics OEMs and end users. Furthermore, partnering with an experienced company with a suitable robotics ecosystem, i.e., from the edge ML chipset layer to the software and applications layer, allows robotics OEMs to focus on perfecting their hardware design and expanding their market presence.
About the Author
Lian Jye Su, Principal Analyst at ABI Research, is responsible for orchestrating research related to robotics, Artificial Intelligence (AI), and Machine Learning (ML). He leads research in emerging and key trends in these industries, diving deeply into advancements in key components, regional dynamics in robotics and AI adoptions, and their future impacts and implications.
Related Content
