Zebra Technologies and Qualcomm unite for On-Device generative AI

Zebra Technologies Corporation, a digital solution provider enabling businesses to intelligently connect data, assets, and people has successfully demonstrated an On-device Generative AI large language model (LLM) running on Zebra handheld mobile computers and tablets without needing connectivity to the cloud.

The breakthrough technology now allows Zebra partners and customers to access exciting productivity gains, which will revolutionize the future of work in various industries, including retail, warehouse, logistics, hospitality, and healthcare. With the on-device execution of GenAI LLMs, frontline workers can now acquire new capabilities that can help them deliver better outcomes for their end customers.

On-device AI provides enhanced privacy and security as data stays on the device. It also leads to faster performance and lower costs as cloud-based GenAI searches can be very expensive. According to a whitepaper published by Qualcomm Technologies, Inc., the cost per query for GenAI-based search is estimated to increase by ten times when compared to traditional search methods. By eliminating the need for cloud utilization, costs can be significantly reduced. This technology can also offer additional personalization, resulting in a better user experience.

“Zebra’s devices are powerful platforms with cutting-edge software and AI models which we’re driving forward with our partner ecosystem to solve customer challenges and add value,” said Tom Bianculli, Chief Technology Officer, Zebra Technologies. “We’re taking GenAI to the mobile edge on-device and applying it to areas such as voice AI, computer vision, and machine vision software powered by deep learning as well as task and workflow software using orchestrated AI.”

Potential use cases for LLMs include improving associate effectiveness by enhancing their product and customer service knowledge, acting as an efficient internal communications tool by answering employee queries on things like store policies, collecting and analyzing feedback from associates to identify areas of improvement, enhancing productivity, and increasing job satisfaction levels.

LLMs also have the potential to elevate the customer experience by powering personalized shopping assistants that could provide product recommendations, integrating shopping experiences across in-store, online, and mobile platforms as well as potentially enabling fully voice-activated shopping.

Zebra's range of mobile computers and tablets, including TC53/TC58, TC73/TC78, and ET6x Series, are powered by Qualcomm Technologies. When combined with Zebra's asset visibility and intelligent automation solutions, they provide enhanced data insight, analysis, recommendations, problem-solving, planning, and creativity. These devices can be used by frontline workers, even in remote, built-up, and underground environments where connecting to the cloud may not be feasible. Additionally, users can switch to a cloud-based app or web browser using Zebra's Wi-Fi 6/6E and 5G enabled devices.

“On-device generative AI is unlocking new and enhanced experiences across industries,” said Megha Daga, Senior Director, Product Management, at Qualcomm Technologies, Inc. “Qualcomm Technologies’ goal is to drive the transformation of industries, and we are doing that beginning with mobile devices. Zebra’s demonstration is showcasing the type of transformation we aim to achieve.”

Zebra has developed an innovative solution that utilizes Qualcomm Technologies' platform, reducing memory requirements. The solution is built on a wide range of open-source and third-party models, which is a crucial part of Zebra's strategy to deliver efficient on-edge AI solutions to various industries.

“Zebra recognizes the importance of ethical and responsible AI,” said Andrea Mirabile, Director of AI Research, at Zebra Technologies. “We are committed to ensuring our AI initiatives are aligned with federal guidance on accountability, ethical purpose, and transparency and help set the standard related to delivering solutions to end-users. We also support the Business Roundtable AI Road Map and policy recommendations for responsible, appropriate, and ethical AI development and deployment.”