The tech industry is no alien to Meta and Qualcomm. Both these massive tech organizations have a strong hold over different aspects of the industry. As per the latest reports, Qualcomm and Meta have joined forces to optimize the execution of Meta’s Llama 2 large language models directly on-device, eliminating the need for heavy reliance on cloud services. By running generative AI models like Llama 2 on smartphones, PCs, VR/AR headsets, and vehicles, developers can offer users more private, reliable, and personalized experiences while saving on cloud costs.

On-device AI can function seamlessly even in airplane mode

The partnership aims to make on-device Llama 2-based AI implementations available, empowering developers to create innovative AI applications. Customers, partners, and developers will be able to harness the power of these AI experiences to build intelligent virtual assistants, productivity tools, content creation platforms, and entertainment applications. One significant advantage of on-device AI is its capability to function in areas with no internet connectivity or even in airplane mode.

qualcomm

Durga Malladi, senior vice president, and general manager of technology, planning, and edge solutions businesses at Qualcomm Technologies, expressed support for Meta’s approach to open and responsible AI. Malladi emphasized the company’s commitment to driving innovation and facilitating AI development for developers of all sizes, envisioning generative AI to run seamlessly on both the cloud and edge devices such as smartphones, laptops, vehicles, and IoT devices.

The collaboration between Meta and Qualcomm Technologies builds upon their longstanding history of driving technology innovation to deliver premium device experiences. This partnership includes joint research and product engineering efforts aimed at supporting the Llama ecosystem. Qualcomm Technologies’ leadership in on-device AI uniquely positions it to support Llama, given its extensive presence at the edge, powering billions of smartphones, vehicles, XR headsets, glasses, PCs, and IoT devices with industry-leading AI hardware and software solutions.

Scheduled to be available from 2024 onwards, Qualcomm Technologies plans to offer Llama 2-based AI implementations on devices powered by Snapdragon. Developers can get started today by optimizing their applications for on-device AI using the Qualcomm® AI Stack, a dedicated set of tools enabling more efficient AI processing on Snapdragon. This breakthrough technology makes on-device AI possible even in small, thin, and light devices. The future of technology seems promising, and full of surprises. We are here for it all!

RELATED:

(Source)