Qualcomm innovation labs, Research institute in San Diego, California

New Delhi, May 16 As generative artificial intelligence (AI) and chatbots like Microsoft-backed OpenAIs ChatGPT and Google Bard take the world by storm, Hybrid AI will allow generative AI developers and providers to take advantage of the compute capabilities available in edge devices to reduce costs, chip maker Qualcomm has said.In a white paper, the company said that hybrid processing is more important than ever."A hybrid AI architecture distributes and coordinates AI workloads among cloud and edge devices, rather than processing in the cloud alone," said the chip maker.The cloud and edge devices smartphones, cars, personal computers, and Internet of Things (IoT) devices work together to deliver more powerful, efficient and highly optimised AI."The main motivation is cost savings. For instance, generative AI-based search cost per query is estimated to increase by 10 times compared to traditional search methods and this is just one of many generative AI applications," Qualcomm stressed.Hybrid AI even allows for devices and cloud to run models concurrently with devices running light versions of the model while the cloud processes multiple tokens of the full model in parallel and corrects the device answers if needed.AI models with more than 1 billion parameters are already running on phones with performance and accuracy levels similar to those of the cloud, and models with 10 billion parameters or more are slated to run on devices in the near future.Disclaimer: This post has been auto-published from an agency feed without any modifications to the text and has not been reviewed by an editor

Qualcomm Innovation LabsFOLLOW

Qualcomm innovation labs, Latest News

2023 perennial winner Joey Chestnut is out of the 2024 Nathan's Hot Dog Eating Contest due to a deal ... ...

California, March 17: Indian athlete Gulveer Singh broke the long-time national record in the men's 10,000 metre category during ... ...

Marco Troper, the 19-year-old son of former YouTube CEO Susan Wojcicki, was discovered dead in his dormitory at the ... ...

An Indian-origin family hailing from Kerala tragically met their demise in their California home in what appears to be ... ...

Heavy rainfall triggered massive flooding in San Diego on Tuesday (January 23), leading to major waterlogging in California and ... ...

A Hindu temple has been vandalized with anti-India and pro-Khalistan graffiti on its exterior walls in Newark, California, United ... ...

In the vibrant landscape of Palm Springs, California, where the sun kisses the desert and the city thrums with ... ...

New Delhi, May 16 As generative artificial intelligence (AI) and chatbots like Microsoft-backed OpenAIs ChatGPT and Google Bard ... ...