blazeroulette| Qualcomm Hou Mingjuan: Promote terminal-side AI transformation and create a future of intelligent interconnection of everything

On May 16th, the 2024 World Telecommunication and Information Society Day conference and series of activities with the theme of "Digital Innovation enabling New industrialization" kicked off in Ningbo, Zhejiang Province. As one of the parallel forums held on the first day of the 517 Conference, the AI Terminal Future Forum takes "AI has come, Terminal Future" as its theme, bringing together representatives from all sides of the industry chain to focus on cutting-edge innovative technologies such as generative AI and AI terminal industry development trends for in-depth discussion.

At the beginning of the forum, Hou Mingjuan, vice president of Qualcomm, brought the theme of "promoting the arrival of terminal-side generative AI era" to share. She said that the industry is facing an excellent opportunity for the development of AI, and continuous innovation keeps Qualcomm at the forefront of terminal-side AI solutions. By providing industry-leading hardware and software solutions, Qualcomm is working with partners to promote the large-scale development of generative AI, making terminal-side generative AI ubiquitous and building the future of the Internet of everything.

In the round-table discussion session, representatives of industry chain enterprises and institutions from China Mobile, GSMA, Qualcomm, OPPO, vivo and Zhonghe Group discussed such topics as "AI reshaping intelligent terminal industry", "AI terminal enabling new industrialization and enterprise digital transformation", and talked about the broad development opportunities that generative AI brings to intelligent terminal industry.

The following is a transcript of the theme sharing session.Blazeroulette:

Hello, distinguished guests and industry partners! I am Hou Mingjuan of Qualcomm. It is my pleasure to discuss with you the new opportunities that generative AI brings to the smart terminal industry. Today I would like to share with you the developments of Qualcomm in AI and my thoughts about the future.

When I was on the plane to attend the conference, I saw the latest market research report showing that at present, Chinese users use mobile phones to surf the Internet for an average of about 160 hours per month, every 6 hours.BlazerouletteCheck your phone every 5 minutes and 150 times a day. I personally think that this average may be on the low side for most users, some of whom use it longer and more frequently.

Qualcomm, as well as all the practitioners here today, are facing excellent opportunities for the development of AI. Many AI functions have been realized in smartphones, mobile PC, Internet-connected cars and other terminals within the reach of users.

At the MWC Mobile World Conference in February this year, Qualcomm partnered with Glory, Xiaomi and OPPO to bringBlazerouletteThe terminal side AI is demonstrated. Today, mobile phones are one of the largest industrial products in the world, with annual shipments of nearly 1.2 billion. For practitioners in the mobile phone industry, we have stood at the forefront of terminal-side AI, allowing more consumers to enjoy the convenience brought by AI, such as creating new mobile functions and experiences through AI digital assistant, which is a terminal-side generated AI that has been realized.

In the automotive field, we are honored that many new smart cars recently released use Snapdragon digital chassis solutions, including Snapdragon cockpit platforms (Snapdragon 8295 and 8155). The digital voice assistant in the car, as well as the intelligent driving, route planning, trajectory and behavior prediction functions supported by AI are gradually being realized. Partners, including Jiyue, ideal and Xiaopeng, have released the large model function of the car end based on the Snapdragon 8295 model.

In terms of PC, Qualcomm participated in the TechWorld2024 held by Lenovo in Shanghai last month, and we are jointly promoting the evolution of AI as a productivity tool, including generating original content and improving productivity. Consumers and business users can take advantage of the enhanced end-side tools of the Snapdragon X series platform AI around the clock to increase productivity, creativity, and collaboration.

With the rapid popularity of generative AI and the increasing demand for computing, the cloud economy is difficult to support the large-scale expansion of generative AI, so the cloud must cooperate with the terminal side to run AI applications. The relationship between cloud-based AI applications and AI applications running on the mobile device side can be summarized as "big things ask the cloud, small things ask the terminal". Generally speaking, users use more terminal-based AI applications. For users, the terminal-side AI is more convenient, faster and more private. For example, sometimes parents may be reluctant to cloud the photos of their children for privacy reasons; with terminal-side AI, manufacturers can quickly use the relevant functions of generative AI, even if the flight mode is not connected to the Internet. From an industry point of view, on the one hand, the query cost of traditional search methods is very different from that of spanning AI-based search based on spanning AI, the cost of a single query is 10 times that of traditional search methods; on the other hand, for the consideration of power consumption, it often takes several hundred watts to run a spanning AI model with more than 1 billion parameters in the cloud, but only a few milliwatts on the terminal side.

Qualcomm believes that hybrid AI is the future of AI. For relatively large-scale computing, we can implement it through the cloud; for the content that needs to ensure immediacy, reliability, personalization, privacy and security, and from the point of view of cost savings, we can run the AI model on the terminal side. To really release the full potential of generative AI, the center of gravity of AI processing needs to be shifted to the edge side. The hybrid AI architecture is more convenient and faster than running the AI model only in the cloud. Through the hybrid AI architecture, AI cooperates on the cloud, edge cloud and terminal side, redistributing the computing and processing power of the entire system in the most efficient way.

Terminal-side generative AI has arrived, and several partners here today have released terminal products equipped with Qualcomm's latest flagship mobile platform, the third generation Snapdragon 8. Take the mobile phone as an example, the smartphone is the key carrier to unleash the potential of AI technology, because it is the terminal that consumers use most frequently in their daily life.

In October last year, Qualcomm launched the third generation Snapdragon 8, the first mobile platform built specifically for generative AI. At present, many mobile phones launched by many OEM manufacturers and smartphone brands, including OPPO and vivo, have adopted this state-of-the-art chip specially designed for generative AI, and these products have also been concerned and loved by customers and consumers.

The third generation Snapdragon 8 supports running a generative AI model with up to 10 billion parameters, running a large language model at the speed of 20tokens per second. In addition to excellent AI capabilities, the third generation Snapdragon 8 also brings a comprehensive upgrade experience in video, security, audio, connectivity and other areas. When it comes to the imaging field, with the powerful AI performance of the third generation Snapdragon 8, OEM manufacturers and smartphone brands, including OPPO and vivo, have launched excellent smartphone video experiences, which are as good as professional video devices. In fact, very few people go out with large cameras these days, because our mobile phones have a very good image function.

During our stay in MWC Barcelona, we also demonstrated with OPPO, vivo and other partners a range of commercial flagship AI smartphones with third-generation Snapdragon 8, which support excellent generative AI features such as image AI elimination, AI-enabled photo expansion and photo magic erasure. Suppose there is a passer-by or some wires blocking the picture in a picture, we can easily eliminate it through these functions. In addition, functions such as smart creation schedule, smart tablets and image expansion have been implemented, and everyone can easily use these functions.

In China, more than 20 commercial terminals equipped with top Snapdragon's flagship mobile platform have been launched, providing consumers with a variety of choices. We believe that terminal-side generated AI will bring a new wave of smartphone replacement, whether from the perspective of China Mobile, OPPO, vivo or Qualcomm, our consensus is to open a new AI-based upgrade cycle for the smartphone market.

blazeroulette| Qualcomm Hou Mingjuan: Promote terminal-side AI transformation and create a future of intelligent interconnection of everything

Take PC as an example. At last year's Snapdragon Summit, in addition to releasing the third generation Snapdragon 8 for flagship smartphones, we also released Snapdragon XElite platform, a processor specially built for PC that supports up to 45TOPS computing power, bringing PC the fastest NPU in the world, while achieving first-class energy efficiency and battery life in the industry. We always say that Qualcomm is born for mobile technology, and we have long-term accumulation and leading technological advantages in power control, battery life, mobile computing and so on.

In addition, in April this year, we also expanded the Snapdragon X series platform portfolio and launched the Snapdragon XPlus platform. Snapdragon XPlus uses the advanced 10-core Qualcomm OryonCPU, supports NPU up to 45TOPS, helps consumers and businesses, and can take advantage of the enhanced terminal-side tools of Snapdragon X series platform AI around the clock to enhance productivity, creativity and collaboration.

In the field of XR, we have also worked with ecological partners, including Zhonghe Group, and achieved good results. In the process of transforming the new workers' sports in Beijing, General GE and his team did their best to promote the transformation from traditional sports to intelligent sports with innovative technologies, so that more football fans who could not attend the scene could access the scene through XR technology and get the real feeling as if they were on the spot.

We cooperate with China Mobile and Zhonghe Group to promote the evolution and landing of the 5G unbounded XR event experience program. In July 2022, we demonstrated the experience scheme of the 5G Unbounded XR event and jointly explored a new path for the construction of "smart worker sports". In August 2023, we realized the application experience of meta-universe football based on 5G existing net for the first time. The number of spectators that the worker sports can hold is limited. If more fans also want to watch the game, they can enter the scene through meta-universe and feel the experience of watching the game. If users are interested in which star, they can watch the star's all-round performance in detail. Based on the experience of bringing the experience of 5G unbounded XR events into the workers' sports, this solution can also be extended to more sports events outside football in the future to achieve meta-universe. This scheme has also been unveiled in many industry exhibitions, and has won many authoritative awards in the World artificial Intelligence Congress, the "Blossom Cup" 5G Application Collection Competition and other activities. In addition, we have also communicated with experts and leaders from all over the world at various exhibitions, and they have also experienced the sense of presence of virtual football matches. It is believed that with the continuous development of technology, the future application of XR will be more realistic.

In the automotive field, generative AI has brought a wealth of use cases for automotive industry partners, and "AI boarding" is becoming a reality. For example, models based on Snapdragon 8295 chips launched by ideal, Xiaopeng, Ji Yue and other manufacturers have all released their large model functions on the car side. With the continuous development of multimodal technology, the AI model will usher in more complex and diversified interactive scenarios, opening up a new application space in intelligent cockpit, autopilot and other fields.

Finally, let's talk about the network terminal. The network terminal with terminal side AI capability will bring a lot of benefits to the operation of the whole wireless communication system. Through these terminals, AI can be distributed in multiple links from cloud to end, support efficient network planning, continuously optimize, enhance service experience, and improve the performance of the entire wireless communication system through end-to-end AI collaboration. For example, with the blessing of AI, the terminal can more comprehensively grasp the characteristics and changing trends of the wireless channel, make the channel state prediction and feedback more accurate, and improve the throughput and other key performance indicators.

We also launched Qualcomm AIHub at the MWC Mobile World Congress in February this year. It can provide more than 75 platform-optimized AI models for Snapdragon and Qualcomm platforms, helping developers optimize product development paths and shorten time to market, so that the advantages of terminal-side AI can be brought into play faster and better in applications.

Continuous innovation keeps Qualcomm at the forefront of terminal-side AI solutions, and our AI leadership also benefits from deep cooperation with the industry. Both Qualcomm's heterogeneous computing capabilities and scalable AI software tools need to be deeply integrated with customers' terminals in order to be realized. With the smart terminal that consumers are most familiar with-mobile phones, terminal-side AI helps consumers to better experience the powerful capabilities of generative AI. Qualcomm is also continuing to expand its terminal-side AI capabilities to more terminals beyond smartphones, including cars, XR headsets and glasses, PC and the Internet of things. Qualcomm helps drive large-scale expansion of generative AI by providing industry-leading hardware and software solutions. At present, the shipments of Qualcomm's AI engine-enabled end products have exceeded 2 billion, and we are particularly honored to be recognized by many users.

In the future, Qualcomm looks forward to working with our partners to jointly promote the reform of terminal-side AI, make terminal-side generation AI ubiquitous, and create the future of Smart Internet of everything. Thank you.