Microsoft Copilot AI: Local PC Integration coming soon

It was previously rumored that Microsoft requires 40 TOPS on next-generation computers with artificial intelligence, to compare the current most powerful processor Apple M3 has "only" 18 TOPS (trillion operations per second)

by Sededin Dedovic
SHARE
Microsoft Copilot AI: Local PC Integration coming soon
© AI Revolution / Youtube channel

Microsoft's Copilot AI service is set up to run locally on computers. This change points to the need for advanced hardware resources, the company said that next-generation AI computers will require embedded neural processing units (NPUs) with over 40 TOPS (trillion operations per second) of power.

This is currently beyond the capabilities of any consumer processor on the market, and currently the most powerful processor Apple's M3 has "only" 18 TOPS. Intel announced that AI computers will be able to run "multiple elements of Copilot" locally.

This is a significant change because until now Copilot mainly used cloud resources, which caused delays, especially for smaller tasks. Adding local computing capabilities will not only reduce latency, but also improve performance and user privacy.

Microsoft's claim of 40 TOPS for AI PCs coupled with a modest 16GB of RAM is a requirement for extremely powerful hardware. Currently, operating systems such as Windows, ChromeOS, and macOS use NPU resources for various functionalities such as video processing, audio processing, OCR, translation, live transcription, and more.

In terms of currently available processors with NPU, Apple's M3 leads the way with 18 TOPS across the entire line (M3, M3 Pro and M3 Ultra). AMD's Ryzen 8040 and 7040 laptop chips offer 16 and 10 TOPS respectively, while Intel's Meteor Lake laptop also reaches 10 TOPS.

Qualcomm's latest Snapdragon X Elite processors promise an impressive 45 TOPS speeds for AI computing. Intel's Lunar Lake chips, expected in 2025, are announced with three times the NPU speed compared to previous generations.

These improvements in hardware are accompanied by the development of software functions. Intel recently introduced 300 new AI functions optimized for its own OpenVino platform. They also announced an AI PC development kit based on the ASUS NUC Pro that uses the current Meteor Lake silicon.

Integrating Copilot with local computing resources opens the door to faster and more efficient problem solving, while simultaneously requiring careful data management to ensure user privacy. The issue of privacy and data protection is currently the most important amid the incredible development of AI technology in the last 5 years.

Microsoft Apple
SHARE