Microsoft has updated the Windows 11 Native AI documentation to confirm that language model APIs can now run on PCs that are not equipped with Copilot+ but have supported GPUs. Previously, these APIs were only available on CoPilot+ PCs that had dedicated NPU hardware.
The change is currently targeted for developers and is not yet available for end users. Supported hardware includes newer models with Nvidia GeForce RTX 30 series GPUs and at least 6GB of VRAM.
What changed and what it enables on non-CoPilot+ PCs
Microsoft’s updated developer documentation and GitHub post describe a recent change. He says the language model APIs now run on GPU-equipped PCs that are not CoPilot+ models, expanding local language model capabilities to more Windows 11 devices.
This represents a change from Microsoft’s original focus on Copilot+ PCs, launched on June 18, 2024, which had emphasized the NPU needed for native AI features in Windows.
While NPUs are not the only chips capable of AI workloads, Microsoft previously limited most built-in AI features to devices with NPUs.
The current feature set focuses on text-based tasks using the Windows.AI.Text API. These capabilities include summarizing content, rewriting text, converting text into structured formats, and generating prompts.
Although the functionality resembles cloud-based AI tools, it runs locally on the device, reducing reliance on cloud processing and keeping data on the machine.
At its core is a smaller on-device model called Phi Silica. Instead of being pre-installed on all systems, Phi Silica can be downloaded via Windows Update when needed by an application. Once installed, the model runs locally and uses the GPU when available.
What’s still limited and why GPU support matters for Windows 11 users
GPU support is currently limited to the language model API layer. Other CoPilot+ features are added to NPU-equipped systems, including:
- windows recall,
- Click to Do, and many other AI integrations are branded under Copilot+.
This capability is primarily accessible at the developer level rather than directly to end users. Running these APIs requires applications that are built or customized to use the Windows AI framework.
Users will see benefits as developers update their applications to support GPU-based native AI on non-CoPilot+ PCs.
The update expands the range of Windows 11 devices that can run native AI features. PCs with mid- to high-end Nvidia GPUs, which previously lacked NPU hardware, now have a way to access Microsoft’s built-in native AI tools.
Many gaming computers and workstations meet this new GPU requirement, enabling native AI capabilities for a large portion of Windows 11 users.
Microsoft has not indicated whether GPU support will be extended to Windows Recall and other features that are currently limited to Copilot+ hardware, or whether AMD and Intel GPUs will get similar support in the future.
Thanks for being a Ghax reader. The post Microsoft Enabling Nvidia GPU Support for Windows 11 Local Language Model API appeared first on Ghacks.
