Microsoft is enhancing its Advanced Paste tool within PowerToys for Windows 11, enabling the use of an on-device AI model to support various features. The recent update, version 0.96, allows users to route requests through Microsoft’s Foundry Local tool or the open-source Ollama. These tools utilize the device’s neural processing unit (NPU), eliminating the need to connect to cloud services for certain operations.
This development means users will not require API credits for functions such as translating or summarizing text copied to the clipboard. Additionally, it allows users to retain their data on their own devices, as opposed to sending it to the cloud for processing.
In addition to support for on-device AI, the Advanced Paste tool now includes compatibility with several online models, such as Azure OpenAI, Gemini, and Mistral. Previously, the tool was limited to support for OpenAI models only.
Moreover, the user interface has undergone a minor redesign. The Advanced Paste tool now displays the current content of the clipboard and features a drop-down menu for selecting different AI models. This upgrade raises questions about the broader implications of on-device processing versus cloud-based AI solutions in terms of performance and privacy.
Source: https://www.theverge.com/news/825668/microsoft-advanced-paste-powertoys-on-device-ai