Microsoft has introduced a new feature in the latest Windows 11 Insider Preview, which includes a “Share with Copilot” button. This button appears when users hover over an open app in the taskbar and allows them to share screen contents with Copilot Vision, Microsoft’s AI tool. By clicking this button, users can inquire about elements on their screen, such as identifying individuals in a photo or obtaining information about an object, like a sculpture.
Copilot Vision analyzes the content shared by users and facilitates interactions with Microsoft’s AI chatbot, offering context and tutorials based on the analyzed content. This feature is part of a broader integration of Copilot functionalities into various Microsoft applications. Previous integrations have appeared in programs such as Microsoft Paint and Notepad, and can even be accessed directly from the taskbar or some PC models.
Despite these additions, there seems to be limited enthusiasm among Windows users for further Copilot features. Microsoft notes that it is currently “trying out this taskbar capability,” suggesting the feature may change or be removed in future updates before being rolled out to the general user base. Additionally, another feature in the same preview offers text translation on screen, reflecting the ongoing development of AI capabilities within the Windows operating system.
Source: https://www.theverge.com/news/782194/windows-11-share-with-copilot-button