Microsoft is set to introduce a suite of new AI features for Windows 11 users, all accessible through Copilot. The update incorporates Copilot Vision, a tool allowing users to scan and analyze content displayed on their screens. This capability extends to multiple open apps and websites, allowing users to query Copilot about the on-screen content or request tasks like enhancing image lighting. The rollout is set to happen gradually. Some features will be exclusive to Copilot Plus PCs. Microsoft’s data indicates that generative AI is widely used for work, business, hobbies, and personal interests. Microsoft is integrating these intuitive experiences to make PC usage easier. The Settings app will allow access to the AI agent for users on Snapdragon-powered Copilot Plus PCs.
Another notable inclusion is the “Click to Do” preview, available on Copilot Plus PCs, which enables users to carry out functions such as summarizing text and enhancing reading capabilities. The feature is accessed by holding the Windows key and left-clicking on content. In addition, the update adds an AI-driven sticker generator for Paint, a tool for object selection in image editing, an AI-enhanced lighting option in Photos, and an AI-powered screenshot tool for precise content capture. The rollout will begin in August, accompanied by further updates, including a color picker within the Snipping Tool and a mechanism designed to automatically correct problems that cause unexpected restarts.