At the Build 2023 developer conference, Microsoft confirmed that it’s bringing full-fledged Bing AI-powered chat to Windows 11 and putting it on your desktop. Called “Windows Copilot,” this new experience can help you automate various tasks, such as copying and pasting text or media, taking screenshots, managing snap assist, and more.
Windows Copilot update arrives in June in preview, and those in the Windows Insider Program will have access to the feature in the coming weeks. Copilot isn’t designed to compete directly with Alexa and Siri-like personal assistants. Yet it works the same way and is designed as a pilot for a local + search engine.
You can use Windows Copilot in standard search mode or in a more conversational mode where you can ask the Bing AI (which powers Copilot) anything like the current time in London, the weather in your area, the latest sports score, and pretty much anything you normally would on a search engine.
The same Bing AI experience lives on the Windows 11 desktop, and accessing Windows Copilot is easy, with the button conveniently located on the taskbar. Once activated, the Windows Copilot sidebar appears on the desktop and in all apps and programs.
Windows Copilot can automatically detect the open app on the left side of the screen and suggest actions such as personalizing the settings and more. For example, users can ask it to plan a fishing trip, adjust settings to improve focus, or summarize and compose text from any app.
Copilot brings ChatGPT plugins to Windows 11
ChatGPT and Bing Chat support Windows Copilot, which supports 1st and 3rd party plugins.
As you probably know, generative AI like ChatGPT traditionally relies on internal scraped data to extract knowledge. Plugins allow ChatGPT or Bing to connect directly to third-party platforms. The plugin allows third-party services such as Instacart or Kayak to connect to ChatGPT.
The same functionality is also available in Windows Copilot, meaning Windows 11 can now use AI to provide information directly from third-party platforms.
For example, you can ask Windows Copilot to share your Spotify playlist and discuss it with the AI, or simply ask it to play songs on Spotify.
There will be a plugin store that will act as the AI version of an app store, like Play Store or App Store, but for AI plugins.
Here’s a list of all Windows Copilot features:
- AI-Powered Assistant: Copilot harnesses the power of Bing’s AI and ChatGPT-4 to answer complex questions and assist with day-to-day activities.
- Works in all apps, documents, desktops and more: The feature can work across apps, summarizing and composing text as needed.
- Seamless Integration: Integrated with Bing Chat and 1st and 3rd party plugins, Windows Copilot acts as a centralized AI assistant, bringing everything in one place, accessible via a toggle on the taskbar.
- Pinned to the taskbar: Copilot is an option that pins to the taskbar, making the Copilot sidebar accessible to all apps.
- Content, content and content! Copilot is synced with Microsoft 365 Copilot and can help you write documents, rewrite documents, summarize or explain anything on screen.
- Plug-in support: With plug-in support, Windows Copilot opens up new opportunities for developers to innovate and reach customers. Plugins from services like Instacart, Kayak, and Expedia are bringing them to Windows 11.
Arrival in June in preview
Microsoft officials confirmed that the AI-powered Windows 11 Copilot update would begin previewing in June.
You must sign up for the Windows Insider Program to access the early preview of the feature.
