On the occasion of its 50th anniversary, Microsoft has unveiled a trove of exciting new features for Copilot. The advancements include Memory, Actions, Vision, Deep Research, Pages, Podcasts, and more, positioning Microsoft Copilot as a formidable competitor alongside ChatGPT and Gemini. Here’s a look at all the new functionalities Microsoft has introduced for Copilot.
Copilot Vision
Let’s begin with Copilot Vision. This feature allows the AI to utilize your device’s camera and analyze on-screen content, enabling real-time interaction through voice chat. While Copilot Vision initially launched on the web, Microsoft is now expanding this capability to Android and iOS platforms. Additionally, with the dedicated Copilot app on Windows, users can access Vision functionality across all Windows applications.
Copilot Vision is officially launching on Android and iOS today, with availability for Windows Insiders expected next week.
Copilot Actions
Next up is Copilot Actions, which enhances the AI’s ability to perform tasks on your behalf. This feature enables you to ask Copilot to book event tickets or secure a restaurant reservation. It works seamlessly with numerous websites, as Microsoft has partnered with various platforms to streamline the experience.
The following websites are optimized for Copilot Actions: Flowers.com, Booking.com, Expedia, Kayak, OpenTable, Priceline, Tripadvisor, Skyscanner, Viator, and Vrbo.
Memory and Personalization
Additionally, Microsoft Copilot is improving its personalization features through Memory support. This allows Copilot to retain information from your conversations, tailoring your interactions based on what it learns about you. For instance, as you chat, it can discern your movie preferences, location, favorite foods, and more. Should you wish for Copilot to forget any of this information, you can delete specific memories or disable the feature entirely.
Moreover, Microsoft is exploring the option for users to customize Copilot’s look, allowing for a more entertaining and personalized character.
Deep Research
Deep Research is an innovative AI tool being integrated into Copilot, enabling users to carry out multi-step research tasks in mere minutes. This feature can scan the web, gather data from various sources, and extract information from extensive documents and images. It then analyzes the data and produces a comprehensive research document for you, akin to the Deep Research tools available on ChatGPT and Gemini.
Pages
Another upcoming feature, Pages, allows you to compile your thoughts, research notes, and content within Copilot. The AI organizes these inputs neatly, making Pages ideal for brainstorming, planning, writing, studying, and organizing scattered notes. Copilot assists in refining and enhancing your notes within Pages effortlessly.
Podcasts
Additionally, Microsoft is introducing AI-generated podcasts within Copilot. It can create personalized podcasts based on your interests, much like NotebookLM. You can also input your notes or study materials, and Copilot will produce an AI-driven podcast tailored for you. Notably, this interactive podcast allows you to engage with the content and ask questions to delve deeper into the topics discussed.
Furthermore, Microsoft aims to transform Copilot into your personal shopping assistant. For example, you can request suggestions for stylish mugs, and Copilot will conduct the research and provide options that fit your budget. You can view product details and make purchases directly through Copilot; this feature is currently available on partner websites. Additionally, Copilot can monitor price drops and compare products for you.
Copilot Search in Bing
Similar to Google’s AI Overviews, Copilot Search is now being integrated into Bing. When you conduct a search, Copilot Search scours the web and compiles information from pertinent websites to present a thorough answer, complete with citations for verification.
Microsoft has stated that this enhanced Copilot Search experience in Bing is rolling out today. However, it is currently available to a limited audience, with plans to expand access to more users in the coming weeks and months.
