Microsoft’s Copilot can now “talk and see”

Microsoft Corporation presented an updated version of the Copilot AI assistant with voice mode and understanding of the image on the screen.

Copilot Voice functionality allows you to talk to the neural network, asking questions and brainstorming on the go. There are four voice options to choose from.

Copilot Vision is a “fundamentally new way to interact with your computer.” AI can analyze content on the screen and talk about it in real time. It understands text and images from the web page being viewed and is able to answer questions regarding its content.

For the Vision service, Microsoft guarantees “safety and security” – the data is not stored or used for training.

Other Copilot features include:

• Copilot Daily – AI will review the news, announce the weather and remind you of upcoming events;
• Copilot integration in Microsoft Edge – the assistant is built into the browser, it can summarize the content of the page, translate text, rewrite a sentence;
• Copilot Labs – provides the opportunity to test experimental neural network functions;
• Think Deeper – Copilot is able to reason about complex issues, spending more time;
• Copilot Discover will offer guidance on useful AI features and over time personalize the experience based on user interactions with other Microsoft services.

The updated Copilot is available on iOS, Android, Windows, WhatsApp and in the web interface.

Also Microsoft reported about launching generative search on Bing starting in the US. The tool collects information from around the Internet to create a summary in response to a search query.

Meanwhile, Microsoft has completed production of HoloLens 2, the portal reported UploadVR. The mixed reality headset will continue to receive updates until December 31, 2027. The company will focus on partnering with Meta in the field of AR and VR technologies.

HoloLens 2 mixed reality headset. Data: UploadVR.

In September 2023, the tech giant announced the Copilot system, which combines Windows OS interfaces with artificial intelligence language models.

In July 2024, the company introduced the Designer application on iOS and Android, a graphic designer for generating and editing images using AI.

Stay informed! Subscribe to World Stock Market in Telegram.