AI Mode in Google Search is being enhanced with new features just in time for the back-to-school season, aimed at helping students, parents, and educators explore complex questions and access high-quality information.
Image and PDF Interaction
AI Mode, previously available on mobile for asking questions about images, is now launching on desktop browsers. Soon, users will be able to upload PDFs on desktop to ask detailed questions, enabling deeper understanding of documents like lecture slides. AI Mode analyzes the content and cross-references it with web information to provide responses with helpful links. Future updates will support more file types, including Google Drive files.
Canvas for Planning and Organization
The new Canvas feature helps users build and organize plans over multiple sessions in a dynamic side panel. For example, students can create study plans by asking AI Mode and using the “Create Canvas” button. Canvas updates as users add information and allows follow-up refinements. Soon, users will be able to upload files like class notes or syllabi to customize their plans. Canvas projects can be revisited and continued later. This feature is rolling out soon to AI Mode Labs users in the U.S. on desktop browsers.
Search Live with Video Input
Search Live integrates video input and Google Lens, allowing users to have real-time, interactive conversations with AI Mode while pointing their camera at objects or scenes. This feature offers expert-like assistance with visual context and access to web links. It is currently rolling out on mobile in the U.S. for AI Mode Labs participants.
Browsing with Lens and AI Mode
Users can now ask questions about content on their desktop screens, including websites and PDFs, using Lens in Chrome combined with AI Mode. A new “Ask Google about this page” option in the Chrome address bar lets users select elements like diagrams and receive an AI Overview with key information in a side panel. Follow-up questions can be asked through AI Mode for deeper exploration.
These updates demonstrate how AI Mode in Search is evolving to support learning, organization, and real-time assistance, enhancing the way users interact with information on the web.