Google's TalkBack now lets users ask questions about on-screen images using Gemini AI
Posted on: May 16, 2025 16:11 IST | Posted by: Livemint
On the occasion of world(a) Accessibility sentience daytime, Google has proclaimed a rooms of new artificial intelligence (AI) and accessibility tools aimed at improving digital experiences for people with vision and hearing impairments. The updates will be introduced across Android devices and the Chrome browser, enhancing inclusivity through smart, user-friendly features.
In a blog post published on Thursday, the California-based tech company revealed that it is enhancing Android's screen reader, TalkBack, with expanded Gemini AI capabilities. Originally launched last year to generate descriptive captions for images lacking alt text, the updated feature now allows users not only to hear descriptions but also to ask questions about the images or content on their screen. This interactive function is designed to provide deeper visual context for those with vision impairments.
Google also announced a wider release of its Expressive Captions feature. Debuted in the US in late 2024, this tool is part of the Live Captions system and aims to convey tone, emotion, and ambient sounds more effectively through AI-generated subtitles. By reflecting vocal emphasis—such as stretching the word “no” to “noooooo” to denote despair—the feature adds a layer of expressiveness to otherwise plain text. Expressive Captions are now being rolled out in English to users in Australia, Canada, the UK, and the US on devices running Android 15 and later.
Chrome users are also set to benefit from new accessibility enhancements. A major update enables the desktop browser to support screen readers for scanned PDF files, a longstanding limitation. This improvement is powered by optical character recognition (OCR) technology, allowing Chrome to identify text within scanned documents, making it possible to read aloud, highlight, copy, and search content.
Additionally, Chrome on Android is introducing Page Zoom—a tool that enlarges text on web pages without distorting the overall layout. This feature is tailored to users with low vision, offering an improved reading experience without the inconvenience of constantly panning across the screen.
Google has also emphasised its commitment to supporting developers creating speech recognition tools by releasing new resources to aid innovation in the field.
Global News Perspectives
In today's interconnected world, staying informed about global events is more important than ever. ZisNews provides news coverage from multiple countries, allowing you to compare how different regions report on the same stories. This unique approach helps you gain a broader and more balanced understanding of international affairs. Whether it's politics, business, technology, or cultural trends, ZisNews ensures that you get a well-rounded perspective rather than a one-sided view. Expand your knowledge and see how global narratives unfold from different angles.
Customizable News Feed
At ZisNews, we understand that not every news story interests everyone. That's why we offer a customizable news feed, allowing you to control what you see. By adding keywords, you can filter out unwanted news, blocking articles that contain specific words in their titles or descriptions. This feature enables you to create a personalized experience where you only receive content that aligns with your interests. Register today to take full advantage of this functionality and enjoy a distraction-free news feed.
Like or Comment on News
Stay engaged with the news by interacting with stories that matter to you. Like or dislike articles based on your opinion, and share your thoughts in the comments section. Join discussions, see what others are saying, and be a part of an informed community that values meaningful conversations.
Download the Android App
For a seamless news experience, download the ZisNews Android app. Get instant notifications based on your selected categories and stay updated on breaking news. The app also allows you to block unwanted news, ensuring that you only receive content that aligns with your preferences. Stay connected anytime, anywhere.
Diverse News Categories
With ZisNews, you can explore a wide range of topics, ensuring that you never miss important developments. From Technology and Science to Sports, Politics, and Entertainment, we bring you the latest updates from the world's most trusted sources. Whether you are interested in groundbreaking scientific discoveries, tech innovations, or major sports events, our platform keeps you updated in real-time. Our carefully curated news selection helps you stay ahead, providing accurate and relevant stories tailored to diverse interests.
No comments yet.