New generative AI-based features coming to Android devices, including smartwatches

Key Highlights

• Google has rolled out 9 new Android features that rely on generative AI.
• Users will get new casting controls for Spotify and AI-generated captions for images.

Tech Giant Google has rolled out nine new generative artificial intelligence (AI)-based features for Android devices. The upcoming features will be accessible for tablets, smartphones, smartwatches, and automobiles intended for use with other products, including the Messages app, Android Auto, and Wear OS.

Google has pushed out additional features for smartphones, Android Auto, and Wear OS, albeit they are still under beta testing. The majority of the new capabilities are AI-based and intended for use with different devices. The company via blog post made the announcement which said, “Today, we’re rolling out Android updates to help you simplify your day and get more done — whether on your phone, tablet or Wear OS smartwatch or in your Android Auto-compatible car.”

Android Auto may automatically summarise lengthy texts or active group discussions with the help of generative artificial intelligence (AI). Users will be able to send messages, share ETA or start a call by tapping once. In addition to this, it will also recommend pertinent responses and actions.

Users will be able to listen to auto-generated AI descriptions of photos, online images and pictures included in messages with image captions in Lookout on Android. This feature is being rolled out globally in English and has been designed with blind and low-vision communities.

Also Read: Nubia Flip 5G foldable phone introduced at MWC 2024

Google’s latest update will now also bring enhanced screen reader support for Lens in Maps. This functionality will aid in exploring nearby and identifying places like ATMs, restaurants and transit stations. One can also point their camera at the surroundings and TalkBack will read out the details about the location, including its business hours, rating, and driving directions.

On the other hand, users can now use their finger or stylus to add handwritten annotations to Google Docs from their Android phone or tablet thanks to Google Docs markups. With a selection of markup tools to choose from, like different pen colours and highlighters, reviewing documents and providing feedback is fast, flexible and easy.

Spotify now provides more screen-casting settings thanks to Google. The output switcher on Android’s home screen lets you move effortlessly between your devices when playing YouTube music on Android’s home screen: your phone’s speaker, headphones, smart speakers, or TV. You may now use Spotify in the same way. Thus, Spotify Connect devices will now be displayed on the output switcher when you are playing media on Spotify.

Also Read: Krafton’s latest Indian-themed game Garuda Saga launched

Through Health Connect, users are now able to see a more complete picture of their health right in the redesigned Fitbit app through Health Connect– with data from their favourite wearables and apps like AllTrails, Oura Ring and MyFitnessPal. To see data from connected apps next to your Fitbit data, go to the You tab in the Fitbit app on your Android phone. In the Today tab, you can see data like exercise, steps, calories burned, floors climbed and distance travelled from Health Connect-compatible apps.

One can now also access boarding passes, event tickets, gym memberships, loyalty cards and more from their wrist with Google Wallet passes now available on Wear OS watches. Choose which passes to hide or display so they’re ready to use right when you need them.

Users may leave their phones in their pockets and check their wrists to make sure they catch their bus, train or ferry using public transit directions on Google Maps for Wear OS. Get compass-guided navigation directions to your destination after checking out the departure times directly from your smartwatch. If you prefer your phone, you can also mirror directions to your watch and navigate hands-free.

You may access Gemini directly in Google Messages on your Android phone starting this week in English beta. Chat with Gemini to draft messages, brainstorm ideas, plan events or simply have a fun conversation without leaving the Messages app.