Multimodal AI (text, images and sound together)
Japanese マルチモーダル(文字・画像・音声をいっしょに扱うAI)
Multimodal AI takes in more than text, such as pictures and sound, and understands them together to answer. You can show it a photo and ask about it, so it can help with more kinds of work.
Multimodal means "more than one mode." It is like a person who used to only read, and can now also see and hear while talking. For example, you can show a photo of your shop's menu and ask the AI to write an introduction.
Watch out When you upload a photo, names, phone numbers and customer details in it are sent to the AI service too. Cover them first, and check the result yourself, because the AI can misread words inside a picture.
Source: Google Cloud "Multimodal AI"; Google AI for Developers "Image understanding"; Anthropic "Vision"