Multimodal
In one sentence
AI can simultaneously process multiple types of information, including text, images, audio, and video.
Multimodal models can answer questions about images, transcribe meeting minutes from audio recordings, generate images or videos from text, and interpret multiple formats together.
A common marketing use case: take a product photo, let the AI identify the product, and have it generate the matching copy and headlines.
Example
Send a store photo to the AI, have it identify display issues, and generate an action list for improvements.
Related terms
- Generative AI (AIGC)
- AI capable of generating new content such as text, images, audio, and video, as well as the content produced by such AI.
- Text-to-Image
- The AI capability to generate images from a text description, or generate new images based on a reference image (image-to-image).
- Large Language Model (LLM)
- AI models trained on massive volumes of text that can understand and generate text. Doubao, DeepSeek, ChatGPT, and Claude are all powered by large language models.
