Data Modalities

Data comes in different types called modalities.

The most common modalities are:

1. Text (words, sentences, documents)
2. Images (photos, drawings, screenshots)
3. Audio (speech, music, sounds)
4. Video (moving images with sound)
5. Tabular (rows and columns of numbers or categories)

Each modality requires different file formats to store it.

Multimodal AI

Some AI models work with only one modality. Other models are multimodal and can work with multiple modalities at the same time.

Example: A multimodal model can understand both text and images together, like answering questions about a photo.