multimodal AI Tools

Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.

Announcement of GPT-4, a large multimodal model. OpenAI blog, March 14, 2023.

Multimodal foundation models for text, speech, video, and music generation

multimodal, contextual understanding for video search

Make-A-Scene by Meta is a multimodal generative AI method puts creative control in the hands of people who use it by allowing them to describe and illustrate their vision through both text descriptions and freeform sketches.