2023
Visual Instruction Tuning
Introducing a method for aligning large language models (LLMs) with visual information by instruction tuning on a massive dataset of image-text pairs.
Tagged with
multimodal learning
Explore machine learning papers and reviews related to multimodal learning. Find insights, analysis, and implementation details.
3
Papers Found
Papers Related to multimodal learning
2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
Computer VisionNatural Language ProcessingDeep LearningMultimodal LearningBLIP-2Vision-Language Models
Introducing BLIP-2, a new vision-language model that leverages frozen image encoders and large language models to achieve improved efficiency and performance in various multimodal tasks.
2021
Learning Transferable Visual Models From Natural Language Supervision
Introducing CLIP, a neural network trained on a massive dataset of image-text pairs that learns to connect images with their textual descriptions, enabling zero-shot image classification and other powerful capabilities.