Visual instruction tuning towards large language and vision models with GPT-4 level capabilities

A model which generates text in response to an input image and prompt.

Advanced text-image comprehension and composition based on InternLM

An instruction-tuned multimodal large language model that generates text based on user-provided prompts and images

A multimodal LLM-based AI assistant, which is trained with alignment techniques. Qwen-VL-Chat supports more flexible interaction, such as multi-round question answering, and creative capabilities.

Zero-shot / open vocabulary object detection

One Transformer Fits All Distributions in Multi-Modal Diffusion at Scale

Open-access reproduction of large visual language model Flamingo

Nougat: Neural Optical Understanding for Academic Documents

Unified Model for Image, Video, Audio and Language Tasks