Bootstrapping Language-Image Pre-training

Answers questions about images

Get an approximate text prompt, with style, matching an image. (Optimized for stable-diffusion (clip ViT-L/14))

Visual instruction tuning towards large language and vision models with GPT-4 level capabilities

Simple image captioning model using CLIP and GPT-2

The CLIP Interrogator is a prompt engineering tool that combines OpenAI's CLIP and Salesforce's BLIP to optimize text prompts to match a given image. Use the resulting prompts with text-to-image models like Stable Diffusion to create cool art!

A model which generates text in response to an input image and prompt.

Fine-grained Image Captioning with CLIP Reward

An instruction-tuned multi-modal model based on BLIP-2 and Vicuna-13B

An instruction-tuned multimodal large language model that generates text based on user-provided prompts and images

datasets: Flickr8k