yorickvp / llava-v1.6-mistral-7b

LLaVA v1.6: Large Language and Vision Assistant (Mistral-7B)

Cold

Public
4.9M runs
L40S
GitHub
License

Iterate in playground

Run with an API

Playground API Examples README Versions

Prediction

yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7

Model

yorickvp/llava-v1.6-mistral-7b:6d853ae8

qlua7w3b5y2fcputi27al53qgy

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

2m 25s

Created

over 1 year ago

Input

image
top_p: 1
prompt: What is unusual about this image?
max_tokens: 1024
temperature: 0.2

{
  "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
  "top_p": 1,
  "prompt": "What is unusual about this image?",
  "max_tokens": 1024,
  "temperature": 0.2
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run yorickvp/llava-v1.6-mistral-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7",
  {
    input: {
      image: "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
      top_p: 1,
      prompt: "What is unusual about this image?",
      max_tokens: 1024,
      temperature: 0.2
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run yorickvp/llava-v1.6-mistral-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7",
    input={
        "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
        "top_p": 1,
        "prompt": "What is unusual about this image?",
        "max_tokens": 1024,
        "temperature": 0.2
    }
)

# The yorickvp/llava-v1.6-mistral-7b model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/yorickvp/llava-v1.6-mistral-7b/api#output-schema
    print(item, end="")

To learn more, take a look at the guide on getting started with Python.

Run yorickvp/llava-v1.6-mistral-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7",
    "input": {
      "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
      "top_p": 1,
      "prompt": "What is unusual about this image?",
      "max_tokens": 1024,
      "temperature": 0.2
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

The unusual aspect of this image is that a man is standing on the back of a yellow SUV, ironing clothes. This is not a typical scene, as one would expect to see the man either inside the vehicle or on the ground, rather than standing on the back of the SUV. The act of ironing clothes while standing on the back of a moving vehicle is both unusual and potentially dangerous.

{
  "completed_at": "2024-02-01T11:47:16.816746Z",
  "created_at": "2024-02-01T11:44:51.978072Z",
  "data_removed": false,
  "error": null,
  "id": "qlua7w3b5y2fcputi27al53qgy",
  "input": {
    "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
    "top_p": 1,
    "prompt": "What is unusual about this image?",
    "max_tokens": 1024,
    "temperature": 0.2
  },
  "logs": "The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.\nSetting `pad_token_id` to `eos_token_id`:2 for open-end generation.",
  "metrics": {
    "predict_time": 4.445047,
    "total_time": 144.838674
  },
  "output": [
    "The ",
    "unusual ",
    "aspect ",
    "of ",
    "this ",
    "image ",
    "is ",
    "that ",
    "a ",
    "man ",
    "is ",
    "standing ",
    "on ",
    "the ",
    "back ",
    "of ",
    "a ",
    "yellow ",
    "SUV, ",
    "ironing ",
    "clothes. ",
    "This ",
    "is ",
    "not ",
    "a ",
    "typical ",
    "scene, ",
    "as ",
    "one ",
    "would ",
    "expect ",
    "to ",
    "see ",
    "the ",
    "man ",
    "either ",
    "inside ",
    "the ",
    "vehicle ",
    "or ",
    "on ",
    "the ",
    "ground, ",
    "rather ",
    "than ",
    "standing ",
    "on ",
    "the ",
    "back ",
    "of ",
    "the ",
    "SUV. ",
    "The ",
    "act ",
    "of ",
    "ironing ",
    "clothes ",
    "while ",
    "standing ",
    "on ",
    "the ",
    "back ",
    "of ",
    "a ",
    "moving ",
    "vehicle ",
    "is ",
    "both ",
    "unusual ",
    "and ",
    "potentially ",
    "dangerous. "
  ],
  "started_at": "2024-02-01T11:47:12.371699Z",
  "status": "succeeded",
  "urls": {
    "stream": "https://streaming-api.svc.us.c.replicate.net/v1/streams/523buztgaalgf6aipreduz2zsudl3edwknku3wftgaw4sdlbdtta",
    "get": "https://api.replicate.com/v1/predictions/qlua7w3b5y2fcputi27al53qgy",
    "cancel": "https://api.replicate.com/v1/predictions/qlua7w3b5y2fcputi27al53qgy/cancel"
  },
  "version": "6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7"
}

Generated in

4.5 seconds

Tweak it Share Report

Prediction

yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7

Model

yorickvp/llava-v1.6-mistral-7b:6d853ae8

qlua7w3b5y2fcputi27al53qgy

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

2m 25s

Created

over 1 year ago

Input

image
top_p: 1
prompt: What is unusual about this image?
max_tokens: 1024
temperature: 0.2

{
  "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
  "top_p": 1,
  "prompt": "What is unusual about this image?",
  "max_tokens": 1024,
  "temperature": 0.2
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run yorickvp/llava-v1.6-mistral-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7",
  {
    input: {
      image: "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
      top_p: 1,
      prompt: "What is unusual about this image?",
      max_tokens: 1024,
      temperature: 0.2
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run yorickvp/llava-v1.6-mistral-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7",
    input={
        "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
        "top_p": 1,
        "prompt": "What is unusual about this image?",
        "max_tokens": 1024,
        "temperature": 0.2
    }
)

# The yorickvp/llava-v1.6-mistral-7b model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/yorickvp/llava-v1.6-mistral-7b/api#output-schema
    print(item, end="")

To learn more, take a look at the guide on getting started with Python.

Run yorickvp/llava-v1.6-mistral-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "yorickvp/llava-v1.6-mistral-7b:6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7",
    "input": {
      "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
      "top_p": 1,
      "prompt": "What is unusual about this image?",
      "max_tokens": 1024,
      "temperature": 0.2
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "completed_at": "2024-02-01T11:47:16.816746Z",
  "created_at": "2024-02-01T11:44:51.978072Z",
  "data_removed": false,
  "error": null,
  "id": "qlua7w3b5y2fcputi27al53qgy",
  "input": {
    "image": "https://replicate.delivery/pbxt/KKNB7w6pjN79j5pHDSyYXa5EwaQE9FL5fx6Qa83XMn1HYuKm/extreme_ironing.jpg",
    "top_p": 1,
    "prompt": "What is unusual about this image?",
    "max_tokens": 1024,
    "temperature": 0.2
  },
  "logs": "The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.\nSetting `pad_token_id` to `eos_token_id`:2 for open-end generation.",
  "metrics": {
    "predict_time": 4.445047,
    "total_time": 144.838674
  },
  "output": [
    "The ",
    "unusual ",
    "aspect ",
    "of ",
    "this ",
    "image ",
    "is ",
    "that ",
    "a ",
    "man ",
    "is ",
    "standing ",
    "on ",
    "the ",
    "back ",
    "of ",
    "a ",
    "yellow ",
    "SUV, ",
    "ironing ",
    "clothes. ",
    "This ",
    "is ",
    "not ",
    "a ",
    "typical ",
    "scene, ",
    "as ",
    "one ",
    "would ",
    "expect ",
    "to ",
    "see ",
    "the ",
    "man ",
    "either ",
    "inside ",
    "the ",
    "vehicle ",
    "or ",
    "on ",
    "the ",
    "ground, ",
    "rather ",
    "than ",
    "standing ",
    "on ",
    "the ",
    "back ",
    "of ",
    "the ",
    "SUV. ",
    "The ",
    "act ",
    "of ",
    "ironing ",
    "clothes ",
    "while ",
    "standing ",
    "on ",
    "the ",
    "back ",
    "of ",
    "a ",
    "moving ",
    "vehicle ",
    "is ",
    "both ",
    "unusual ",
    "and ",
    "potentially ",
    "dangerous. "
  ],
  "started_at": "2024-02-01T11:47:12.371699Z",
  "status": "succeeded",
  "urls": {
    "stream": "https://streaming-api.svc.us.c.replicate.net/v1/streams/523buztgaalgf6aipreduz2zsudl3edwknku3wftgaw4sdlbdtta",
    "get": "https://api.replicate.com/v1/predictions/qlua7w3b5y2fcputi27al53qgy",
    "cancel": "https://api.replicate.com/v1/predictions/qlua7w3b5y2fcputi27al53qgy/cancel"
  },
  "version": "6d853ae87b782cd5f659578c807aa5cc03075e40b28fc3ff83e8aee98f9f94c7"
}

Generated in

4.5 seconds

Tweak it Share Report