chenxwh

cogvlm2

Cold

CogVLM2: Visual Language Models for Image and Video Understanding

Public

1K runs

Run with an API

Playground API Examples README Versions

Prediction

chenxwh/cogvlm2:6d0394ab8fd98efb399c29c03c84c29f1d43c0259c6ee63d12f44def476c92b2

Model

chenxwh/cogvlm2:6d0394ab

r8pb3fq20drgj0cj4p6rfznsac

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

3m 30s

Created

12 months ago

Input

top_p: 0.9
prompt: Describe this image.
input_image
temperature: 0.7
max_new_tokens: 2048

{
  "top_p": 0.9,
  "prompt": "Describe this image.",
  "input_image": "https://replicate.delivery/pbxt/Lg6495P56J6wq1WFLML3jPlCuXLOQii8eoPNb1iFwsFiJXVw/book3.jpeg",
  "temperature": 0.7,
  "max_new_tokens": 2048
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run chenxwh/cogvlm2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "chenxwh/cogvlm2:6d0394ab8fd98efb399c29c03c84c29f1d43c0259c6ee63d12f44def476c92b2",
  {
    input: {
      top_p: 0.9,
      prompt: "Describe this image.",
      input_image: "https://replicate.delivery/pbxt/Lg6495P56J6wq1WFLML3jPlCuXLOQii8eoPNb1iFwsFiJXVw/book3.jpeg",
      temperature: 0.7,
      max_new_tokens: 2048
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run chenxwh/cogvlm2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "chenxwh/cogvlm2:6d0394ab8fd98efb399c29c03c84c29f1d43c0259c6ee63d12f44def476c92b2",
    input={
        "top_p": 0.9,
        "prompt": "Describe this image.",
        "input_image": "https://replicate.delivery/pbxt/Lg6495P56J6wq1WFLML3jPlCuXLOQii8eoPNb1iFwsFiJXVw/book3.jpeg",
        "temperature": 0.7,
        "max_new_tokens": 2048
    }
)

print(output)

To learn more, take a look at the guide on getting started with Python.

Run chenxwh/cogvlm2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "chenxwh/cogvlm2:6d0394ab8fd98efb399c29c03c84c29f1d43c0259c6ee63d12f44def476c92b2",
    "input": {
      "top_p": 0.9,
      "prompt": "Describe this image.",
      "input_image": "https://replicate.delivery/pbxt/Lg6495P56J6wq1WFLML3jPlCuXLOQii8eoPNb1iFwsFiJXVw/book3.jpeg",
      "temperature": 0.7,
      "max_new_tokens": 2048
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

The image captures a well-lit, modern library or bookstore with a distinct industrial aesthetic. The main focus is a large, wooden bookshelf filled with an assortment of books, creating a warm and inviting atmosphere. The bookshelf is positioned against a rustic brick wall, which adds a touch of vintage charm to the space. The room is illuminated by hanging light bulbs, which dangle from the ceiling in a casual manner. There are also decorative elements such as a potted plant, a small framed sign, and a table with various items on it, enhancing the cozy ambiance. A person is seated at a desk in the foreground, suggesting the space is functional for reading or studying.

{
  "completed_at": "2024-09-24T19:45:18.433249Z",
  "created_at": "2024-09-24T19:41:48.419000Z",
  "data_removed": false,
  "error": null,
  "id": "r8pb3fq20drgj0cj4p6rfznsac",
  "input": {
    "top_p": 0.9,
    "prompt": "Describe this image.",
    "input_image": "https://replicate.delivery/pbxt/Lg6495P56J6wq1WFLML3jPlCuXLOQii8eoPNb1iFwsFiJXVw/book3.jpeg",
    "temperature": 0.7,
    "max_new_tokens": 2048
  },
  "logs": "/root/.pyenv/versions/3.11.10/lib/python3.11/site-packages/bitsandbytes/autograd/_functions.py:316: UserWarning: MatMul8bitLt: inputs will be cast from torch.bfloat16 to float16 during quantization\nwarnings.warn(f\"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization\")\n/root/.pyenv/versions/3.11.10/lib/python3.11/site-packages/bitsandbytes/autograd/_functions.py:316: UserWarning: MatMul8bitLt: inputs will be cast from torch.bfloat16 to float16 during quantization\nwarnings.warn(f\"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization\")\n/root/.pyenv/versions/3.11.10/lib/python3.11/site-packages/bitsandbytes/autograd/_functions.py:316: UserWarning: MatMul8bitLt: inputs will be cast from torch.bfloat16 to float16 during quantization\nwarnings.warn(f\"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization\")",
  "metrics": {
    "predict_time": 24.170625701,
    "total_time": 210.014249
  },
  "output": "The image captures a well-lit, modern library or bookstore with a distinct industrial aesthetic. The main focus is a large, wooden bookshelf filled with an assortment of books, creating a warm and inviting atmosphere. The bookshelf is positioned against a rustic brick wall, which adds a touch of vintage charm to the space. The room is illuminated by hanging light bulbs, which dangle from the ceiling in a casual manner. There are also decorative elements such as a potted plant, a small framed sign, and a table with various items on it, enhancing the cozy ambiance. A person is seated at a desk in the foreground, suggesting the space is functional for reading or studying.",
  "started_at": "2024-09-24T19:44:54.262623Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/r8pb3fq20drgj0cj4p6rfznsac",
    "cancel": "https://api.replicate.com/v1/predictions/r8pb3fq20drgj0cj4p6rfznsac/cancel"
  },
  "version": "6d0394ab8fd98efb399c29c03c84c29f1d43c0259c6ee63d12f44def476c92b2"
}

Generated in

24.2 seconds

Tweak it Iterate in playground Share Report

Want to make some of these yourself?

Run this model