aodianyun / minicpm-v-26

Cold

Public
12 runs
L40S

Run with an API

Playground API Examples README Versions

Prediction

aodianyun/minicpm-v-26:4e42bfc1

Model

aodianyun/minicpm-v-26:4e42bfc1

9aw9w676m9rgj0chxbg8w10g90

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

3m 7s

Created

7 months ago

Input

image
prompt: Describe the video in great detail.

{
  "image": "https://replicate.delivery/pbxt/LYg9UV9q67McivPuwvpQPjClOZ7KqaOHH5F2DgbfCZspIhOQ/input.mp4",
  "prompt": "Describe the video in great detail."
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run aodianyun/minicpm-v-26 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "aodianyun/minicpm-v-26:4e42bfc1891e0899109f0bd64e58948dabd872d9c5ebd7ecc1cc290a4b7e8f51",
  {
    input: {
      image: "https://replicate.delivery/pbxt/LYg9UV9q67McivPuwvpQPjClOZ7KqaOHH5F2DgbfCZspIhOQ/input.mp4",
      prompt: "Describe the video in great detail."
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run aodianyun/minicpm-v-26 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "aodianyun/minicpm-v-26:4e42bfc1891e0899109f0bd64e58948dabd872d9c5ebd7ecc1cc290a4b7e8f51",
    input={
        "image": "https://replicate.delivery/pbxt/LYg9UV9q67McivPuwvpQPjClOZ7KqaOHH5F2DgbfCZspIhOQ/input.mp4",
        "prompt": "Describe the video in great detail."
    }
)

# The aodianyun/minicpm-v-26 model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/aodianyun/minicpm-v-26/api#output-schema
    print(item, end="")

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run aodianyun/minicpm-v-26 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "4e42bfc1891e0899109f0bd64e58948dabd872d9c5ebd7ecc1cc290a4b7e8f51",
    "input": {
      "image": "https://replicate.delivery/pbxt/LYg9UV9q67McivPuwvpQPjClOZ7KqaOHH5F2DgbfCZspIhOQ/input.mp4",
      "prompt": "Describe the video in great detail."
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

The video depicts a a cooking process involving a b. Here is the detailed step-by-step description: 1. **Initial Preparation**: The video begins with an empty pan on a and a utensils placed next to it. 22. **Adding Ingredients**: A person starts adding ingredients into the pan, which appears to be some form of liquid or sauce. 3. **Cooking Process Begins**: As more ingredients are added, the pan starts heating up, indicating the commencement of the cooking process. 4. **Monitoring Cooking**: The person continues to monitor the cooking process, ensuring that everything is being cooked evenly. 5. **Adding Vegetables**: At one point, green vegetables are added to the pan, suggesting a multi-ingredient dish is being prepared. 6. **Stirring and Mixing**: Throughout the cooking process, the individual uses a utensil to stir and mix the ingredients, ensuring they cook uniformly. 7. **Final Stages**: Near the end of the video, the contents in the pan appears well-cooked, with steam rising from it. 8. **Plating**: The final part of the video shows the pan being lifted off the heat source, and the cooked mixture being transferred into a container, likely for serving. 9. **Conclusion**: The video concludes with the pan being removed completely, leaving only the now container filled with the cooked mixture. This sequence provides a visual representation of how a can be used for cooking various dishes, emphasizing the importance of monitoring and stirring during the cooking process.

{
  "completed_at": "2024-09-13T10:18:00.281537Z",
  "created_at": "2024-09-13T10:14:53.346000Z",
  "data_removed": false,
  "error": null,
  "id": "9aw9w676m9rgj0chxbg8w10g90",
  "input": {
    "image": "https://replicate.delivery/pbxt/LYg9UV9q67McivPuwvpQPjClOZ7KqaOHH5F2DgbfCZspIhOQ/input.mp4",
    "prompt": "Describe the video in great detail."
  },
  "logs": "video_duration 20.099\nframe_rate 0.49753719090502013\nSpecial tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.",
  "metrics": {
    "predict_time": 15.142686484,
    "total_time": 186.935537
  },
  "output": [
    "",
    "",
    "The ",
    "video ",
    "depicts ",
    "a ",
    "a ",
    "cooking ",
    "process ",
    "involving ",
    "a ",
    "",
    "b. ",
    "Here ",
    "is ",
    "the ",
    "detailed ",
    "",
    "",
    "step-by-step ",
    "description:\n\n",
    "",
    "",
    "1. ",
    "",
    "**Initial ",
    "",
    "Preparation**: ",
    "The ",
    "video ",
    "begins ",
    "with ",
    "an ",
    "empty ",
    "pan ",
    "on ",
    "a ",
    "and ",
    "a ",
    "",
    "utensils ",
    "placed ",
    "next ",
    "to ",
    "it.\n\n",
    "",
    "",
    "",
    "22. ",
    "",
    "**Adding ",
    "",
    "Ingredients**: ",
    "A ",
    "person ",
    "starts ",
    "adding ",
    "ingredients ",
    "into ",
    "the ",
    "",
    "pan, ",
    "which ",
    "appears ",
    "to ",
    "be ",
    "some ",
    "form ",
    "of ",
    "liquid ",
    "or ",
    "sauce.\n\n",
    "",
    "",
    "3. ",
    "",
    "",
    "**Cooking ",
    "Process ",
    "",
    "Begins**: ",
    "As ",
    "more ",
    "ingredients ",
    "are ",
    "",
    "added, ",
    "the ",
    "pan ",
    "starts ",
    "heating ",
    "",
    "up, ",
    "indicating ",
    "the ",
    "commencement ",
    "of ",
    "the ",
    "cooking ",
    "process.\n\n",
    "",
    "",
    "4. ",
    "",
    "**Monitoring ",
    "",
    "Cooking**: ",
    "The ",
    "person ",
    "continues ",
    "to ",
    "monitor ",
    "the ",
    "cooking ",
    "",
    "process, ",
    "ensuring ",
    "that ",
    "everything ",
    "is ",
    "being ",
    "cooked ",
    "evenly.\n\n",
    "",
    "",
    "5. ",
    "",
    "**Adding ",
    "",
    "",
    "Vegetables**: ",
    "At ",
    "one ",
    "",
    "point, ",
    "green ",
    "vegetables ",
    "are ",
    "added ",
    "to ",
    "the ",
    "",
    "pan, ",
    "suggesting ",
    "a ",
    "",
    "",
    "multi-ingredient ",
    "dish ",
    "is ",
    "being ",
    "prepared.\n\n",
    "",
    "",
    "6. ",
    "",
    "",
    "",
    "**Stirring ",
    "and ",
    "",
    "Mixing**: ",
    "Throughout ",
    "the ",
    "cooking ",
    "",
    "process, ",
    "the ",
    "individual ",
    "uses ",
    "a ",
    "",
    "utensil ",
    "to ",
    "stir ",
    "and ",
    "mix ",
    "the ",
    "",
    "ingredients, ",
    "ensuring ",
    "they ",
    "cook ",
    "uniformly.\n\n",
    "",
    "",
    "7. ",
    "",
    "**Final ",
    "",
    "",
    "Stages**: ",
    "Near ",
    "the ",
    "end ",
    "of ",
    "the ",
    "",
    "video, ",
    "the ",
    "contents ",
    "in ",
    "the ",
    "pan ",
    "appears ",
    "",
    "",
    "",
    "well-cooked, ",
    "with ",
    "steam ",
    "rising ",
    "from ",
    "it.\n\n",
    "",
    "",
    "8. ",
    "",
    "",
    "",
    "**Plating**: ",
    "The ",
    "final ",
    "part ",
    "of ",
    "the ",
    "video ",
    "shows ",
    "the ",
    "pan ",
    "being ",
    "lifted ",
    "off ",
    "the ",
    "heat ",
    "",
    "source, ",
    "and ",
    "the ",
    "cooked ",
    "mixture ",
    "being ",
    "transferred ",
    "into ",
    "a ",
    "",
    "container, ",
    "likely ",
    "for ",
    "serving.\n\n",
    "",
    "",
    "9. ",
    "",
    "",
    "**Conclusion**: ",
    "The ",
    "video ",
    "concludes ",
    "with ",
    "the ",
    "pan ",
    "being ",
    "removed ",
    "",
    "completely, ",
    "leaving ",
    "only ",
    "the ",
    "now ",
    "container ",
    "filled ",
    "with ",
    "the ",
    "cooked ",
    "mixture.\n\n",
    "",
    "This ",
    "sequence ",
    "provides ",
    "a ",
    "visual ",
    "representation ",
    "of ",
    "how ",
    "a ",
    "can ",
    "be ",
    "used ",
    "for ",
    "cooking ",
    "various ",
    "",
    "dishes, ",
    "emphasizing ",
    "the ",
    "importance ",
    "of ",
    "monitoring ",
    "and ",
    "stirring ",
    "during ",
    "the ",
    "cooking ",
    "",
    "",
    "process."
  ],
  "started_at": "2024-09-13T10:17:45.138850Z",
  "status": "succeeded",
  "urls": {
    "stream": "https://stream-g.svc.us.c.replicate.net/v1/streams/ciwntw5wslwhky7pgcjyp4iwiut2cpbfnmpfvjo4kfwkdvolpk5a",
    "get": "https://api.replicate.com/v1/predictions/9aw9w676m9rgj0chxbg8w10g90",
    "cancel": "https://api.replicate.com/v1/predictions/9aw9w676m9rgj0chxbg8w10g90/cancel"
  },
  "version": "4e42bfc1891e0899109f0bd64e58948dabd872d9c5ebd7ecc1cc290a4b7e8f51"
}

Generated in

15.2 seconds

Tweak it Share Report

Want to make some of these yourself?

Run this model