zsxkib / jina-clip-v2

Jina-CLIP v2: 0.9B multimodal embedding model with 89-language multilingual support, 512x512 image resolution, and Matryoshka representations

Cold

Public
76K runs
T4
Weights
Paper
License

Run with an API

Playground API Examples README Versions

Prediction

zsxkib/jina-clip-v2:5050c310

Model

zsxkib/jina-clip-v2:5050c310

kcwtbtg1pnrg80ckedy983n82m

Status

Succeeded

Source

Web

Hardware

Total duration

Created

4 months ago

Input

text: A cute fox
image
embedding_dim: 64
output_format: base64

{
  "text": "A cute fox",
  "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
  "embedding_dim": 64,
  "output_format": "base64"
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zsxkib/jina-clip-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zsxkib/jina-clip-v2:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448",
  {
    input: {
      text: "A cute fox",
      image: "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
      embedding_dim: 64,
      output_format: "base64"
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run zsxkib/jina-clip-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zsxkib/jina-clip-v2:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448",
    input={
        "text": "A cute fox",
        "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
        "embedding_dim": 64,
        "output_format": "base64"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run zsxkib/jina-clip-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448",
    "input": {
      "text": "A cute fox",
      "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
      "embedding_dim": 64,
      "output_format": "base64"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/zsxkib/jina-clip-v2@sha256:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448 \
  -i 'text="A cute fox"' \
  -i 'image="https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg"' \
  -i 'embedding_dim=64' \
  -i 'output_format="base64"'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/zsxkib/jina-clip-v2@sha256:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "text": "A cute fox",
      "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
      "embedding_dim": 64,
      "output_format": "base64"
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

uAhEvoVqwDyFtDg+aP6rvHA6xD1iKvY9dBz/vBJCXz4xFSY92mw/vl3zSz5xY0e8ugd0vmo/Ij4X/N09yuLcOxs+nb0fJcU8CgtDPqJKKr3mXLO9Zm6DvTobtT1Evk++mzNqvLbZJT6YEDw+ngaOvXOaab2gofQ8qrAGvkkrgD67Dws+6nKbvnk34L2bAvI9FlNKOsW6W73YY5K+bVmkvWj2Lj3TyUK7EYxAPj4/4Ly0mY294LcePeQggTzc89e9gMUNvpyvujtA/hi9O40APAwixL25WwM+b7jzO9cHvj0gboc9bxyUvTXXXL0VoQQ9cwQnPUpHHj5pH7i9eRNgvg==

eR/JvaEGCj5U8Lw8oGMEPhHuD74frls8R6XovaMmTLwPaIC9fXW6vF5ahDxqi929Zmtbvk7tJT5t7CM8w89zPWeogz3HHIw9jd8dPvUD3b0wQki9Kpt2vWBYmb1Xxam9kz7yPXAA6b23roS9qQiovXZZ9LxOgw8+7xlBvRMOPD4fskc9zONKvjLOYb4/ed49KAKxO1Bwib35RqQ8G3EKPu/TCj4xFdE9O4g8Plzrib2NUNO9rUwkPvxIQj2QbXW+PUDrPYbdlb2JUke+lRMOPS3OJb5XPAO+05oBPRSPAj0DBSC9aYQmPi4Fib7/pZS+oj0kvUriED79nTm+vE5Vvg==

Generated in

1.1 seconds

Tweak it Share Report

Prediction

zsxkib/jina-clip-v2:5050c310

Model

zsxkib/jina-clip-v2:5050c310

kcwtbtg1pnrg80ckedy983n82m

Status

Succeeded

Source

Web

Hardware

Total duration

Created

4 months ago

Input

text: A cute fox
image
embedding_dim: 64
output_format: base64

{
  "text": "A cute fox",
  "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
  "embedding_dim": 64,
  "output_format": "base64"
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zsxkib/jina-clip-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zsxkib/jina-clip-v2:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448",
  {
    input: {
      text: "A cute fox",
      image: "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
      embedding_dim: 64,
      output_format: "base64"
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run zsxkib/jina-clip-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zsxkib/jina-clip-v2:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448",
    input={
        "text": "A cute fox",
        "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
        "embedding_dim": 64,
        "output_format": "base64"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run zsxkib/jina-clip-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448",
    "input": {
      "text": "A cute fox",
      "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
      "embedding_dim": 64,
      "output_format": "base64"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/zsxkib/jina-clip-v2@sha256:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448 \
  -i 'text="A cute fox"' \
  -i 'image="https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg"' \
  -i 'embedding_dim=64' \
  -i 'output_format="base64"'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/zsxkib/jina-clip-v2@sha256:5050c3108bab23981802011a3c76ee327cc0dbfdd31a2f4ef1ee8ef0d3f0b448
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "text": "A cute fox",
      "image": "https://images.stockcake.com/public/f/b/a/fba4da70-95d2-4e86-825b-38c32b15f678_large/fox-in-flight-stockcake.jpg",
      "embedding_dim": 64,
      "output_format": "base64"
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

Generated in

1.1 seconds

Tweak it Share Report

Want to make some of these yourself?

Run this model

zsxkib / jina-clip-v2

Prediction

Input

Output

Prediction

Input

Output

Logs (kcwtbtg1pnrg80ckedy983n82m)

Logs (kcwtbtg1pnrg80ckedy983n82m)