Prediction

idea-research/ram-grounded-sam:80a2aede

Model

idea-research/ram-grounded-sam:52443130

ID

dis6i23b5xpxynblnjqsnzj7qi

Status

Succeeded

Source

Web

Hardware

A100 (40GB)

Total duration

16.2s

Created

almost 2 years ago

Input

use_sam_hq
input_image

{
  "use_sam_hq": true,
  "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
  {
    input: {
      use_sam_hq: true,
      input_image: "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    input={
        "use_sam_hq": True,
        "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    "input": {
      "use_sam_hq": true,
      "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

tags

blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk

json_data

{ "mask": [ { "label": "background", "value": 0 }, { "box": [ 447.7718811035156, 124.53912353515625, 1290.986083984375, 1642.045166015625 ], "label": "christmas tree", "logit": 0.59, "value": 1 }, { "box": [ 2145.87646484375, 1465.0322265625, 2413.177490234375, 1993.34521484375 ], "label": "person", "logit": 0.43, "value": 2 }, { "box": [ 2602.589599609375, 1359.5167236328125, 2759.728515625, 1679.375 ], "label": "person", "logit": 0.36, "value": 3 }, { "box": [ 1972.0328369140625, 1405.271240234375, 2139.08740234375, 1846.872802734375 ], "label": "person", "logit": 0.35, "value": 4 }, { "box": [ 770.5214233398438, 1232.5810546875, 1365.618896484375, 1702.4271240234375 ], "label": "stall", "logit": 0.32, "value": 5 }, { "box": [ 4.3865966796875, 1491.7822265625, 2992.400390625, 1996.292236328125 ], "label": "snow", "logit": 0.29, "value": 6 }, { "box": [ 7.7828369140625, 14.20318603515625, 2989.4248046875, 1987.43603515625 ], "label": "town square", "logit": 0.27, "value": 7 }, { "box": [ 765.1876220703125, 1226.3323974609375, 1388.451171875, 1330.4671630859375 ], "label": "blanket", "logit": 0.25, "value": 8 }, { "box": [ 1608.644287109375, 1352.242919921875, 1705.8228759765625, 1571.37353515625 ], "label": "person", "logit": 0.25, "value": 9 }, { "box": [ 2454.14013671875, 1378.1806640625, 2591.238525390625, 1705.857421875 ], "label": "person", "logit": 0.25, "value": 10 } ], "tags": "blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk" }

masked_img

rounding_box_img

{
  "completed_at": "2023-06-16T12:40:27.606115Z",
  "created_at": "2023-06-16T12:40:11.376359Z",
  "data_removed": false,
  "error": null,
  "id": "dis6i23b5xpxynblnjqsnzj7qi",
  "input": {
    "use_sam_hq": true,
    "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
  },
  "logs": "Before NMS: 11 boxes\nAfter NMS: 10 boxes",
  "metrics": {
    "predict_time": 16.222222,
    "total_time": 16.229756
  },
  "output": {
    "tags": "blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk",
    "json_data": {
      "mask": [
        {
          "label": "background",
          "value": 0
        },
        {
          "box": [
            447.7718811035156,
            124.53912353515625,
            1290.986083984375,
            1642.045166015625
          ],
          "label": "christmas tree",
          "logit": 0.59,
          "value": 1
        },
        {
          "box": [
            2145.87646484375,
            1465.0322265625,
            2413.177490234375,
            1993.34521484375
          ],
          "label": "person",
          "logit": 0.43,
          "value": 2
        },
        {
          "box": [
            2602.589599609375,
            1359.5167236328125,
            2759.728515625,
            1679.375
          ],
          "label": "person",
          "logit": 0.36,
          "value": 3
        },
        {
          "box": [
            1972.0328369140625,
            1405.271240234375,
            2139.08740234375,
            1846.872802734375
          ],
          "label": "person",
          "logit": 0.35,
          "value": 4
        },
        {
          "box": [
            770.5214233398438,
            1232.5810546875,
            1365.618896484375,
            1702.4271240234375
          ],
          "label": "stall",
          "logit": 0.32,
          "value": 5
        },
        {
          "box": [
            4.3865966796875,
            1491.7822265625,
            2992.400390625,
            1996.292236328125
          ],
          "label": "snow",
          "logit": 0.29,
          "value": 6
        },
        {
          "box": [
            7.7828369140625,
            14.20318603515625,
            2989.4248046875,
            1987.43603515625
          ],
          "label": "town square",
          "logit": 0.27,
          "value": 7
        },
        {
          "box": [
            765.1876220703125,
            1226.3323974609375,
            1388.451171875,
            1330.4671630859375
          ],
          "label": "blanket",
          "logit": 0.25,
          "value": 8
        },
        {
          "box": [
            1608.644287109375,
            1352.242919921875,
            1705.8228759765625,
            1571.37353515625
          ],
          "label": "person",
          "logit": 0.25,
          "value": 9
        },
        {
          "box": [
            2454.14013671875,
            1378.1806640625,
            2591.238525390625,
            1705.857421875
          ],
          "label": "person",
          "logit": 0.25,
          "value": 10
        }
      ],
      "tags": "blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk"
    },
    "masked_img": "https://replicate.delivery/pbxt/q7guUH7mq0oUB1f8R3U8DKXDFWFW4iuLpLP184MZUF4dUQjIA/mask.png",
    "rounding_box_img": "https://replicate.delivery/pbxt/2MPkfaDaFuRDeEzbQRZRGOp7xnQcJIYen4dWiuUyTMI1RBNiA/automatic_label_output.png"
  },
  "started_at": "2023-06-16T12:40:11.383893Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/dis6i23b5xpxynblnjqsnzj7qi",
    "cancel": "https://api.replicate.com/v1/predictions/dis6i23b5xpxynblnjqsnzj7qi/cancel"
  },
  "version": "524431302c66d1c5418bb86ff1213c4140833ae80b1b6702ba85c2b810e4d6df"
}

Generated in

16.2 seconds

Tweak it ShareReport

Prediction

idea-research/ram-grounded-sam:80a2aede

Model

idea-research/ram-grounded-sam:52443130

ID

mmjtiw3bevrxcdkxdh22yfdnk4

Status

Succeeded

Source

Web

Hardware

A100 (40GB)

Total duration

33.0s

Created

almost 2 years ago

Input

use_sam_hq
input_image

{
  "use_sam_hq": false,
  "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
  {
    input: {
      use_sam_hq: false,
      input_image: "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    input={
        "use_sam_hq": False,
        "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    "input": {
      "use_sam_hq": false,
      "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

tags

blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk

json_data

{ "mask": [ { "label": "background", "value": 0 }, { "box": [ 447.7718811035156, 124.53912353515625, 1290.986083984375, 1642.045166015625 ], "label": "christmas tree", "logit": 0.59, "value": 1 }, { "box": [ 2145.87646484375, 1465.0322265625, 2413.177490234375, 1993.34521484375 ], "label": "person", "logit": 0.43, "value": 2 }, { "box": [ 2602.589599609375, 1359.5167236328125, 2759.728515625, 1679.375 ], "label": "person", "logit": 0.36, "value": 3 }, { "box": [ 1972.0328369140625, 1405.271240234375, 2139.08740234375, 1846.872802734375 ], "label": "person", "logit": 0.35, "value": 4 }, { "box": [ 770.5214233398438, 1232.5810546875, 1365.618896484375, 1702.4271240234375 ], "label": "stall", "logit": 0.32, "value": 5 }, { "box": [ 4.3865966796875, 1491.7822265625, 2992.400390625, 1996.292236328125 ], "label": "snow", "logit": 0.29, "value": 6 }, { "box": [ 7.7828369140625, 14.20318603515625, 2989.4248046875, 1987.43603515625 ], "label": "town square", "logit": 0.27, "value": 7 }, { "box": [ 765.1876220703125, 1226.3323974609375, 1388.451171875, 1330.4671630859375 ], "label": "blanket", "logit": 0.25, "value": 8 }, { "box": [ 1608.644287109375, 1352.242919921875, 1705.8228759765625, 1571.37353515625 ], "label": "person", "logit": 0.25, "value": 9 }, { "box": [ 2454.14013671875, 1378.1806640625, 2591.238525390625, 1705.857421875 ], "label": "person", "logit": 0.25, "value": 10 } ], "tags": "blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk" }

masked_img

rounding_box_img

{
  "completed_at": "2023-06-16T12:48:50.084961Z",
  "created_at": "2023-06-16T12:48:17.068611Z",
  "data_removed": false,
  "error": null,
  "id": "mmjtiw3bevrxcdkxdh22yfdnk4",
  "input": {
    "use_sam_hq": false,
    "input_image": "https://replicate.delivery/pbxt/J0ZuuR9TnfvQr609pnHjkHAyySHEctD35WXXQQK9QMoprKD7/demo2.jpg"
  },
  "logs": "Before NMS: 11 boxes\nAfter NMS: 10 boxes",
  "metrics": {
    "predict_time": 16.531878,
    "total_time": 33.01635
  },
  "output": {
    "tags": "blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk",
    "json_data": {
      "mask": [
        {
          "label": "background",
          "value": 0
        },
        {
          "box": [
            447.7718811035156,
            124.53912353515625,
            1290.986083984375,
            1642.045166015625
          ],
          "label": "christmas tree",
          "logit": 0.59,
          "value": 1
        },
        {
          "box": [
            2145.87646484375,
            1465.0322265625,
            2413.177490234375,
            1993.34521484375
          ],
          "label": "person",
          "logit": 0.43,
          "value": 2
        },
        {
          "box": [
            2602.589599609375,
            1359.5167236328125,
            2759.728515625,
            1679.375
          ],
          "label": "person",
          "logit": 0.36,
          "value": 3
        },
        {
          "box": [
            1972.0328369140625,
            1405.271240234375,
            2139.08740234375,
            1846.872802734375
          ],
          "label": "person",
          "logit": 0.35,
          "value": 4
        },
        {
          "box": [
            770.5214233398438,
            1232.5810546875,
            1365.618896484375,
            1702.4271240234375
          ],
          "label": "stall",
          "logit": 0.32,
          "value": 5
        },
        {
          "box": [
            4.3865966796875,
            1491.7822265625,
            2992.400390625,
            1996.292236328125
          ],
          "label": "snow",
          "logit": 0.29,
          "value": 6
        },
        {
          "box": [
            7.7828369140625,
            14.20318603515625,
            2989.4248046875,
            1987.43603515625
          ],
          "label": "town square",
          "logit": 0.27,
          "value": 7
        },
        {
          "box": [
            765.1876220703125,
            1226.3323974609375,
            1388.451171875,
            1330.4671630859375
          ],
          "label": "blanket",
          "logit": 0.25,
          "value": 8
        },
        {
          "box": [
            1608.644287109375,
            1352.242919921875,
            1705.8228759765625,
            1571.37353515625
          ],
          "label": "person",
          "logit": 0.25,
          "value": 9
        },
        {
          "box": [
            2454.14013671875,
            1378.1806640625,
            2591.238525390625,
            1705.857421875
          ],
          "label": "person",
          "logit": 0.25,
          "value": 10
        }
      ],
      "tags": "blanket, building, christmas, christmas market, christmas tree, city, city square, crowded, person, market, market square, snow, stall, stroll, town, town square, walk"
    },
    "masked_img": "https://replicate.delivery/pbxt/zyeZlBBQo8z6KKJ3McT7T4viy9dFcSrLho61SKtTfjtxwgGRA/mask.png",
    "rounding_box_img": "https://replicate.delivery/pbxt/6lSd9ePHQjVeDEnN5leZv9F6CXQI3rMxewZmv6EULZnDDDaEB/automatic_label_output.png"
  },
  "started_at": "2023-06-16T12:48:33.553083Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/mmjtiw3bevrxcdkxdh22yfdnk4",
    "cancel": "https://api.replicate.com/v1/predictions/mmjtiw3bevrxcdkxdh22yfdnk4/cancel"
  },
  "version": "524431302c66d1c5418bb86ff1213c4140833ae80b1b6702ba85c2b810e4d6df"
}

Generated in

16.5 seconds

Tweak it ShareReport

Prediction

idea-research/ram-grounded-sam:80a2aede

Model

idea-research/ram-grounded-sam:47c4f1c7

ID

lnpkzhdb6nbmlmxeudkbelmml4

Status

Succeeded

Source

Web

Hardware

A100 (40GB)

Total duration

1.2s

Created

almost 2 years ago by @idea-research

Input

input_image
show_visualisation

{
  "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
  "show_visualisation": false
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
  {
    input: {
      input_image: "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
      show_visualisation: false
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    input={
        "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
        "show_visualisation": False
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    "input": {
      "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
      "show_visualisation": false
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

tags

armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor

json_data

{ "mask": [ { "label": "background", "value": 0 }, { "box": [ 1590.994384765625, 1150.455810546875, 2062.0126953125, 1525.410400390625 ], "label": "dog", "logit": 0.61, "value": 1 }, { "box": [ 320.5067138671875, 1872.4437255859375, 2564.30126953125, 2149.60693359375 ], "label": "carpet", "logit": 0.51, "value": 2 }, { "box": [ 2526.239013671875, 905.7824096679688, 2951.733154296875, 1446.57421875 ], "label": "lamp", "logit": 0.49, "value": 3 }, { "box": [ 1488.95751953125, 1134.001953125, 2101.83740234375, 1869.38525390625 ], "label": "blanket", "logit": 0.49, "value": 4 }, { "box": [ 1649.08935546875, 462.552734375, 2173.29248046875, 844.016357421875 ], "label": "picture frame", "logit": 0.46, "value": 5 }, { "box": [ 7.120361328125, 9.4737548828125, 2988.807861328125, 2143.8388671875 ], "label": "living room room", "logit": 0.45, "value": 6 }, { "box": [ 5.122314453125, 1560.66943359375, 2993.923828125, 2147.88232421875 ], "label": "floor wood floor", "logit": 0.44, "value": 7 }, { "box": [ 21.509536743164062, 1283.55908203125, 493.4183349609375, 1861.4951171875 ], "label": "plant", "logit": 0.43, "value": 8 }, { "box": [ 318.203369140625, 746.8875732421875, 874.658447265625, 1167.321044921875 ], "label": "plant", "logit": 0.4, "value": 9 }, { "box": [ 2223.62109375, 196.16336059570312, 2685.33837890625, 838.8326416015625 ], "label": "picture frame", "logit": 0.38, "value": 10 }, { "box": [ 729.8843383789062, 1130.2867431640625, 2381.857666015625, 1854.0660400390625 ], "label": "armchair couch", "logit": 0.38, "value": 11 }, { "box": [ 987.6152954101562, 1520.15966796875, 1631.835693359375, 2110.7431640625 ], "label": "furniture stool", "logit": 0.37, "value": 12 }, { "box": [ 1056.6025390625, 1164.431396484375, 1398.310791015625, 1448.27099609375 ], "label": "pillow", "logit": 0.35, "value": 13 }, { "box": [ 2108.94873046875, 1920.5863037109375, 2995.509033203125, 2149.590087890625 ], "label": "stool", "logit": 0.31, "value": 14 }, { "box": [ 1787.185302734375, 1134.058837890625, 2167.47900390625, 1448.926025390625 ], "label": "pillow", "logit": 0.31, "value": 15 }, { "box": [ 899.2510986328125, 1112.372802734375, 1249.1456298828125, 1453.3167724609375 ], "label": "pillow", "logit": 0.3, "value": 16 }, { "box": [ 471.819580078125, 1143.072998046875, 961.84228515625, 1664.814697265625 ], "label": "furniture", "logit": 0.27, "value": 17 }, { "box": [ 2467.264892578125, 1397.0821533203125, 2937.561279296875, 1785.8111572265625 ], "label": "furniture", "logit": 0.26, "value": 18 } ], "tags": "armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor" }

{
  "completed_at": "2023-06-17T08:55:52.530188Z",
  "created_at": "2023-06-17T08:55:51.347268Z",
  "data_removed": false,
  "error": null,
  "id": "lnpkzhdb6nbmlmxeudkbelmml4",
  "input": {
    "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
    "show_visualisation": false
  },
  "logs": "Before NMS: 23 boxes\nAfter NMS: 18 boxes",
  "metrics": {
    "predict_time": 1.229093,
    "total_time": 1.18292
  },
  "output": {
    "tags": "armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor",
    "json_data": {
      "mask": [
        {
          "label": "background",
          "value": 0
        },
        {
          "box": [
            1590.994384765625,
            1150.455810546875,
            2062.0126953125,
            1525.410400390625
          ],
          "label": "dog",
          "logit": 0.61,
          "value": 1
        },
        {
          "box": [
            320.5067138671875,
            1872.4437255859375,
            2564.30126953125,
            2149.60693359375
          ],
          "label": "carpet",
          "logit": 0.51,
          "value": 2
        },
        {
          "box": [
            2526.239013671875,
            905.7824096679688,
            2951.733154296875,
            1446.57421875
          ],
          "label": "lamp",
          "logit": 0.49,
          "value": 3
        },
        {
          "box": [
            1488.95751953125,
            1134.001953125,
            2101.83740234375,
            1869.38525390625
          ],
          "label": "blanket",
          "logit": 0.49,
          "value": 4
        },
        {
          "box": [
            1649.08935546875,
            462.552734375,
            2173.29248046875,
            844.016357421875
          ],
          "label": "picture frame",
          "logit": 0.46,
          "value": 5
        },
        {
          "box": [
            7.120361328125,
            9.4737548828125,
            2988.807861328125,
            2143.8388671875
          ],
          "label": "living room room",
          "logit": 0.45,
          "value": 6
        },
        {
          "box": [
            5.122314453125,
            1560.66943359375,
            2993.923828125,
            2147.88232421875
          ],
          "label": "floor wood floor",
          "logit": 0.44,
          "value": 7
        },
        {
          "box": [
            21.509536743164062,
            1283.55908203125,
            493.4183349609375,
            1861.4951171875
          ],
          "label": "plant",
          "logit": 0.43,
          "value": 8
        },
        {
          "box": [
            318.203369140625,
            746.8875732421875,
            874.658447265625,
            1167.321044921875
          ],
          "label": "plant",
          "logit": 0.4,
          "value": 9
        },
        {
          "box": [
            2223.62109375,
            196.16336059570312,
            2685.33837890625,
            838.8326416015625
          ],
          "label": "picture frame",
          "logit": 0.38,
          "value": 10
        },
        {
          "box": [
            729.8843383789062,
            1130.2867431640625,
            2381.857666015625,
            1854.0660400390625
          ],
          "label": "armchair couch",
          "logit": 0.38,
          "value": 11
        },
        {
          "box": [
            987.6152954101562,
            1520.15966796875,
            1631.835693359375,
            2110.7431640625
          ],
          "label": "furniture stool",
          "logit": 0.37,
          "value": 12
        },
        {
          "box": [
            1056.6025390625,
            1164.431396484375,
            1398.310791015625,
            1448.27099609375
          ],
          "label": "pillow",
          "logit": 0.35,
          "value": 13
        },
        {
          "box": [
            2108.94873046875,
            1920.5863037109375,
            2995.509033203125,
            2149.590087890625
          ],
          "label": "stool",
          "logit": 0.31,
          "value": 14
        },
        {
          "box": [
            1787.185302734375,
            1134.058837890625,
            2167.47900390625,
            1448.926025390625
          ],
          "label": "pillow",
          "logit": 0.31,
          "value": 15
        },
        {
          "box": [
            899.2510986328125,
            1112.372802734375,
            1249.1456298828125,
            1453.3167724609375
          ],
          "label": "pillow",
          "logit": 0.3,
          "value": 16
        },
        {
          "box": [
            471.819580078125,
            1143.072998046875,
            961.84228515625,
            1664.814697265625
          ],
          "label": "furniture",
          "logit": 0.27,
          "value": 17
        },
        {
          "box": [
            2467.264892578125,
            1397.0821533203125,
            2937.561279296875,
            1785.8111572265625
          ],
          "label": "furniture",
          "logit": 0.26,
          "value": 18
        }
      ],
      "tags": "armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor"
    },
    "masked_img": null,
    "rounding_box_img": null
  },
  "started_at": "2023-06-17T08:55:51.301095Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/lnpkzhdb6nbmlmxeudkbelmml4",
    "cancel": "https://api.replicate.com/v1/predictions/lnpkzhdb6nbmlmxeudkbelmml4/cancel"
  },
  "version": "47c4f1c73993ec1c8ab3c2b76fc6dfbab5dc5bab6c06786b196fa9e1bda8bcc4"
}

Generated in

1.2 seconds

Tweak it Share Report

Prediction

idea-research/ram-grounded-sam:80a2aede

Model

idea-research/ram-grounded-sam:80a2aede

ID

mxlzrebbyjlxgi6tyuufyov4wm

Status

Succeeded

Source

Web

Hardware

A100 (40GB)

Total duration

41.0s

Created

almost 2 years ago

Input

use_sam_hq
input_image
show_visualisation

{
  "use_sam_hq": true,
  "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
  "show_visualisation": true
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
  {
    input: {
      use_sam_hq: true,
      input_image: "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
      show_visualisation: true
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "idea-research/ram-grounded-sam:80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    input={
        "use_sam_hq": True,
        "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
        "show_visualisation": True
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run idea-research/ram-grounded-sam using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad",
    "input": {
      "use_sam_hq": true,
      "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
      "show_visualisation": true
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

tags

armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor

json_data

{ "mask": [ { "label": "background", "value": 0 }, { "box": [ 1590.994384765625, 1150.455810546875, 2062.0126953125, 1525.410400390625 ], "label": "dog", "logit": 0.61, "value": 1 }, { "box": [ 320.5067138671875, 1872.4437255859375, 2564.30126953125, 2149.60693359375 ], "label": "carpet", "logit": 0.51, "value": 2 }, { "box": [ 2526.239013671875, 905.7824096679688, 2951.733154296875, 1446.57421875 ], "label": "lamp", "logit": 0.49, "value": 3 }, { "box": [ 1488.95751953125, 1134.001953125, 2101.83740234375, 1869.38525390625 ], "label": "blanket", "logit": 0.49, "value": 4 }, { "box": [ 1649.08935546875, 462.552734375, 2173.29248046875, 844.016357421875 ], "label": "picture frame", "logit": 0.46, "value": 5 }, { "box": [ 7.120361328125, 9.4737548828125, 2988.807861328125, 2143.8388671875 ], "label": "living room room", "logit": 0.45, "value": 6 }, { "box": [ 5.122314453125, 1560.66943359375, 2993.923828125, 2147.88232421875 ], "label": "floor wood floor", "logit": 0.44, "value": 7 }, { "box": [ 21.509536743164062, 1283.55908203125, 493.4183349609375, 1861.4951171875 ], "label": "plant", "logit": 0.43, "value": 8 }, { "box": [ 318.203369140625, 746.8875732421875, 874.658447265625, 1167.321044921875 ], "label": "plant", "logit": 0.4, "value": 9 }, { "box": [ 2223.62109375, 196.16336059570312, 2685.33837890625, 838.8326416015625 ], "label": "picture frame", "logit": 0.38, "value": 10 }, { "box": [ 729.8843383789062, 1130.2867431640625, 2381.857666015625, 1854.0660400390625 ], "label": "armchair couch", "logit": 0.38, "value": 11 }, { "box": [ 987.6152954101562, 1520.15966796875, 1631.835693359375, 2110.7431640625 ], "label": "furniture stool", "logit": 0.37, "value": 12 }, { "box": [ 1056.6025390625, 1164.431396484375, 1398.310791015625, 1448.27099609375 ], "label": "pillow", "logit": 0.35, "value": 13 }, { "box": [ 2108.94873046875, 1920.5863037109375, 2995.509033203125, 2149.590087890625 ], "label": "stool", "logit": 0.31, "value": 14 }, { "box": [ 1787.185302734375, 1134.058837890625, 2167.47900390625, 1448.926025390625 ], "label": "pillow", "logit": 0.31, "value": 15 }, { "box": [ 899.2510986328125, 1112.372802734375, 1249.1456298828125, 1453.3167724609375 ], "label": "pillow", "logit": 0.3, "value": 16 }, { "box": [ 471.819580078125, 1143.072998046875, 961.84228515625, 1664.814697265625 ], "label": "furniture", "logit": 0.27, "value": 17 }, { "box": [ 2467.264892578125, 1397.0821533203125, 2937.561279296875, 1785.8111572265625 ], "label": "furniture", "logit": 0.26, "value": 18 } ], "tags": "armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor" }

masked_img

rounding_box_img

{
  "completed_at": "2023-06-17T09:26:41.165664Z",
  "created_at": "2023-06-17T09:26:00.138045Z",
  "data_removed": false,
  "error": null,
  "id": "mxlzrebbyjlxgi6tyuufyov4wm",
  "input": {
    "use_sam_hq": true,
    "input_image": "https://replicate.delivery/pbxt/J0ZYz9p5l5j1a8NR6GU1dprLTRS6O0g3QDyX9hTx0ignueHJ/demo1.jpg",
    "show_visualisation": true
  },
  "logs": "Before NMS: 23 boxes\nAfter NMS: 18 boxes",
  "metrics": {
    "predict_time": 41.056977,
    "total_time": 41.027619
  },
  "output": {
    "tags": "armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor",
    "json_data": {
      "mask": [
        {
          "label": "background",
          "value": 0
        },
        {
          "box": [
            1590.994384765625,
            1150.455810546875,
            2062.0126953125,
            1525.410400390625
          ],
          "label": "dog",
          "logit": 0.61,
          "value": 1
        },
        {
          "box": [
            320.5067138671875,
            1872.4437255859375,
            2564.30126953125,
            2149.60693359375
          ],
          "label": "carpet",
          "logit": 0.51,
          "value": 2
        },
        {
          "box": [
            2526.239013671875,
            905.7824096679688,
            2951.733154296875,
            1446.57421875
          ],
          "label": "lamp",
          "logit": 0.49,
          "value": 3
        },
        {
          "box": [
            1488.95751953125,
            1134.001953125,
            2101.83740234375,
            1869.38525390625
          ],
          "label": "blanket",
          "logit": 0.49,
          "value": 4
        },
        {
          "box": [
            1649.08935546875,
            462.552734375,
            2173.29248046875,
            844.016357421875
          ],
          "label": "picture frame",
          "logit": 0.46,
          "value": 5
        },
        {
          "box": [
            7.120361328125,
            9.4737548828125,
            2988.807861328125,
            2143.8388671875
          ],
          "label": "living room room",
          "logit": 0.45,
          "value": 6
        },
        {
          "box": [
            5.122314453125,
            1560.66943359375,
            2993.923828125,
            2147.88232421875
          ],
          "label": "floor wood floor",
          "logit": 0.44,
          "value": 7
        },
        {
          "box": [
            21.509536743164062,
            1283.55908203125,
            493.4183349609375,
            1861.4951171875
          ],
          "label": "plant",
          "logit": 0.43,
          "value": 8
        },
        {
          "box": [
            318.203369140625,
            746.8875732421875,
            874.658447265625,
            1167.321044921875
          ],
          "label": "plant",
          "logit": 0.4,
          "value": 9
        },
        {
          "box": [
            2223.62109375,
            196.16336059570312,
            2685.33837890625,
            838.8326416015625
          ],
          "label": "picture frame",
          "logit": 0.38,
          "value": 10
        },
        {
          "box": [
            729.8843383789062,
            1130.2867431640625,
            2381.857666015625,
            1854.0660400390625
          ],
          "label": "armchair couch",
          "logit": 0.38,
          "value": 11
        },
        {
          "box": [
            987.6152954101562,
            1520.15966796875,
            1631.835693359375,
            2110.7431640625
          ],
          "label": "furniture stool",
          "logit": 0.37,
          "value": 12
        },
        {
          "box": [
            1056.6025390625,
            1164.431396484375,
            1398.310791015625,
            1448.27099609375
          ],
          "label": "pillow",
          "logit": 0.35,
          "value": 13
        },
        {
          "box": [
            2108.94873046875,
            1920.5863037109375,
            2995.509033203125,
            2149.590087890625
          ],
          "label": "stool",
          "logit": 0.31,
          "value": 14
        },
        {
          "box": [
            1787.185302734375,
            1134.058837890625,
            2167.47900390625,
            1448.926025390625
          ],
          "label": "pillow",
          "logit": 0.31,
          "value": 15
        },
        {
          "box": [
            899.2510986328125,
            1112.372802734375,
            1249.1456298828125,
            1453.3167724609375
          ],
          "label": "pillow",
          "logit": 0.3,
          "value": 16
        },
        {
          "box": [
            471.819580078125,
            1143.072998046875,
            961.84228515625,
            1664.814697265625
          ],
          "label": "furniture",
          "logit": 0.27,
          "value": 17
        },
        {
          "box": [
            2467.264892578125,
            1397.0821533203125,
            2937.561279296875,
            1785.8111572265625
          ],
          "label": "furniture",
          "logit": 0.26,
          "value": 18
        }
      ],
      "tags": "armchair, blanket, lamp, carpet, couch, dog, floor, furniture, gray, green, living room, picture frame, pillow, plant, room, sit, stool, wood floor"
    },
    "masked_img": "https://replicate.delivery/pbxt/nAoM5dc1WZ62KV6itFsSnfEOFN4QKRdXYK6k0aKZ2VEocZjIA/mask.png",
    "rounding_box_img": "https://replicate.delivery/pbxt/eRV1reoCrKncD0fXe4S58nlefSeNKcXeJuUHFIxDOUlWQ5yGRA/automatic_label_output.png"
  },
  "started_at": "2023-06-17T09:26:00.108687Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/mxlzrebbyjlxgi6tyuufyov4wm",
    "cancel": "https://api.replicate.com/v1/predictions/mxlzrebbyjlxgi6tyuufyov4wm/cancel"
  },
  "version": "80a2aede4cf8e3c9f26e96c308d45b23c350dd36f1c381de790715007f1ac0ad"
}

Generated in

41.1 seconds

Tweak it ShareReport

idea-research / ram-grounded-sam

Prediction

Input

Output

Prediction

Input

Output

Prediction

Input

Output

Prediction

Input

Output

Logs (dis6i23b5xpxynblnjqsnzj7qi)

Logs (mmjtiw3bevrxcdkxdh22yfdnk4)

Logs (lnpkzhdb6nbmlmxeudkbelmml4)

Logs (mxlzrebbyjlxgi6tyuufyov4wm)