daanelson / motion_diffusion_model

A diffusion model for generating human motion video from a text prompt

Cold

Public
14.2K runs
T4
GitHub
Paper
License

Run with an API

Playground API Examples README Versions

Prediction

daanelson/motion_diffusion_model:3e2218c0

Model

daanelson/motion_diffusion_model:f7a4f1c6

w3wgblb245gtnivcd5tvdhwtam

Status

Succeeded

Source

Web

Hardware

–

Total duration

2m 46s

Created

over 2 years ago by @arielreplicate

Input

prompt: the person angrily punching the air.
num_repetitions: 4

{
  "prompt": "the person angrily punching the air.",
  "num_repetitions": 4
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run daanelson/motion_diffusion_model using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "daanelson/motion_diffusion_model:3e2218c061c18b2a7388dd91b6677b6515529d4db4d719a6513a23522d23cfa7",
  {
    input: {
      prompt: "the person angrily punching the air.",
      num_repetitions: 4
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run daanelson/motion_diffusion_model using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "daanelson/motion_diffusion_model:3e2218c061c18b2a7388dd91b6677b6515529d4db4d719a6513a23522d23cfa7",
    input={
        "prompt": "the person angrily punching the air.",
        "num_repetitions": 4
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run daanelson/motion_diffusion_model using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "3e2218c061c18b2a7388dd91b6677b6515529d4db4d719a6513a23522d23cfa7",
    "input": {
      "prompt": "the person angrily punching the air.",
      "num_repetitions": 4
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Generated in

2 minutes 46 seconds

Tweak it Share Report

Prediction

daanelson/motion_diffusion_model:3e2218c0

Model

daanelson/motion_diffusion_model:f7a4f1c6

42n6r2tyuzafxoyhkv3auaeuhe

Status

Succeeded

Source

Web

Hardware

–

Total duration

2m 48s

Created

over 2 years ago by @arielreplicate

Input

prompt: the person break-dancing
num_repetitions: 4

{
  "prompt": "the person break-dancing",
  "num_repetitions": 4
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run daanelson/motion_diffusion_model using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "daanelson/motion_diffusion_model:3e2218c061c18b2a7388dd91b6677b6515529d4db4d719a6513a23522d23cfa7",
  {
    input: {
      prompt: "the person break-dancing",
      num_repetitions: 4
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run daanelson/motion_diffusion_model using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "daanelson/motion_diffusion_model:3e2218c061c18b2a7388dd91b6677b6515529d4db4d719a6513a23522d23cfa7",
    input={
        "prompt": "the person break-dancing",
        "num_repetitions": 4
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run daanelson/motion_diffusion_model using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "3e2218c061c18b2a7388dd91b6677b6515529d4db4d719a6513a23522d23cfa7",
    "input": {
      "prompt": "the person break-dancing",
      "num_repetitions": 4
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Generated in

2 minutes 48 seconds

Tweak it Share Report

Want to make some of these yourself?

Run this model

daanelson / motion_diffusion_model

Prediction

Input

Output

Prediction

Input

Output

Logs (w3wgblb245gtnivcd5tvdhwtam)

Logs (42n6r2tyuzafxoyhkv3auaeuhe)