Prediction

Official model

openai/gpt-4o

6vpwwwbvgnrmc0cqn71v6qnpg4

Status

Succeeded

Source

Web

Total duration

1.2s

Created

6 months ago

Webhook

–

Input

prompt: Who was the 16th president of the United States?
system_prompt: You are a helpful assistant.
image_input
temperature: 1
max_completion_tokens: 4096
top_p: 1
frequency_penalty: 0
presence_penalty: 0

{
  "frequency_penalty": 0,
  "image_input": [],
  "max_completion_tokens": 4096,
  "presence_penalty": 0,
  "prompt": "Who was the 16th president of the United States?",
  "system_prompt": "You are a helpful assistant.",
  "temperature": 1,
  "top_p": 1
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_dzo**********************************

This is your API token. Keep it to yourself.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run openai/gpt-4o using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const input = {
  frequency_penalty: 0,
  image_input: [],
  max_completion_tokens: 4096,
  presence_penalty: 0,
  prompt: "Who was the 16th president of the United States?",
  system_prompt: "You are a helpful assistant.",
  temperature: 1,
  top_p: 1
};

for await (const event of replicate.stream("openai/gpt-4o", { input })) {
  process.stdout.write(event.toString());
};

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_dzo**********************************

This is your API token. Keep it to yourself.

Import the client:

import replicate

Run openai/gpt-4o using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

# The openai/gpt-4o model can stream output as it's running.
for event in replicate.stream(
    "openai/gpt-4o",
    input={
        "frequency_penalty": 0,
        "image_input": [],
        "max_completion_tokens": 4096,
        "presence_penalty": 0,
        "prompt": "Who was the 16th president of the United States?",
        "system_prompt": "You are a helpful assistant.",
        "temperature": 1,
        "top_p": 1
    },
):
    print(str(event), end="")

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=r8_dzo**********************************

This is your API token. Keep it to yourself.

Run openai/gpt-4o using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "input": {
      "frequency_penalty": 0,
      "image_input": [],
      "max_completion_tokens": 4096,
      "presence_penalty": 0,
      "prompt": "Who was the 16th president of the United States?",
      "system_prompt": "You are a helpful assistant.",
      "temperature": 1,
      "top_p": 1
    }
  }' \
  https://api.replicate.com/v1/models/openai/gpt-4o/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

The 16th president of the United States was Abraham Lincoln. He served from March 4, 1861, until his assassination on April 15, 1865.

Generated in

1.1 second

Input tokens

Output tokens

Tokens per second

59.70 tokens / second

Time to first token

0.6 seconds

Tweak it Iterate in playground Report