Prediction

lucataco/qwen1.5-72b:f919d3c43a8758de744cf2908426dd744154120f0a22e457a3fa647acdfe33be

Model

lucataco/qwen1.5-72b:f919d3c4

urgqsx3b7d2a7kf54w3zyiwna4

Status

Succeeded

Source

Web

Hardware

A100 (80GB)

Total duration

16m 54s

Created

over 1 year ago

Input

top_k: 1
top_p: 1
prompt: Give me a short introduction to large language model.
temperature: 1
system_prompt: You are a helpful assistant.
max_new_tokens: 512
repetition_penalty: 1

{
  "top_k": 1,
  "top_p": 1,
  "prompt": "Give me a short introduction to large language model.",
  "temperature": 1,
  "system_prompt": "You are a helpful assistant.",
  "max_new_tokens": 512,
  "repetition_penalty": 1
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run lucataco/qwen1.5-72b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "lucataco/qwen1.5-72b:f919d3c43a8758de744cf2908426dd744154120f0a22e457a3fa647acdfe33be",
  {
    input: {
      top_k: 1,
      top_p: 1,
      prompt: "Give me a short introduction to large language model.",
      temperature: 1,
      system_prompt: "You are a helpful assistant.",
      max_new_tokens: 512,
      repetition_penalty: 1
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run lucataco/qwen1.5-72b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "lucataco/qwen1.5-72b:f919d3c43a8758de744cf2908426dd744154120f0a22e457a3fa647acdfe33be",
    input={
        "top_k": 1,
        "top_p": 1,
        "prompt": "Give me a short introduction to large language model.",
        "temperature": 1,
        "system_prompt": "You are a helpful assistant.",
        "max_new_tokens": 512,
        "repetition_penalty": 1
    }
)

# The lucataco/qwen1.5-72b model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/lucataco/qwen1.5-72b/api#output-schema
    print(item, end="")

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run lucataco/qwen1.5-72b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "lucataco/qwen1.5-72b:f919d3c43a8758de744cf2908426dd744154120f0a22e457a3fa647acdfe33be",
    "input": {
      "top_k": 1,
      "top_p": 1,
      "prompt": "Give me a short introduction to large language model.",
      "temperature": 1,
      "system_prompt": "You are a helpful assistant.",
      "max_new_tokens": 512,
      "repetition_penalty": 1
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

A large language model is a type of artificial intelligence system trained on an immense amount of text data, designed to understand, generate, and manipulate human language. These models are typically deep neural networks with billions of parameters, which enable them to learn complex patterns and relationships within language. The goal is to create a model that can perform various natural language processing tasks with high accuracy, such as language translation, text summarization, question-answering, and even conversational dialogue. By continuously learning from vast amounts of text, large language models have become increasingly proficient in understanding and generating coherent, contextually appropriate responses, making them a cornerstone of modern AI research and applications.

{
  "completed_at": "2024-02-07T01:14:26.462164Z",
  "created_at": "2024-02-07T00:57:32.092743Z",
  "data_removed": false,
  "error": null,
  "id": "urgqsx3b7d2a7kf54w3zyiwna4",
  "input": {
    "top_k": 1,
    "top_p": 1,
    "prompt": "Give me a short introduction to large language model.",
    "temperature": 1,
    "system_prompt": "You are a helpful assistant.",
    "max_new_tokens": 512,
    "repetition_penalty": 1
  },
  "logs": "Using seed: 240117260\nThe attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.\nSetting `pad_token_id` to `eos_token_id`:151645 for open-end generation.",
  "metrics": {
    "predict_time": 213.606701,
    "total_time": 1014.369421
  },
  "output": [
    "",
    "A ",
    "large ",
    "language ",
    "model ",
    "is ",
    "a ",
    "type ",
    "of ",
    "artificial ",
    "intelligence ",
    "system ",
    "trained ",
    "on ",
    "an ",
    "immense ",
    "amount ",
    "of ",
    "text ",
    "",
    "data, ",
    "designed ",
    "to ",
    "",
    "understand, ",
    "",
    "generate, ",
    "and ",
    "manipulate ",
    "human ",
    "",
    "language. ",
    "These ",
    "models ",
    "are ",
    "typically ",
    "deep ",
    "neural ",
    "networks ",
    "with ",
    "billions ",
    "of ",
    "",
    "parameters, ",
    "which ",
    "enable ",
    "them ",
    "to ",
    "learn ",
    "complex ",
    "patterns ",
    "and ",
    "relationships ",
    "within ",
    "",
    "language. ",
    "The ",
    "goal ",
    "is ",
    "to ",
    "create ",
    "a ",
    "model ",
    "that ",
    "can ",
    "perform ",
    "various ",
    "natural ",
    "language ",
    "processing ",
    "tasks ",
    "with ",
    "high ",
    "",
    "accuracy, ",
    "such ",
    "as ",
    "language ",
    "",
    "translation, ",
    "text ",
    "",
    "",
    "summarization, ",
    "",
    "",
    "",
    "",
    "",
    "question-answering, ",
    "and ",
    "even ",
    "",
    "conversational ",
    "",
    "dialogue. ",
    "By ",
    "continuously ",
    "learning ",
    "from ",
    "vast ",
    "amounts ",
    "of ",
    "",
    "text, ",
    "large ",
    "language ",
    "models ",
    "have ",
    "become ",
    "increasingly ",
    "proficient ",
    "in ",
    "understanding ",
    "and ",
    "generating ",
    "",
    "coherent, ",
    "",
    "contextually ",
    "appropriate ",
    "",
    "responses, ",
    "making ",
    "them ",
    "a ",
    "cornerstone ",
    "of ",
    "modern ",
    "AI ",
    "research ",
    "and ",
    "",
    "",
    "applications."
  ],
  "started_at": "2024-02-07T01:10:52.855463Z",
  "status": "succeeded",
  "urls": {
    "stream": "https://streaming-api.svc.us.c.replicate.net/v1/streams/maq4lrfir54qgz4a5zhiy7iyohxmz3nt3d2yygi5xk26tr3omtyq",
    "get": "https://api.replicate.com/v1/predictions/urgqsx3b7d2a7kf54w3zyiwna4",
    "cancel": "https://api.replicate.com/v1/predictions/urgqsx3b7d2a7kf54w3zyiwna4/cancel"
  },
  "version": "f919d3c43a8758de744cf2908426dd744154120f0a22e457a3fa647acdfe33be"
}

Generated in

3 minutes 34 seconds

Tweak it Report