lucataco / upstage-llama-2-70b-instruct-v2

Upstage/Llama-2-70B-instruct-v2 - GPTQ

Cold

Public
3.3K runs
A100 (80GB)
GitHub

Run with an API

Playground API Examples README Versions

Prediction

lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b

Model

lucataco/upstage-llama-2-70b-instruct-v2:4a954f75

gynqsvlbi4qfhfweoscofvy4ha

Status

Succeeded

Source

Web

Hardware

A100 (80GB)

Total duration

13m 5s

Created

almost 2 years ago

Input

top_p: 0.95
prompt: Tell me about AI
temperature: 0.75
system_prompt: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
max_new_tokens: 512
repetition_penalty: 1.1

{
  "top_p": 0.95,
  "prompt": "Tell me about AI",
  "temperature": 0.75,
  "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
  "max_new_tokens": 512,
  "repetition_penalty": 1.1
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run lucataco/upstage-llama-2-70b-instruct-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b",
  {
    input: {
      top_p: 0.95,
      prompt: "Tell me about AI",
      temperature: 0.75,
      system_prompt: "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
      max_new_tokens: 512,
      repetition_penalty: 1.1
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run lucataco/upstage-llama-2-70b-instruct-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b",
    input={
        "top_p": 0.95,
        "prompt": "Tell me about AI",
        "temperature": 0.75,
        "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
        "max_new_tokens": 512,
        "repetition_penalty": 1.1
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run lucataco/upstage-llama-2-70b-instruct-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b",
    "input": {
      "top_p": 0.95,
      "prompt": "Tell me about AI",
      "temperature": 0.75,
      "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don\'t know the answer to a question, please don\'t share false information.",
      "max_new_tokens": 512,
      "repetition_penalty": 1.1
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

AI stands for Artificial Intelligence, which refers to the development of computer systems that can perform tasks that would normally require human intelligence, such as learning, problem-solving, decision making, and language understanding. AI technology has been rapidly advancing in recent years, with applications ranging from virtual assistants like Siri and Alexa, to self-driving cars, medical diagnosis, and even creating art and music. There are various approaches to developing AI, including machine learning, deep learning, and neural networks, all aimed at enabling machines to learn from data and improve their performance over time. While AI holds great potential for improving our lives and solving complex problems, it also raises important ethical questions about its impact on society and the future of work.</s>

{
  "completed_at": "2023-08-11T20:59:49.215285Z",
  "created_at": "2023-08-11T20:46:43.727328Z",
  "data_removed": false,
  "error": null,
  "id": "gynqsvlbi4qfhfweoscofvy4ha",
  "input": {
    "top_p": 0.95,
    "prompt": "Tell me about AI",
    "temperature": 0.75,
    "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
    "max_new_tokens": 512,
    "repetition_penalty": 1.1
  },
  "logs": null,
  "metrics": {
    "predict_time": 90.350318,
    "total_time": 785.487957
  },
  "output": "\nAI stands for Artificial Intelligence, which refers to the development of computer systems that can perform tasks that would normally require human intelligence, such as learning, problem-solving, decision making, and language understanding. AI technology has been rapidly advancing in recent years, with applications ranging from virtual assistants like Siri and Alexa, to self-driving cars, medical diagnosis, and even creating art and music. There are various approaches to developing AI, including machine learning, deep learning, and neural networks, all aimed at enabling machines to learn from data and improve their performance over time. While AI holds great potential for improving our lives and solving complex problems, it also raises important ethical questions about its impact on society and the future of work.</s>",
  "started_at": "2023-08-11T20:58:18.864967Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/gynqsvlbi4qfhfweoscofvy4ha",
    "cancel": "https://api.replicate.com/v1/predictions/gynqsvlbi4qfhfweoscofvy4ha/cancel"
  },
  "version": "4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b"
}

Generated in

1 minute 30 seconds

Tweak it Share Report

Prediction

lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b

Model

lucataco/upstage-llama-2-70b-instruct-v2:4a954f75

mtgm3qdbrocmzyndxoreel5l24

Status

Succeeded

Source

Web

Hardware

A100 (80GB)

Total duration

1m 48s

Created

almost 2 years ago

Input

top_p: 0.95
prompt: Thomas is healthy, but he has to go to the hospital. What could be the reasons?
temperature: 0.75
system_prompt: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
max_new_tokens: 512
repetition_penalty: 1.1

{
  "top_p": 0.95,
  "prompt": "Thomas is healthy, but he has to go to the hospital. What could be the reasons?",
  "temperature": 0.75,
  "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
  "max_new_tokens": 512,
  "repetition_penalty": 1.1
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run lucataco/upstage-llama-2-70b-instruct-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b",
  {
    input: {
      top_p: 0.95,
      prompt: "Thomas is healthy, but he has to go to the hospital. What could be the reasons?",
      temperature: 0.75,
      system_prompt: "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
      max_new_tokens: 512,
      repetition_penalty: 1.1
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run lucataco/upstage-llama-2-70b-instruct-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b",
    input={
        "top_p": 0.95,
        "prompt": "Thomas is healthy, but he has to go to the hospital. What could be the reasons?",
        "temperature": 0.75,
        "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
        "max_new_tokens": 512,
        "repetition_penalty": 1.1
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run lucataco/upstage-llama-2-70b-instruct-v2 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "lucataco/upstage-llama-2-70b-instruct-v2:4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b",
    "input": {
      "top_p": 0.95,
      "prompt": "Thomas is healthy, but he has to go to the hospital. What could be the reasons?",
      "temperature": 0.75,
      "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don\'t know the answer to a question, please don\'t share false information.",
      "max_new_tokens": 512,
      "repetition_penalty": 1.1
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

There could be several reasons why Thomas might need to go to the hospital even though he is healthy. Some possibilities include: 1. Routine check-up: Thomas may have an appointment with his doctor for a routine physical examination or preventive care. 2. Medical tests: He might need to undergo some medical tests or procedures that require him to visit the hospital. 3. Donating blood or organs: Thomas could be going to the hospital to donate blood or organs to someone in need. 4. Visiting a friend or family member: It's also possible that Thomas is accompanying a loved one who needs medical attention at the hospital. 5. Volunteering: Thomas might be volunteering at the hospital, helping out with various tasks or providing support to patients and their families. 6. Work: If Thomas works in the medical field, he might be required to go to the hospital for work-related reasons. 7. Emergency situation: Although Thomas himself is healthy, there could be an emergency situation where he needs to rush someone else to the hospital. These are just a few potential scenarios; there could be other reasons as well.</s>

{
  "completed_at": "2023-08-11T21:01:41.520083Z",
  "created_at": "2023-08-11T20:59:53.893896Z",
  "data_removed": false,
  "error": null,
  "id": "mtgm3qdbrocmzyndxoreel5l24",
  "input": {
    "top_p": 0.95,
    "prompt": "Thomas is healthy, but he has to go to the hospital. What could be the reasons?",
    "temperature": 0.75,
    "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
    "max_new_tokens": 512,
    "repetition_penalty": 1.1
  },
  "logs": null,
  "metrics": {
    "predict_time": 107.68172,
    "total_time": 107.626187
  },
  "output": "\nThere could be several reasons why Thomas might need to go to the hospital even though he is healthy. Some possibilities include:\n\n1. Routine check-up: Thomas may have an appointment with his doctor for a routine physical examination or preventive care.\n\n2. Medical tests: He might need to undergo some medical tests or procedures that require him to visit the hospital.\n\n3. Donating blood or organs: Thomas could be going to the hospital to donate blood or organs to someone in need.\n\n4. Visiting a friend or family member: It's also possible that Thomas is accompanying a loved one who needs medical attention at the hospital.\n\n5. Volunteering: Thomas might be volunteering at the hospital, helping out with various tasks or providing support to patients and their families.\n\n6. Work: If Thomas works in the medical field, he might be required to go to the hospital for work-related reasons.\n\n7. Emergency situation: Although Thomas himself is healthy, there could be an emergency situation where he needs to rush someone else to the hospital.\n\nThese are just a few potential scenarios; there could be other reasons as well.</s>",
  "started_at": "2023-08-11T20:59:53.838363Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/mtgm3qdbrocmzyndxoreel5l24",
    "cancel": "https://api.replicate.com/v1/predictions/mtgm3qdbrocmzyndxoreel5l24/cancel"
  },
  "version": "4a954f75869cae9f2b39a6b28fb978764a93b3f50b8672fb7184f4e5600ddd8b"
}

Generated in

1 minute 48 seconds

Tweak it Share Report