meta /llama-2-13b-chat:6b4da803
Input
Run this model in Node.js with one line of code:
npx create-replicate --model=meta/llama-2-13b-chat
or set up a project from scratch
Install Replicate’s Node.js client library:
npm install replicateSet the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import and set up the client:
import Replicate from "replicate";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});Run meta/llama-2-13b-chat using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"meta/llama-2-13b-chat:6b4da803a2382c08868c5af10a523892f38e2de1aafb2ee55b020d9efef2fdb8",
{
input: {
debug: false,
top_p: 1,
prompt: "please provide 10 fun names for a pet pelican. Please come up with unique emojis to go along with each name. Try not to repeat the same emojis. Make them fun, colorful, and loving names",
temperature: 0.75,
system_prompt: "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\n\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
max_new_tokens: 500,
repetition_penalty: 1
}
}
);
console.log(output);To learn more, take a look at the guide on getting started with Node.js.
Install Replicate’s Python client library:
pip install replicateSet the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Import the client:
import replicateRun meta/llama-2-13b-chat using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"meta/llama-2-13b-chat:6b4da803a2382c08868c5af10a523892f38e2de1aafb2ee55b020d9efef2fdb8",
input={
"debug": False,
"top_p": 1,
"prompt": "please provide 10 fun names for a pet pelican. Please come up with unique emojis to go along with each name. Try not to repeat the same emojis. Make them fun, colorful, and loving names",
"temperature": 0.75,
"system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\n\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
"max_new_tokens": 500,
"repetition_penalty": 1
}
)
# The meta/llama-2-13b-chat model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
# https://replicate.com/meta/llama-2-13b-chat/api#output-schema
print(item, end="")To learn more, take a look at the guide on getting started with Python.
Set the
REPLICATE_API_TOKEN environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>Find your API token in your account settings.
Run meta/llama-2-13b-chat using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "6b4da803a2382c08868c5af10a523892f38e2de1aafb2ee55b020d9efef2fdb8",
"input": {
"debug": false,
"top_p": 1,
"prompt": "please provide 10 fun names for a pet pelican. Please come up with unique emojis to go along with each name. Try not to repeat the same emojis. Make them fun, colorful, and loving names",
"temperature": 0.75,
"system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\\n\\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don\'t know the answer to a question, please don\'t share false information.",
"max_new_tokens": 500,
"repetition_penalty": 1
}
}' \
https://api.replicate.com/v1/predictionsTo learn more, take a look at Replicate’s HTTP API reference docs.
Output
Of course! I'd be happy to help you come up with some fun and unique names for your pet pelican. Here are ten suggestions, each accompanied by a fun and colorful emoji:
1. Peanut 🥜 - A playful and affectionate name for a small and adorable pelican.
2. Puddles 🐦 - A cute and quirky name for a pelican that loves to splash and play in the water.
3. Pelty 🐧 - A fun and bubbly name for a pelican with a lively personality.
4. Sunny ☀️ - A bright and cheerful name for a pelican with a sunny disposition.
5. Splishy 🐳 - A playful and whimsical name for a pelican that loves to splash and play in the water.
6. Luna 🌙 - A celestial and dreamy name for a pelican with a calm and peaceful demeanor.
7. Nibbles 🐣 - A cute and endearing name for a pelican that loves to nibble on tasty treats.
8. Scout 🐦 - A fun and adventurous name for a pelican that loves to explore and discover new things.
9. Fina 🐟 - A playful and lively name for a pelican with a bubbly and energetic personality.
10. Tango 🕺 - A fun and sassy name for a pelican with a lively and passionate spirit.
I hope these suggestions help inspire you to find the perfect name for your pet pelican!
{
"completed_at": "2023-07-22T00:50:04.006967Z",
"created_at": "2023-07-22T00:49:45.070613Z",
"data_removed": false,
"error": null,
"id": "qv66ayjbkyj5ynuft6odokrlta",
"input": {
"top_p": 1,
"prompt": "please provide 10 fun names for a pet pelican. Please come up with unique emojis to go along with each name. Try not to repeat the same emojis. Make them fun, colorful, and loving names",
"temperature": 0.75,
"system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\n\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
"max_new_tokens": 500,
"repetition_penalty": 1
},
"logs": "Formatted input prompt:\n[INST] <<SYS>>\nYou are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.\n<</SYS>>\nplease provide 10 fun names for a pet pelican. Please come up with unique emojis to go along with each name. Try not to repeat the same emojis. Make them fun, colorful, and loving names [/INST]",
"metrics": {
"predict_time": 18.962994,
"total_time": 18.936354
},
"output": [
" Of",
" course!",
" I'd",
" be",
" happy",
" to",
" help",
" you",
" come",
" up",
" with",
" some",
" fun",
" and",
" unique",
" names",
" for",
" your",
" pet",
" pelican.",
" Here",
" are",
" ten",
" suggestions,",
" each",
" accompanied",
" by",
" a",
" fun",
" and",
" colorful",
" emoji:\n1.",
" Peanut",
" 🥜",
" -",
" A",
" playful",
" and",
" affectionate",
" name",
" for",
" a",
" small",
" and",
" adorable",
" pelican.\n2.",
" Puddles",
" 🐦",
" -",
" A",
" cute",
" and",
" quirky",
" name",
" for",
" a",
" pelican",
" that",
" loves",
" to",
" splash",
" and",
" play",
" in",
" the",
" water.\n3.",
" Pelty",
" 🐧",
" -",
" A",
" fun",
" and",
" bubbly",
" name",
" for",
" a",
" pelican",
" with",
" a",
" lively",
" personality.\n4.",
" Sunny",
" ☀️",
" -",
" A",
" bright",
" and",
" cheerful",
" name",
" for",
" a",
" pelican",
" with",
" a",
" sunny",
" disposition.\n5.",
" Splishy",
" 🐳",
" -",
" A",
" playful",
" and",
" whimsical",
" name",
" for",
" a",
" pelican",
" that",
" loves",
" to",
" splash",
" and",
" play",
" in",
" the",
" water.\n6.",
" Luna",
" 🌙",
" -",
" A",
" celestial",
" and",
" dreamy",
" name",
" for",
" a",
" pelican",
" with",
" a",
" calm",
" and",
" peaceful",
" demeanor.\n7.",
" Nibbles",
" 🐣",
" -",
" A",
" cute",
" and",
" endearing",
" name",
" for",
" a",
" pelican",
" that",
" loves",
" to",
" nibble",
" on",
" tasty",
" treats.\n8.",
" Scout",
" 🐦",
" -",
" A",
" fun",
" and",
" adventurous",
" name",
" for",
" a",
" pelican",
" that",
" loves",
" to",
" explore",
" and",
" discover",
" new",
" things.\n9.",
" Fina",
" 🐟",
" -",
" A",
" playful",
" and",
" lively",
" name",
" for",
" a",
" pelican",
" with",
" a",
" bubbly",
" and",
" energetic",
" personality.\n10.",
" Tango",
" 🕺",
" -",
" A",
" fun",
" and",
" sassy",
" name",
" for",
" a",
" pelican",
" with",
" a",
" lively",
" and",
" passionate",
" spirit.\nI",
" hope",
" these",
" suggestions",
" help",
" inspire",
" you",
" to",
" find",
" the",
" perfect",
" name",
" for",
" your",
" pet",
" pelican!"
],
"started_at": "2023-07-22T00:49:45.043973Z",
"status": "succeeded",
"urls": {
"get": "https://api.replicate.com/v1/predictions/qv66ayjbkyj5ynuft6odokrlta",
"cancel": "https://api.replicate.com/v1/predictions/qv66ayjbkyj5ynuft6odokrlta/cancel"
},
"version": "6b4da803a2382c08868c5af10a523892f38e2de1aafb2ee55b020d9efef2fdb8"
}Generated in
Formatted input prompt:
[INST] <<SYS>>
You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.
If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
<</SYS>>
please provide 10 fun names for a pet pelican. Please come up with unique emojis to go along with each name. Try not to repeat the same emojis. Make them fun, colorful, and loving names [/INST]