nateraw / mixtral-8x7b-32kseqlen

The Mixtral-8x7B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts.

Cold

Public
15.1K runs
4x A100 (80GB)
GitHub

Iterate in playground

Run with an API

Playground API Examples README Versions

Prediction

nateraw/mixtral-8x7b-32kseqlen:f8125aef9cd96d879f4e5c5c1ff78618818e62939ab76ab1e07425ac75d453bc

Model

nateraw/mixtral-8x7b-32kseqlen:f8125aef

7g7hs33buoiqp2rdoszwzy5yse

Status

Succeeded

Source

Web

Hardware

4x A100 (80GB)

Total duration

2m 59s

Created

over 1 year ago

Input

top_p: 0.9
prompt: Here are the top 10 useful Hindi phrases for your upcoming trip to India: 1.
temperature: 0.6
max_new_tokens: 512

{
  "top_p": 0.9,
  "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
  "temperature": 0.6,
  "max_new_tokens": 512
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "nateraw/mixtral-8x7b-32kseqlen:f8125aef9cd96d879f4e5c5c1ff78618818e62939ab76ab1e07425ac75d453bc",
  {
    input: {
      top_p: 0.9,
      prompt: "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
      temperature: 0.6,
      max_new_tokens: 512
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "nateraw/mixtral-8x7b-32kseqlen:f8125aef9cd96d879f4e5c5c1ff78618818e62939ab76ab1e07425ac75d453bc",
    input={
        "top_p": 0.9,
        "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
        "temperature": 0.6,
        "max_new_tokens": 512
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "nateraw/mixtral-8x7b-32kseqlen:f8125aef9cd96d879f4e5c5c1ff78618818e62939ab76ab1e07425ac75d453bc",
    "input": {
      "top_p": 0.9,
      "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\\n\\n1. ",
      "temperature": 0.6,
      "max_new_tokens": 512
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

नमस्ते (Namaste): This is the most common greeting in India and is used to say “hello” or “goodbye.” It is a respectful way to greet someone and can be used with anyone, regardless of age or gender. 2. धन्यवाद (Dhanyavaad): This is the Hindi word for “thank you” and is used to express gratitude. It is important to use this phrase when someone does something for you or when you receive a gift or favor. 3. क्या हाल है? (Kya Haal Hai?): This phrase means “how are you?” and is used to ask someone about their well-being. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender. 4. मैं बहुत अच्छा हूँ (Main Bahaaut Acha Hoon): This phrase means “I am very good” and is used as a response to the question “how are you?” It is a polite way to let someone know that you are doing well. 5. क्या आप हिंदी बोलते हैं? (Kya Aap Hindi Bolte Hain?): This phrase means “do you speak Hindi?” and is used to ask someone if they speak the language. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender. 6. क्या आप इंग्लिश बोलते हैं? (Kya Aap English Bolte Hain?): This phrase means “do you speak English?” and is used to ask someone if they speak the language. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender. 7. क्या आप कैसे पहुँचे? (Kya Aap Kaise Pahunche?): This phrase means “how did you get here?” and is used to ask someone how they arrived at a particular location. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender.

{
  "completed_at": "2023-12-09T04:21:23.099483Z",
  "created_at": "2023-12-09T04:18:24.555008Z",
  "data_removed": false,
  "error": null,
  "id": "7g7hs33buoiqp2rdoszwzy5yse",
  "input": {
    "top_p": 0.9,
    "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
    "temperature": 0.6,
    "max_new_tokens": 512
  },
  "logs": "generation took 38.182s",
  "metrics": {
    "predict_time": 38.18934,
    "total_time": 178.544475
  },
  "output": "नमस्ते (Namaste): This is the most common greeting in India and is used to say “hello” or “goodbye.” It is a respectful way to greet someone and can be used with anyone, regardless of age or gender.\n2. धन्यवाद (Dhanyavaad): This is the Hindi word for “thank you” and is used to express gratitude. It is important to use this phrase when someone does something for you or when you receive a gift or favor.\n3. क्या हाल है? (Kya Haal Hai?): This phrase means “how are you?” and is used to ask someone about their well-being. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender.\n4. मैं बहुत अच्छा हूँ (Main Bahaaut Acha Hoon): This phrase means “I am very good” and is used as a response to the question “how are you?” It is a polite way to let someone know that you are doing well.\n5. क्या आप हिंदी बोलते हैं? (Kya Aap Hindi Bolte Hain?): This phrase means “do you speak Hindi?” and is used to ask someone if they speak the language. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender.\n6. क्या आप इंग्लिश बोलते हैं? (Kya Aap English Bolte Hain?): This phrase means “do you speak English?” and is used to ask someone if they speak the language. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender.\n7. क्या आप कैसे पहुँचे? (Kya Aap Kaise Pahunche?): This phrase means “how did you get here?” and is used to ask someone how they arrived at a particular location. It is a polite way to start a conversation and can be used with anyone, regardless of age or gender.\n",
  "started_at": "2023-12-09T04:20:44.910143Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/7g7hs33buoiqp2rdoszwzy5yse",
    "cancel": "https://api.replicate.com/v1/predictions/7g7hs33buoiqp2rdoszwzy5yse/cancel"
  },
  "version": "f8125aef9cd96d879f4e5c5c1ff78618818e62939ab76ab1e07425ac75d453bc"
}

Generated in

38.2 seconds

Tweak it Share Report

Prediction

nateraw/mixtral-8x7b-32kseqlen:db11a6311e4ce1fc6b3904d944f6052b17dcd1236ea976690e4943c4e807cd9b

Model

nateraw/mixtral-8x7b-32kseqlen:db11a631

dr2fladb5ujzbzp5mdvrx6q5gi

Status

Succeeded

Source

Web

Hardware

4x A100 (80GB)

Total duration

1m 32s

Created

over 1 year ago

Input

top_p: 0.9
prompt: Here are the top 10 useful Hindi phrases for your upcoming trip to India: 1.
temperature: 0.6
max_new_tokens: 512

{
  "top_p": 0.9,
  "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
  "temperature": 0.6,
  "max_new_tokens": 512
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "nateraw/mixtral-8x7b-32kseqlen:db11a6311e4ce1fc6b3904d944f6052b17dcd1236ea976690e4943c4e807cd9b",
  {
    input: {
      top_p: 0.9,
      prompt: "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
      temperature: 0.6,
      max_new_tokens: 512
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "nateraw/mixtral-8x7b-32kseqlen:db11a6311e4ce1fc6b3904d944f6052b17dcd1236ea976690e4943c4e807cd9b",
    input={
        "top_p": 0.9,
        "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
        "temperature": 0.6,
        "max_new_tokens": 512
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "nateraw/mixtral-8x7b-32kseqlen:db11a6311e4ce1fc6b3904d944f6052b17dcd1236ea976690e4943c4e807cd9b",
    "input": {
      "top_p": 0.9,
      "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\\n\\n1. ",
      "temperature": 0.6,
      "max_new_tokens": 512
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

नमस्ते (Namaste): This is a traditional greeting in India, and it means “hello” or “I bow to you.” 2. क्या हाल है? (Kya haal hai?): This phrase means “how are you?” or “how are things?” 3. मुझे पता नहीं (Mujhe pata nahi): This phrase means “I don’t know.” 4. क्या आप इसे समझ पाते हैं? (Kya aap ise samajh paate hain?): This phrase means “do you understand?” 5. क्या आप इसे बता सकते हैं? (Kya aap ise bata sakate hain?): This phrase means “can you tell me?” 6. मुझे यहाँ से बाहर जाना है (Mujhe yahaan se bahar jana hai): This phrase means “I want to go outside.” 7. मुझे पीना है (Mujhe peena hai): This phrase means “I want to drink.” 8. मुझे खाना खाना है (Mujhe khana khana hai): This phrase means “I want to eat.” 9. मुझे सोना है (Mujhe sona hai): This phrase means “I want to sleep.” 10. मुझे प्यार है (Mujhe pyaar hai): This phrase means “I love you.” These phrases will help you communicate with locals and navigate your way around India. It’s important to remember that Hindi is just one of the many languages spoken in India, so you may also encounter other languages such as Bengali, Tamil, and Punjabi. However, Hindi is widely spoken and understood, so it’s a good language to start with.

{
  "completed_at": "2023-12-12T06:04:32.292800Z",
  "created_at": "2023-12-12T06:03:00.652492Z",
  "data_removed": false,
  "error": null,
  "id": "dr2fladb5ujzbzp5mdvrx6q5gi",
  "input": {
    "top_p": 0.9,
    "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
    "temperature": 0.6,
    "max_new_tokens": 512
  },
  "logs": "generation took 37.723s",
  "metrics": {
    "predict_time": 37.729377,
    "total_time": 91.640308
  },
  "output": "नमस्ते (Namaste): This is a traditional greeting in India, and it means “hello” or “I bow to you.”\n2. क्या हाल है? (Kya haal hai?): This phrase means “how are you?” or “how are things?”\n3. मुझे पता नहीं (Mujhe pata nahi): This phrase means “I don’t know.”\n4. क्या आप इसे समझ पाते हैं? (Kya aap ise samajh paate hain?): This phrase means “do you understand?”\n5. क्या आप इसे बता सकते हैं? (Kya aap ise bata sakate hain?): This phrase means “can you tell me?”\n6. मुझे यहाँ से बाहर जाना है (Mujhe yahaan se bahar jana hai): This phrase means “I want to go outside.”\n7. मुझे पीना है (Mujhe peena hai): This phrase means “I want to drink.”\n8. मुझे खाना खाना है (Mujhe khana khana hai): This phrase means “I want to eat.”\n9. मुझे सोना है (Mujhe sona hai): This phrase means “I want to sleep.”\n10. मुझे प्यार है (Mujhe pyaar hai): This phrase means “I love you.”\n\nThese phrases will help you communicate with locals and navigate your way around India. It’s important to remember that Hindi is just one of the many languages spoken in India, so you may also encounter other languages such as Bengali, Tamil, and Punjabi. However, Hindi is widely spoken and understood, so it’s a good language to start with.",
  "started_at": "2023-12-12T06:03:54.563423Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/dr2fladb5ujzbzp5mdvrx6q5gi",
    "cancel": "https://api.replicate.com/v1/predictions/dr2fladb5ujzbzp5mdvrx6q5gi/cancel"
  },
  "version": "db11a6311e4ce1fc6b3904d944f6052b17dcd1236ea976690e4943c4e807cd9b"
}

Generated in

37.7 seconds

Tweak it Share Report

Prediction

nateraw/mixtral-8x7b-32kseqlen:8af4159e0cf7ffa46cf62249be1ad6b93302c5f3f9ba507ddbd3c4987ecca133

Model

nateraw/mixtral-8x7b-32kseqlen:8af4159e

fae6fjdbf6rxnjxmgnxgyzpdsm

Status

Succeeded

Source

Web

Hardware

4x A100 (80GB)

Total duration

36.4s

Created

over 1 year ago

Input

top_p: 0.9
prompt: Here are the top 10 useful Hindi phrases for your upcoming trip to India: 1.
temperature: 0.6
max_new_tokens: 512

{
  "top_p": 0.9,
  "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
  "temperature": 0.6,
  "max_new_tokens": 512
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "nateraw/mixtral-8x7b-32kseqlen:8af4159e0cf7ffa46cf62249be1ad6b93302c5f3f9ba507ddbd3c4987ecca133",
  {
    input: {
      top_p: 0.9,
      prompt: "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
      temperature: 0.6,
      max_new_tokens: 512
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "nateraw/mixtral-8x7b-32kseqlen:8af4159e0cf7ffa46cf62249be1ad6b93302c5f3f9ba507ddbd3c4987ecca133",
    input={
        "top_p": 0.9,
        "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
        "temperature": 0.6,
        "max_new_tokens": 512
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run nateraw/mixtral-8x7b-32kseqlen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "nateraw/mixtral-8x7b-32kseqlen:8af4159e0cf7ffa46cf62249be1ad6b93302c5f3f9ba507ddbd3c4987ecca133",
    "input": {
      "top_p": 0.9,
      "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\\n\\n1. ",
      "temperature": 0.6,
      "max_new_tokens": 512
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

नमस्ते (Namaste): This is the most common greeting in India. It means “hello” or “goodbye” and is used to greet people and say goodbye. 2. क्या हाल है? (Kya haal hai?): This phrase means “how are you?” and is used to ask about someone’s well-being. 3. मैं आपको सुनना चाहता हूँ (Mai aapko sunana chahta hoon): This phrase means “I want to listen to you” and is used to show interest in what someone is saying. 4. क्या आप कह रहे हैं? (Kya aap kah rahe hain?): This phrase means “what are you saying?” and is used to clarify what someone is saying. 5. मैं यहाँ हूँ (Mai yahan hoon): This phrase means “I am here” and is used to indicate one’s presence. 6. मुझे यहाँ से जाना है (Mujhe yahan se jana hai): This phrase means “I need to leave from here” and is used to indicate one’s intention to leave. 7. मैं यहाँ रहना चाहता हूँ (Mai yahan rahna chahta hoon): This phrase means “I want to stay here” and is used to indicate one’s desire to stay in a particular place. 8. मैं यहाँ क्या कर सकता हूँ? (Mai yahan kya kar sakta hoon?): This phrase means “what can I do here?” and is used to ask for advice or suggestions about what to do in a particular place. 9. क्या आप इस काम

{
  "completed_at": "2023-12-09T00:02:37.048287Z",
  "created_at": "2023-12-09T00:02:00.637458Z",
  "data_removed": false,
  "error": null,
  "id": "fae6fjdbf6rxnjxmgnxgyzpdsm",
  "input": {
    "top_p": 0.9,
    "prompt": "Here are the top 10 useful Hindi phrases for your upcoming trip to India:\n\n1. ",
    "temperature": 0.6,
    "max_new_tokens": 512
  },
  "logs": "generation took 36.397s",
  "metrics": {
    "predict_time": 36.402658,
    "total_time": 36.410829
  },
  "output": "नमस्ते (Namaste): This is the most common greeting in India. It means “hello” or “goodbye” and is used to greet people and say goodbye.\n2. क्या हाल है? (Kya haal hai?): This phrase means “how are you?” and is used to ask about someone’s well-being.\n3. मैं आपको सुनना चाहता हूँ (Mai aapko sunana chahta hoon): This phrase means “I want to listen to you” and is used to show interest in what someone is saying.\n4. क्या आप कह रहे हैं? (Kya aap kah rahe hain?): This phrase means “what are you saying?” and is used to clarify what someone is saying.\n5. मैं यहाँ हूँ (Mai yahan hoon): This phrase means “I am here” and is used to indicate one’s presence.\n6. मुझे यहाँ से जाना है (Mujhe yahan se jana hai): This phrase means “I need to leave from here” and is used to indicate one’s intention to leave.\n7. मैं यहाँ रहना चाहता हूँ (Mai yahan rahna chahta hoon): This phrase means “I want to stay here” and is used to indicate one’s desire to stay in a particular place.\n8. मैं यहाँ क्या कर सकता हूँ? (Mai yahan kya kar sakta hoon?): This phrase means “what can I do here?” and is used to ask for advice or suggestions about what to do in a particular place.\n9. क्या आप इस काम ",
  "started_at": "2023-12-09T00:02:00.645629Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/fae6fjdbf6rxnjxmgnxgyzpdsm",
    "cancel": "https://api.replicate.com/v1/predictions/fae6fjdbf6rxnjxmgnxgyzpdsm/cancel"
  },
  "version": "8af4159e0cf7ffa46cf62249be1ad6b93302c5f3f9ba507ddbd3c4987ecca133"
}

Generated in

36.4 seconds

Tweak it Share Report