ctrl+k

dsingal0/mixtral-single-gpu

Runs Mixtral 8x7B on a single A40 GPU

Public
88 runs
Run with an API
Pricing
Playground API Examples README Versions

Input

*string
Shift + Return to add a new line
integer

The maximum number of tokens the model should generate as output.

Default: 512

number

The value used to modulate the next token probabilities.

Default: 0.6

number

A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).

Default: 0.9

integer

The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).

Default: 50

Sign in to run this model:

Sign in with GitHub

By signing in, you agree to our
terms of service and privacy policy

Output

Once upon a time, in a small village, there lived a lonely shepherer boy named Samuel. He was known to be mischievous and often played pranks on the villagers. One day, Samuel thought of a new prank to play on the villagers. He cried out, "Wolf! Wolf! The sheeps are being attacked by a wolf!" The villagers were startled and rushed to help Samuel, but when they arrived, they found that there was no wolf and Samuel was laughing at their reactions. The villagers were not happy with Samuel's prank, but they decided to let it go this time. However, Samuel thought that the villagers' reactions were very funny, and he decided to play the same prank again the next day. Once again, Samuel cried out, "Wolf! Wolf! The sheeps are being attacked by a wolf!" The villagers were once again startled and rushed to help, only to find that Samuel was once again laughing at their reactions. The villagers were getting frustrated with Samuel's constant pranks, but they didn't want to encourage him by scolding him too much. They warned him that if he kept playing pranks, they would not believe him in case of a real emergency. Days passed, and Samuel continued to play his pranks, crying "Wolf!" whenever he felt like it. But the villagers were now cautious and did not believe him. One day, while Samuel was tending to his sheep, a real wolf appeared and attacked the herd. Samuel cried out in terror, "Wolf! Wolf! A real wolf is attacking my sheeps!" The villagers heard Samuel's cries, but they did not believe him, assuming it was just another one of his pranks. They did not come to help, and the wolf was able to attack and kill many of Samuel's sheep before it finally left. Samuel was left alone with his few remaining sheep, feeling foolish and ashamed. He had learned a valuable lesson about the consequences of lying and playing pranks. The villagers eventually forgave him, but they never forgot the time when the boy who cried wolf lost his herd because no one believed him. So the story of the boy who cried wolf serves as a reminder to always tell the truth, even if it's not what people want to hear, because lying and playing
Generated in
Tweak itIterate in playgroundReportView full prediction

Run time and cost

This model runs on Nvidia L40S GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

This model doesn't have a readme.