tomasmcm / metamath-cybertron-starling

Source: Q-bert/MetaMath-Cybertron-Starling ✦ Quant: TheBloke/MetaMath-Cybertron-Starling-AWQ ✦ Merge Q-bert/MetaMath-Cybertron and berkeley-nest/Starling-LM-7B-alpha using slerp merge (Updated 1 year, 6 months ago)

Cold

Public
184 runs
L40S
Paper
License

Iterate in playground

Run with an API

Playground API Examples README Versions

Prediction

tomasmcm/metamath-cybertron-starling:194cbf3864ad03f8df95aa682719a4ec2cd3540f7a6f59142d954d50d3a30b3f

Model

tomasmcm/metamath-cybertron-starling:194cbf38

j4eivmtbq62qskkbjwxumn4iza

Status

Succeeded

Source

Web

Hardware

A40

Total duration

1m 35s

Created

over 1 year ago

Input

top_k: -1
top_p: 0.95
prompt: <|im_start|>system - You are a helpful assistant chatbot. - You answer questions. - You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user. - You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|> <|im_start|>user Explain metabolism<|im_end|> <|im_start|>assistant
max_tokens: 128
temperature: 0.8
presence_penalty: 0
frequency_penalty: 0

{
  "top_k": -1,
  "top_p": 0.95,
  "prompt": "<|im_start|>system\n- You are a helpful assistant chatbot.\n- You answer questions.\n- You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.\n- You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|>\n<|im_start|>user\nExplain metabolism<|im_end|>\n<|im_start|>assistant",
  "max_tokens": 128,
  "temperature": 0.8,
  "presence_penalty": 0,
  "frequency_penalty": 0
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run tomasmcm/metamath-cybertron-starling using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "tomasmcm/metamath-cybertron-starling:194cbf3864ad03f8df95aa682719a4ec2cd3540f7a6f59142d954d50d3a30b3f",
  {
    input: {
      top_k: -1,
      top_p: 0.95,
      prompt: "<|im_start|>system\n- You are a helpful assistant chatbot.\n- You answer questions.\n- You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.\n- You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|>\n<|im_start|>user\nExplain metabolism<|im_end|>\n<|im_start|>assistant",
      max_tokens: 128,
      temperature: 0.8,
      presence_penalty: 0,
      frequency_penalty: 0
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run tomasmcm/metamath-cybertron-starling using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "tomasmcm/metamath-cybertron-starling:194cbf3864ad03f8df95aa682719a4ec2cd3540f7a6f59142d954d50d3a30b3f",
    input={
        "top_k": -1,
        "top_p": 0.95,
        "prompt": "<|im_start|>system\n- You are a helpful assistant chatbot.\n- You answer questions.\n- You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.\n- You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|>\n<|im_start|>user\nExplain metabolism<|im_end|>\n<|im_start|>assistant",
        "max_tokens": 128,
        "temperature": 0.8,
        "presence_penalty": 0,
        "frequency_penalty": 0
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run tomasmcm/metamath-cybertron-starling using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "tomasmcm/metamath-cybertron-starling:194cbf3864ad03f8df95aa682719a4ec2cd3540f7a6f59142d954d50d3a30b3f",
    "input": {
      "top_k": -1,
      "top_p": 0.95,
      "prompt": "<|im_start|>system\\n- You are a helpful assistant chatbot.\\n- You answer questions.\\n- You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.\\n- You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|>\\n<|im_start|>user\\nExplain metabolism<|im_end|>\\n<|im_start|>assistant",
      "max_tokens": 128,
      "temperature": 0.8,
      "presence_penalty": 0,
      "frequency_penalty": 0
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Metabolism is the set of chemical reactions that happen within a living organism in order to maintain life. These reactions occur at the cellular level and are responsible for the conversion of food into energy, as well as the growth, reproduction, and other essential processes. There are two main types of metabolism: 1. Anabolism: This is the process of building complex molecules from simpler ones using the energy provided by food. It is also known as "synthesis" or "biosynthesis." Anabolism is the process by which cells grow and repair themselves.

{
  "completed_at": "2023-12-10T18:50:10.185575Z",
  "created_at": "2023-12-10T18:48:34.756892Z",
  "data_removed": false,
  "error": null,
  "id": "j4eivmtbq62qskkbjwxumn4iza",
  "input": {
    "top_k": -1,
    "top_p": 0.95,
    "prompt": "<|im_start|>system\n- You are a helpful assistant chatbot.\n- You answer questions.\n- You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.\n- You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|>\n<|im_start|>user\nExplain metabolism<|im_end|>\n<|im_start|>assistant",
    "max_tokens": 128,
    "temperature": 0.8,
    "presence_penalty": 0,
    "frequency_penalty": 0
  },
  "logs": "Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]\nProcessed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it]\nProcessed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it]\nGenerated 128 tokens in 2.3741703033447266 seconds.",
  "metrics": {
    "predict_time": 2.459764,
    "total_time": 95.428683
  },
  "output": "\nMetabolism is the set of chemical reactions that happen within a living organism in order to maintain life. These reactions occur at the cellular level and are responsible for the conversion of food into energy, as well as the growth, reproduction, and other essential processes.\n\nThere are two main types of metabolism:\n\n1. Anabolism: This is the process of building complex molecules from simpler ones using the energy provided by food. It is also known as \"synthesis\" or \"biosynthesis.\" Anabolism is the process by which cells grow and repair themselves.\n",
  "started_at": "2023-12-10T18:50:07.725811Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/j4eivmtbq62qskkbjwxumn4iza",
    "cancel": "https://api.replicate.com/v1/predictions/j4eivmtbq62qskkbjwxumn4iza/cancel"
  },
  "version": "194cbf3864ad03f8df95aa682719a4ec2cd3540f7a6f59142d954d50d3a30b3f"
}

Generated in

2.5 seconds

Tweak it Share Report

Want to make some of these yourself?

Run this model