nateraw/gairmath-abel-7b – Run with an API on Replicate

nateraw / gairmath-abel-7b

Cold

Public
32 runs
L40S

Run with an API

Playground API Examples README Versions

Input

message

*string

Shift + Return to add a new line

Question:
Farmer Brown has 60 animals on his farm, all either chickens or cows. He has twice as many chickens as cows. How many legs do the animals have, all together?
Answer:
Let's think step by step.
Question:
Farmer Brown has 60 animals on his farm, all either chickens or cows. He has twice as many chickens as cows. How many legs do the animals have, all together?
Answer:
Let's think step by step.

max_new_tokens

integer

The maximum number of tokens the model should generate as output.

Default: 256

temperature

number

The value used to modulate the next token probabilities.

Default: 1

top_p

number

A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).

Default: 1

top_k

integer

The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).

Default: 50

Run this model in Node.js with one line of code:

npx create-replicate --model=nateraw/gairmath-abel-7b

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run nateraw/gairmath-abel-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "nateraw/gairmath-abel-7b:08026755ceaebf00fbade61fc1ad31a063e67bcb4387925c7c82cb0d8206e2b3",
  {
    input: {
      top_k: 50,
      top_p: 0.95,
      message: "Question:\nFarmer Brown has 60 animals on his farm, all either chickens or cows. He has twice as many chickens as cows. How many legs do the animals have, all together?\nAnswer:\nLet's think step by step.\n",
      temperature: 0.8,
      max_new_tokens: 1024
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run nateraw/gairmath-abel-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "nateraw/gairmath-abel-7b:08026755ceaebf00fbade61fc1ad31a063e67bcb4387925c7c82cb0d8206e2b3",
    input={
        "top_k": 50,
        "top_p": 0.95,
        "message": "Question:\nFarmer Brown has 60 animals on his farm, all either chickens or cows. He has twice as many chickens as cows. How many legs do the animals have, all together?\nAnswer:\nLet's think step by step.\n",
        "temperature": 0.8,
        "max_new_tokens": 1024
    }
)

# The nateraw/gairmath-abel-7b model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/nateraw/gairmath-abel-7b/api#output-schema
    print(item, end="")

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run nateraw/gairmath-abel-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "08026755ceaebf00fbade61fc1ad31a063e67bcb4387925c7c82cb0d8206e2b3",
    "input": {
      "top_k": 50,
      "top_p": 0.95,
      "message": "Question:\\nFarmer Brown has 60 animals on his farm, all either chickens or cows. He has twice as many chickens as cows. How many legs do the animals have, all together?\\nAnswer:\\nLet\'s think step by step.\\n",
      "temperature": 0.8,
      "max_new_tokens": 1024
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

1. The problem states that Farmer Brown has 60 animals on his farm, all either chickens or cows. He has twice as many chickens as cows. We need to find out how many legs the animals have in total. 2. Let's assume the number of cows is x. Since Farmer Brown has twice as many chickens as cows, the number of chickens is 2x. 3. The total number of animals is 60, so we can write the equation x + 2x = 60. 4. Simplifying this equation, we get 3x = 60. 5. Dividing both sides by 3, we find x = 20. 6. Therefore, the number of cows is 20. 7. Since each cow has 4 legs and each chicken has 2 legs, the total number of legs is 4 * 20 + 2 * 60 = 80 + 120 = 200. 8. [Final solution] Thus, the animals have a total of 200 legs. #### 200

{
  "completed_at": "2023-09-25T17:38:28.668384Z",
  "created_at": "2023-09-25T17:38:13.680717Z",
  "data_removed": false,
  "error": null,
  "id": "yav75qlbw6matrhjoejbyg65oi",
  "input": {
    "top_k": 50,
    "top_p": 0.95,
    "message": "Question:\nFarmer Brown has 60 animals on his farm, all either chickens or cows. He has twice as many chickens as cows. How many legs do the animals have, all together?\nAnswer:\nLet's think step by step.\n",
    "temperature": 0.8,
    "max_new_tokens": 1024
  },
  "logs": null,
  "metrics": {
    "predict_time": 15.037079,
    "total_time": 14.987667
  },
  "output": [
    "",
    "",
    "1. ",
    "The ",
    "problem ",
    "states ",
    "that ",
    "",
    "Farmer ",
    "Brown ",
    "has ",
    "",
    "",
    "60 ",
    "animals ",
    "on ",
    "his ",
    "",
    "farm, ",
    "all ",
    "either ",
    "",
    "",
    "chickens ",
    "or ",
    "",
    "",
    "cows. ",
    "He ",
    "has ",
    "twice ",
    "as ",
    "many ",
    "",
    "",
    "chickens ",
    "as ",
    "",
    "",
    "cows. ",
    "We ",
    "need ",
    "to ",
    "find ",
    "out ",
    "how ",
    "many ",
    "legs ",
    "the ",
    "animals ",
    "have ",
    "in ",
    "",
    "total.\n",
    "\n",
    "",
    "",
    "2. ",
    "",
    "",
    "Let's ",
    "assume ",
    "the ",
    "number ",
    "of ",
    "",
    "cows ",
    "is ",
    "",
    "x. ",
    "Since ",
    "",
    "Farmer ",
    "Brown ",
    "has ",
    "twice ",
    "as ",
    "many ",
    "",
    "",
    "chickens ",
    "as ",
    "",
    "",
    "cows, ",
    "the ",
    "number ",
    "of ",
    "",
    "",
    "chickens ",
    "is ",
    "",
    "",
    "",
    "2x.\n",
    "\n",
    "",
    "",
    "3. ",
    "The ",
    "total ",
    "number ",
    "of ",
    "animals ",
    "is ",
    "",
    "",
    "",
    "60, ",
    "so ",
    "we ",
    "can ",
    "write ",
    "the ",
    "equation ",
    "x ",
    "+ ",
    "",
    "",
    "2x ",
    "= ",
    "",
    "",
    "",
    "60.\n",
    "\n",
    "",
    "",
    "4. ",
    "",
    "",
    "Simplifying ",
    "this ",
    "",
    "equation, ",
    "we ",
    "get ",
    "",
    "",
    "3x ",
    "= ",
    "",
    "",
    "",
    "60.\n",
    "\n",
    "",
    "",
    "5. ",
    "",
    "",
    "Dividing ",
    "both ",
    "sides ",
    "by ",
    "",
    "",
    "3, ",
    "we ",
    "find ",
    "x ",
    "= ",
    "",
    "",
    "",
    "20.\n",
    "\n",
    "",
    "",
    "6. ",
    "",
    "Therefore, ",
    "the ",
    "number ",
    "of ",
    "",
    "cows ",
    "is ",
    "",
    "",
    "",
    "20.\n",
    "\n",
    "",
    "",
    "7. ",
    "Since ",
    "each ",
    "cow ",
    "has ",
    "",
    "4 ",
    "legs ",
    "and ",
    "each ",
    "",
    "chicken ",
    "has ",
    "",
    "2 ",
    "",
    "legs, ",
    "the ",
    "total ",
    "number ",
    "of ",
    "legs ",
    "is ",
    "",
    "4 ",
    "* ",
    "",
    "",
    "20 ",
    "+ ",
    "",
    "2 ",
    "* ",
    "",
    "",
    "60 ",
    "= ",
    "",
    "",
    "80 ",
    "+ ",
    "",
    "",
    "",
    "120 ",
    "= ",
    "",
    "",
    "",
    "",
    "200.\n",
    "\n",
    "",
    "",
    "8. ",
    "",
    "[Final ",
    "",
    "solution] ",
    "",
    "Thus, ",
    "the ",
    "animals ",
    "have ",
    "a ",
    "total ",
    "of ",
    "",
    "",
    "",
    "200 ",
    "",
    "legs. ",
    "#### ",
    "",
    "",
    "",
    "",
    "200"
  ],
  "started_at": "2023-09-25T17:38:13.631305Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/yav75qlbw6matrhjoejbyg65oi",
    "cancel": "https://api.replicate.com/v1/predictions/yav75qlbw6matrhjoejbyg65oi/cancel"
  },
  "version": "bfcd64ec21f2d25007501f7133890f1e2753ee4c2d5920488f62da536eb8f00e"
}

Generated in

15.0 seconds

Tweak it Report

This example was created by a different version, nateraw/gairmath-abel-7b:bfcd64ec.

Run time and cost

This model runs on Nvidia L40S GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

This model doesn't have a readme.