stability-ai/stablelm-base-alpha-3b:1a55f731 – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

stability-ai /stablelm-base-alpha-3b:1a55f731

Input

prompt

string

Shift + Return to add a new line

Simply put, the theory of relativity states thatSimply put, the theory of relativity states that

Input Prompt.

Default: "What's your mood today?"

max_tokens

integer

(minimum: 1)

Maximum number of tokens to generate. A word is generally 2-3 tokens

Default: 100

top_p

number

(minimum: 0.01, maximum: 1)

Valid if you choose top_p decoding. When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens

Default: 1

temperature

number

(minimum: 0.01, maximum: 5)

Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.

Default: 0.75

repetition_penalty

number

(minimum: 0.01, maximum: 5)

Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.

Default: 1.2

Run this model in Node.js with one line of code:

npx create-replicate --model=stability-ai/stablelm-base-alpha-3b

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run stability-ai/stablelm-base-alpha-3b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "stability-ai/stablelm-base-alpha-3b:1a55f731ed1787bee29f94ad6661fb8eb7d63ca4fee1c983b710afc66954677a",
  {
    input: {
      top_p: 1,
      prompt: "Simply put, the theory of relativity states that",
      max_tokens: 100,
      temperature: 0.75,
      repetition_penalty: 1.2
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run stability-ai/stablelm-base-alpha-3b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "stability-ai/stablelm-base-alpha-3b:1a55f731ed1787bee29f94ad6661fb8eb7d63ca4fee1c983b710afc66954677a",
    input={
        "top_p": 1,
        "prompt": "Simply put, the theory of relativity states that",
        "max_tokens": 100,
        "temperature": 0.75,
        "repetition_penalty": 1.2
    }
)

# The stability-ai/stablelm-base-alpha-3b model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/stability-ai/stablelm-base-alpha-3b/api#output-schema
    print(item, end="")

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run stability-ai/stablelm-base-alpha-3b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "stability-ai/stablelm-base-alpha-3b:1a55f731ed1787bee29f94ad6661fb8eb7d63ca4fee1c983b710afc66954677a",
    "input": {
      "top_p": 1,
      "prompt": "Simply put, the theory of relativity states that",
      "max_tokens": 100,
      "temperature": 0.75,
      "repetition_penalty": 1.2
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

gravity has to be a force or some sort. This could explain many phenomena in nature and is also one reason why physicists do not really want their equations describing gravitation as we know them today." If he's right about dark matter there are decades worth left behind by existing studies - if they detect even something like those evidenced so far no signs yet link it up well enough for government measurements – which means governments can always use discretion when making ultramarginal choices involving lethal options such an stuff

{
  "completed_at": "2023-05-02T17:09:22.848934Z",
  "created_at": "2023-05-02T17:09:19.636670Z",
  "data_removed": false,
  "error": null,
  "id": "oalogbz5azhkpmlrj37uaksype",
  "input": {
    "top_p": 1,
    "prompt": "Simply put, the theory of relativity states that",
    "max_tokens": 100,
    "temperature": 0.75,
    "repetition_penalty": 1.2
  },
  "logs": "prompt: Simply put, the theory of relativity states that\nThe attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.\nSetting `pad_token_id` to `eos_token_id`:0 for open-end generation.",
  "metrics": {
    "predict_time": 3.168755,
    "total_time": 3.212264
  },
  "output": [
    " gravity",
    " has",
    " to",
    " be",
    " a",
    " force",
    " or",
    " some",
    " sort.",
    " This",
    " could",
    " explain",
    " many",
    " phenomena",
    " in",
    " nature",
    " and",
    " is",
    " also",
    " one",
    " reason",
    " why",
    " physicists",
    " do",
    " not",
    " really",
    " want",
    " their",
    " equations",
    " describing",
    " gravitation",
    " as",
    " we",
    " know",
    " them",
    " today.\"\nIf",
    " he's",
    " right",
    " about",
    " dark",
    " matter",
    " there",
    " are",
    " decades",
    " worth",
    " left",
    " behind",
    " by",
    " existing",
    " studies",
    " -",
    " if",
    " they",
    " detect",
    " even",
    " something",
    " like",
    " those",
    " evidenced",
    " so",
    " far",
    " no",
    " signs",
    " yet",
    " link",
    " it",
    " up",
    " well",
    " enough",
    " for",
    " government",
    " measurements",
    " –",
    " which",
    " means",
    " governments",
    " can",
    " always",
    " use",
    " discretion",
    " when",
    " making",
    " ultramarginal",
    " choices",
    " involving",
    " lethal",
    " options",
    " such",
    " an",
    " stuff"
  ],
  "started_at": "2023-05-02T17:09:19.680179Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/oalogbz5azhkpmlrj37uaksype",
    "cancel": "https://api.replicate.com/v1/predictions/oalogbz5azhkpmlrj37uaksype/cancel"
  },
  "version": "1a55f731ed1787bee29f94ad6661fb8eb7d63ca4fee1c983b710afc66954677a"
}

Generated in

3.2 seconds

Tweak it Report