andreasjansson/codegen:211bde4f – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

andreasjansson /codegen:211bde4f

Input

context

string

Shift + Return to add a new line

# Implement a function that computes the square of an integer argument.
# Implement a function that computes the square of an integer argument.

Some starting python code. CodeGen will try to complete the code provided. Providing examples of what you want to do before your prompt can improve performance.

Default: "# Implement a function that computes the square of an integer argument.\n"

prepend_context_to_output

boolean

Whether to prepend your input to the output.

Default: true

num_return_sequences

integer

(minimum: 1, maximum: 10)

Number of code completions to generate from context.

Default: 1

temperature

number

(minimum: 0, maximum: 1)

Increase to improve diversity of outputs, may cause artifacts.

Default: 0.2

prepend_imports

boolean

Whether to prepend a numpy import to the context as in the paper.

Default: true

top_p

number

(minimum: 0, maximum: 1)

Top-p sampling probability.

Default: 0.95

max_length

integer

(minimum: 32, maximum: 2048)

Max length of returned sequences.

Default: 128

seed

integer

Seed for reproducibility. Use -1 for a random seed.

Default: -1

raw_output

boolean

Whether to return a long string (multiple code snippets separated by the string `======`) or a markdown url to be downloaded. May find useful for api.

Default: false

Run this model in Node.js with one line of code:

npx create-replicate --model=andreasjansson/codegen

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run andreasjansson/codegen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "andreasjansson/codegen:211bde4f1da227ce567f2db0fe3811d27435f69b3ac1c37237f3272fa1e79820",
  {
    input: {
      seed: -1,
      top_p: 0.95,
      context: "# Implement a function that computes the square of an integer argument.\n",
      max_length: 128,
      raw_output: false,
      temperature: 0.2,
      prepend_imports: true,
      num_return_sequences: 1,
      prepend_context_to_output: true
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run andreasjansson/codegen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "andreasjansson/codegen:211bde4f1da227ce567f2db0fe3811d27435f69b3ac1c37237f3272fa1e79820",
    input={
        "seed": -1,
        "top_p": 0.95,
        "context": "# Implement a function that computes the square of an integer argument.\n",
        "max_length": 128,
        "raw_output": False,
        "temperature": 0.2,
        "prepend_imports": True,
        "num_return_sequences": 1,
        "prepend_context_to_output": True
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run andreasjansson/codegen using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "211bde4f1da227ce567f2db0fe3811d27435f69b3ac1c37237f3272fa1e79820",
    "input": {
      "seed": -1,
      "top_p": 0.95,
      "context": "# Implement a function that computes the square of an integer argument.\\n",
      "max_length": 128,
      "raw_output": false,
      "temperature": 0.2,
      "prepend_imports": true,
      "num_return_sequences": 1,
      "prepend_context_to_output": true
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/andreasjansson/codegen@sha256:211bde4f1da227ce567f2db0fe3811d27435f69b3ac1c37237f3272fa1e79820 \
  -i 'seed=-1' \
  -i 'top_p=0.95' \
  -i $'context="# Implement a function that computes the square of an integer argument.\\n"' \
  -i 'max_length=128' \
  -i 'raw_output=false' \
  -i 'temperature=0.2' \
  -i 'prepend_imports=true' \
  -i 'num_return_sequences=1' \
  -i 'prepend_context_to_output=true'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/andreasjansson/codegen@sha256:211bde4f1da227ce567f2db0fe3811d27435f69b3ac1c37237f3272fa1e79820
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "seed": -1,
      "top_p": 0.95,
      "context": "# Implement a function that computes the square of an integer argument.\\n",
      "max_length": 128,
      "raw_output": false,
      "temperature": 0.2,
      "prepend_imports": true,
      "num_return_sequences": 1,
      "prepend_context_to_output": true
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

No output yet! Press "Submit" to start a prediction.