zsxkib

qwen2-0.5b-instruct

Cold

Qwen 2: A 0.5 billion parameter language model from Alibaba Cloud, fine tuned for chat completions

Public

210 runs

Run with an API

Playground API Examples README Versions

Prediction

zsxkib/qwen2-0.5b-instruct:f45376a2df2570a076816e9f9c1713d63a5e52851026fa836f14886585591350

Model

zsxkib/qwen2-0.5b-instruct:f45376a2

n20fq4zmk5rgm0cg9yqv9jex9c

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

3m 29s

Created

about 1 year ago

Input

top_k: 1
top_p: 1
prompt: Tell me a funny joke about cowboys in the style of Yoda from star wars
model_type: Qwen2-0.5B-Instruct
temperature: 1
system_prompt: You are a funny and helpful assistant.
max_new_tokens: 512
repetition_penalty: 1

{
  "top_k": 1,
  "top_p": 1,
  "prompt": "Tell me a funny joke about cowboys in the style of Yoda from star wars",
  "model_type": "Qwen2-0.5B-Instruct",
  "temperature": 1,
  "system_prompt": "You are a funny and helpful assistant.",
  "max_new_tokens": 512,
  "repetition_penalty": 1
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zsxkib/qwen2-0.5b-instruct using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zsxkib/qwen2-0.5b-instruct:f45376a2df2570a076816e9f9c1713d63a5e52851026fa836f14886585591350",
  {
    input: {
      top_k: 1,
      top_p: 1,
      prompt: "Tell me a funny joke about cowboys in the style of Yoda from star wars",
      model_type: "Qwen2-0.5B-Instruct",
      temperature: 1,
      system_prompt: "You are a funny and helpful assistant.",
      max_new_tokens: 512,
      repetition_penalty: 1
    }
  }
);

console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run zsxkib/qwen2-0.5b-instruct using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zsxkib/qwen2-0.5b-instruct:f45376a2df2570a076816e9f9c1713d63a5e52851026fa836f14886585591350",
    input={
        "top_k": 1,
        "top_p": 1,
        "prompt": "Tell me a funny joke about cowboys in the style of Yoda from star wars",
        "model_type": "Qwen2-0.5B-Instruct",
        "temperature": 1,
        "system_prompt": "You are a funny and helpful assistant.",
        "max_new_tokens": 512,
        "repetition_penalty": 1
    }
)

# The zsxkib/qwen2-0.5b-instruct model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
    # https://replicate.com/zsxkib/qwen2-0.5b-instruct/api#output-schema
    print(item, end="")

To learn more, take a look at the guide on getting started with Python.

Run zsxkib/qwen2-0.5b-instruct using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "zsxkib/qwen2-0.5b-instruct:f45376a2df2570a076816e9f9c1713d63a5e52851026fa836f14886585591350",
    "input": {
      "top_k": 1,
      "top_p": 1,
      "prompt": "Tell me a funny joke about cowboys in the style of Yoda from star wars",
      "model_type": "Qwen2-0.5B-Instruct",
      "temperature": 1,
      "system_prompt": "You are a funny and helpful assistant.",
      "max_new_tokens": 512,
      "repetition_penalty": 1
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Why did the cowgirl refuse to ride the horse? Because she was afraid of the horse's horn!

Generated in

1.2 seconds

Tweak it Iterate in playground Share Report

Want to make some of these yourself?

Run this model