tomasmcm / docsgpt-7b-mistral

Source: Arc53/docsgpt-7b-mistral ✦ Quant: TheBloke/docsgpt-7B-mistral-AWQ ✦ DocsGPT is optimized for Documentation (RAG), fine-tuned for providing answers that are based on context

Cold

Public
75 runs
L40S
Paper
License

Run with an API

Playground API Examples README Versions

Prediction

tomasmcm/docsgpt-7b-mistral:2f13e304

Model

tomasmcm/docsgpt-7b-mistral:2f13e304

wmmy3vlbr6mu3a6zwbmbomnniy

Status

Succeeded

Source

Web

Hardware

A40

Total duration

1m 51s

Created

over 1 year ago

Input

top_k: -1
top_p: 0.95
prompt: ### Instruction When was Aquaman and the Lost Kingdom released? ### Context Aquaman and the Lost Kingdom premiered at a fan event at the Grove, Los Angeles on December 19, 2023, and was released in the United States on December 22, by Warner Bros. Pictures. The film received mixed reviews from critics, who deemed it inferior to its predecessor. The film has grossed $138 million worldwide. ### Answer
max_tokens: 128
temperature: 0.8
presence_penalty: 0
frequency_penalty: 0

{
  "top_k": -1,
  "top_p": 0.95,
  "prompt": "### Instruction\nWhen was Aquaman and the Lost Kingdom released?\n### Context\nAquaman and the Lost Kingdom premiered at a fan event at the Grove, Los Angeles on December 19, 2023, and was released in the United States on December 22, by Warner Bros. Pictures. The film received mixed reviews from critics, who deemed it inferior to its predecessor. The film has grossed $138 million worldwide.\n### Answer",
  "max_tokens": 128,
  "temperature": 0.8,
  "presence_penalty": 0,
  "frequency_penalty": 0
}

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run tomasmcm/docsgpt-7b-mistral using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "tomasmcm/docsgpt-7b-mistral:2f13e3048eb30d468bfd30bdbdc403c9d7fc4d90ccd76b6f0674ba5cb1c70f0e",
  {
    input: {
      top_k: -1,
      top_p: 0.95,
      prompt: "### Instruction\nWhen was Aquaman and the Lost Kingdom released?\n### Context\nAquaman and the Lost Kingdom premiered at a fan event at the Grove, Los Angeles on December 19, 2023, and was released in the United States on December 22, by Warner Bros. Pictures. The film received mixed reviews from critics, who deemed it inferior to its predecessor. The film has grossed $138 million worldwide.\n### Answer",
      max_tokens: 128,
      temperature: 0.8,
      presence_penalty: 0,
      frequency_penalty: 0
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run tomasmcm/docsgpt-7b-mistral using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "tomasmcm/docsgpt-7b-mistral:2f13e3048eb30d468bfd30bdbdc403c9d7fc4d90ccd76b6f0674ba5cb1c70f0e",
    input={
        "top_k": -1,
        "top_p": 0.95,
        "prompt": "### Instruction\nWhen was Aquaman and the Lost Kingdom released?\n### Context\nAquaman and the Lost Kingdom premiered at a fan event at the Grove, Los Angeles on December 19, 2023, and was released in the United States on December 22, by Warner Bros. Pictures. The film received mixed reviews from critics, who deemed it inferior to its predecessor. The film has grossed $138 million worldwide.\n### Answer",
        "max_tokens": 128,
        "temperature": 0.8,
        "presence_penalty": 0,
        "frequency_penalty": 0
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run tomasmcm/docsgpt-7b-mistral using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "2f13e3048eb30d468bfd30bdbdc403c9d7fc4d90ccd76b6f0674ba5cb1c70f0e",
    "input": {
      "top_k": -1,
      "top_p": 0.95,
      "prompt": "### Instruction\\nWhen was Aquaman and the Lost Kingdom released?\\n### Context\\nAquaman and the Lost Kingdom premiered at a fan event at the Grove, Los Angeles on December 19, 2023, and was released in the United States on December 22, by Warner Bros. Pictures. The film received mixed reviews from critics, who deemed it inferior to its predecessor. The film has grossed $138 million worldwide.\\n### Answer",
      "max_tokens": 128,
      "temperature": 0.8,
      "presence_penalty": 0,
      "frequency_penalty": 0
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

Aquaman and the Lost Kingdom was released on December 22, 2023, in the United States by Warner Bros. Pictures.

Generated in

0.7 seconds

Tweak it Share Report

Want to make some of these yourself?

Run this model