mikeei / dolphin-2.9.1-llama3-8b-gguf

Dolphin is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant.

  • Public
  • 1.5K runs
  • T4
Run with an API
Playground API Examples README Versions

Run mikeei/dolphin-2.9.1-llama3-8b-gguf with an API

Use one of our client libraries to get started quickly.

Set the REPLICATE_API_TOKEN environment variable

export REPLICATE_API_TOKEN=<paste-your-token-here>

Learn more about authentication

Install Replicate’s Node.js client library

npm install replicate
Learn more about setup

Run mikeei/dolphin-2.9.1-llama3-8b-gguf using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

import Replicate from "replicate";
const replicate = new Replicate();

const input = {
    prompt: "Is it ethical to cheat in a test if my whole life depends on it?"
};

for await (const event of replicate.stream("mikeei/dolphin-2.9.1-llama3-8b-gguf:d074e3e36af3e7f7a84cc566071e4c080c1935a8d791cdd91ae23dc99b8edd52", { input })) {
  process.stdout.write(`${event}`)
  //=> "\n"
};
process.stdout.write("\n");
Learn more