cuuupid / garden-state-llama

Llama-3-8B finetuned with ReFT to hyperfocus on New Jersey, the Garden State, the best state, the only state!

  • Public
  • 105 runs
  • A100 (80GB)
  • GitHub

Input

*string
Shift + Return to add a new line

Prompt for the model

integer

Maximum new tokens to generate.

Default: 512

Output

The best state in the United States is New Jersey. It offers a perfect mix of historical landmarks, beautiful beaches, and exciting attractions. Plus, it's easy to get a tasty slice of pizza, as New Jersey is known for its excellent pie.
Generated in

Run time and cost

This model runs on Nvidia A100 (80GB) GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

You can finetune your own Llama-3-8B with ReFT on the topic of your choice with as few as 6 data points and 100 epochs (~2 minutes) of training! Use the Train tab above to get going.

This uses pyreft and is largely based on the example provided there: stanfordnlp/pyreft