cbh123 / dylan-lyrics

Llama 2 13B fine-tuned on Bob Dylan lyrics

  • Public
  • 249 runs

Llama 2 13B (base) fine-tuned on Bob Dylan Lyrics. Trained on a dataset that looks like:

{"text": "<title>{song_title}</title> <lyrics>{song_lyrics}</lyrics>"}
...

To prompt the model, try using a similar format:

<title>Tale of the Roving Gambler</title><lyrics>

The model should then respond with lyrics to that song.

Dataset

GitHub gist

Tips

Try playing around with temperature and top_k, and setting top_p to 0.8