Llama 2 13B (base) fine-tuned on Bob Dylan Lyrics. Trained on a dataset that looks like:

{"text": "<title>{song_title}</title> <lyrics>{song_lyrics}</lyrics>"}
...

To prompt the model, try using a similar format:

<title>Tale of the Roving Gambler</title><lyrics>

The model should then respond with lyrics to that song.

Dataset

GitHub gist

Tips

Try playing around with temperature and top_k, and setting top_p to 0.8