andreasjansson/music-inpainting-bert:58bdc207 – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

andreasjansson /music-inpainting-bert:58bdc207

Input

notes

*string

Shift + Return to add a new line

e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2

Notes in tinynotation, with each bar separated by '|'. Use '?' for bars you want in-painted.

chords

*string

Shift + Return to add a new line

Em | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | EmEm | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | Em

Chords (one chord per bar), with each bar separated by '|'. Use '?' for bars you want in-painted.

time_signature

integer

Time signature

Default: 4

tempo

integer

(minimum: 60, maximum: 200)

Tempo (beats per minute)

Default: 120

sample_width

integer

(minimum: 1, maximum: 200)

Number of potential predictions to sample from. The higher, the more chaotic the output.

Default: 10

seed

integer

Random seed, -1 for random

Default: -1

Run this model in Node.js with one line of code:

npx create-replicate --model=andreasjansson/music-inpainting-bert

or set up a project from scratch

Install Replicate’s Node.js client library

npm install replicate

Set the REPLICATE_API_TOKEN environment variable

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run andreasjansson/music-inpainting-bert using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "andreasjansson/music-inpainting-bert:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1",
  {
    input: {
      seed: -1,
      notes: "e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2",
      tempo: 100,
      chords: "Em | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | Em",
      sample_width: 80,
      time_signature: 3
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library

pip install replicate

Set the REPLICATE_API_TOKEN environment variable

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client

import replicate

Run andreasjansson/music-inpainting-bert using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "andreasjansson/music-inpainting-bert:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1",
    input={
        "seed": -1,
        "notes": "e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2",
        "tempo": 100,
        "chords": "Em | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | Em",
        "sample_width": 80,
        "time_signature": 3
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run andreasjansson/music-inpainting-bert using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1",
    "input": {
      "seed": -1,
      "notes": "e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2",
      "tempo": 100,
      "chords": "Em | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | Em",
      "sample_width": 80,
      "time_signature": 3
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Install Cog

brew install cog

If you don’t have Homebrew, there are other installation options available.

Pull and run andreasjansson/music-inpainting-bert using Cog (this will download the full model and run it in your local environment):

cog predict r8.im/andreasjansson/music-inpainting-bert@sha256:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1 \
  -i 'seed=-1' \
  -i 'notes="e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2"' \
  -i 'tempo=100' \
  -i 'chords="Em | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | Em"' \
  -i 'sample_width=80' \
  -i 'time_signature=3'

To learn more, take a look at the Cog documentation.

Pull and run andreasjansson/music-inpainting-bert using Docker (this will download the full model and run it in your local environment):

docker run -d -p 5000:5000 --gpus=all r8.im/andreasjansson/music-inpainting-bert@sha256:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "seed": -1,
      "notes": "e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2",
      "tempo": 100,
      "chords": "Em | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | Em",
      "sample_width": 80,
      "time_signature": 3
    }
  }' \
  http://localhost:5000/predictions

Output

mp3

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

midi

out.midi

score

{
  "completed_at": "2022-05-03T19:30:32.763896Z",
  "created_at": "2022-05-03T19:29:39.113688Z",
  "data_removed": false,
  "error": null,
  "id": "qfzlgox7krattbnistlqzyq6qe",
  "input": {
    "seed": -1,
    "notes": "e2 f#4 | g.4 f#8 e4 | b2 b4 | b.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | e.2",
    "tempo": "100",
    "chords": "Em | Em | Em | Em | Fm | Fm | Em | Em | Fm | Fm | Em | Em | B7 | B7 | Em | Em",
    "sample_width": "80",
    "time_signature": "3"
  },
  "logs": "Using seed: 15436\n0.0 80\n0.1 12\n0.2 9\n0.3 7\n0.4 6\n0.5 5\n0.6 4\n0.7 3\n0.8 3\n0.9 2\n0:0 (0/1 E4) Em/E 0\n0:1  Em/E 0\n1:2 (0/1 F#4) Em/E 0\n1:0 (0/1 G4) Em/E 0\n1:1 (1/2 F#4) Em/E 0\n2:2 (0/1 E4) Em/E 0\n2:0 (0/1 B4) Em/E 0\n2:1  Em/E 0\n3:2 (0/1 B4) Em/E 0\n3:0 (0/1 B4) Em/E 0\n3:1  Em/E 0\n4:2  Em/E 0\n4:0 (0/1 G#4) Fm/F 6\n4:1  Fm/F 6\n5:2 (0/1 F4) Fm/F 5\n5:0 (0/1 G#4) Fm/F 4\n5:1  Fm/F 1\n6:2  Fm/F 2\n6:0 (0/1 G4) Em/E 3\n6:1 (0/1 E4) Em/E 8\n7:2  Em/E 8\n7:0  Em/E 5\n7:1  Em/E 5\n8:2  Em/E 6\n8:0 (0/1 F5) Fm/F 7\n8:1  Fm/F 4\n9:2 (0/1 F5) Fm/F 3\n9:0 (0/1 F5) Fm/F 2\n9:1  Fm/F 4\n10:2  Fm/F 9\n10:0 (0/1 E5) Em/E 3\n10:1  Em/E 5\n11:2 (0/1 B4) Em/E 7\n11:0 (0/1 B4) Em/E 2\n11:1  Em/E 4\n12:2  Em/E 2\n12:0 (0/1 F#4) B7 3\n12:1 (0/1 B4) B7 1\n13:2 (0/1 E-5) B7 8\n13:0 (0/1 F#5) B7 7\n13:1 (1/2 E5) B7 1\n14:2 (0/1 E-5) B7 6\n14:0 (0/1 B4) Em/E 7\n14:1  Em/E 8\n15:2 (0/1 E4), (1/2 G4) Em/E 1\n15:0 (0/1 E4) Em/E 0\n46: Invalid pattern: 0\n0 pattern\nffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers\n  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)\n  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared\n  libavutil      55. 78.100 / 55. 78.100\n  libavcodec     57.107.100 / 57.107.100\n  libavformat    57. 83.100 / 57. 83.100\n  libavdevice    57. 10.100 / 57. 10.100\n  libavfilter     6.107.100 /  6.107.100\n  libavresample   3.  7.  0 /  3.  7.  0\n  libswscale      4.  8.100 /  4.  8.100\n  libswresample   2.  9.100 /  2.  9.100\n  libpostproc    54.  7.100 / 54.  7.100\nGuessed Channel Layout for Input Stream #0.0 : mono\nInput #0, wav, from '/tmp/tmp_345nbx1/out.wav':\n  Duration: 00:00:29.20, bitrate: 2822 kb/s\n    Stream #0:0: Audio: pcm_f64le ([3][0][0][0] / 0x0003), 44100 Hz, mono, dbl, 2822 kb/s\nStream mapping:\n  Stream #0:0 -> #0:0 (pcm_f64le (native) -> mp3 (libmp3lame))\nPress [q] to stop, [?] for help\nOutput #0, mp3, to '/tmp/tmp_345nbx1/out.mp3':\n  Metadata:\n    TSSE            : Lavf57.83.100\n    Stream #0:0: Audio: mp3 (libmp3lame), 44100 Hz, mono, fltp\n    Metadata:\n      encoder         : Lavc57.107.100 libmp3lame\nsize=     226kB time=00:00:28.83 bitrate=  64.1kbits/s speed=71.9x\nvideo:0kB audio:226kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.098302%\nLY output to `/tmp/tmp_345nbx1/score.ly'...\nChanging working directory to: `/tmp/tmp_345nbx1'\nProcessing `/tmp/tmp_345nbx1/score.ly'\nParsing...\nInterpreting music...[8][16][16]\nPreprocessing graphical objects...\nInterpreting music...\nMIDI output to `score.midi'...\nFinding the ideal number of pages...\nFitting music on 1 page...\nDrawing systems...\nLayout output to `score.ps'...\nConverting to PNG...\nSuccess: compilation successfully completed",
  "metrics": {
    "predict_time": 20.019826,
    "total_time": 53.650208
  },
  "output": {
    "mp3": "https://replicate.delivery/mgxm/70f4aa51-bf99-471b-b9f0-a6ffc234926e/out.mp3",
    "midi": "https://replicate.delivery/mgxm/4a3375d4-e29e-4fbd-8351-0641e0466a21/out.midi",
    "score": "https://replicate.delivery/mgxm/4fd2a875-d3a5-47f9-bfcf-b7cd8a99ca1c/score.png"
  },
  "started_at": "2022-05-03T19:30:12.744070Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/qfzlgox7krattbnistlqzyq6qe",
    "cancel": "https://api.replicate.com/v1/predictions/qfzlgox7krattbnistlqzyq6qe/cancel"
  },
  "version": "58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1"
}

Generated in

20.0 seconds

Tweak itReport

Using seed: 15436
0.0 80
0.1 12
0.2 9
0.3 7
0.4 6
0.5 5
0.6 4
0.7 3
0.8 3
0.9 2
0:0 (0/1 E4) Em/E 0
0:1  Em/E 0
1:2 (0/1 F#4) Em/E 0
1:0 (0/1 G4) Em/E 0
1:1 (1/2 F#4) Em/E 0
2:2 (0/1 E4) Em/E 0
2:0 (0/1 B4) Em/E 0
2:1  Em/E 0
3:2 (0/1 B4) Em/E 0
3:0 (0/1 B4) Em/E 0
3:1  Em/E 0
4:2  Em/E 0
4:0 (0/1 G#4) Fm/F 6
4:1  Fm/F 6
5:2 (0/1 F4) Fm/F 5
5:0 (0/1 G#4) Fm/F 4
5:1  Fm/F 1
6:2  Fm/F 2
6:0 (0/1 G4) Em/E 3
6:1 (0/1 E4) Em/E 8
7:2  Em/E 8
7:0  Em/E 5
7:1  Em/E 5
8:2  Em/E 6
8:0 (0/1 F5) Fm/F 7
8:1  Fm/F 4
9:2 (0/1 F5) Fm/F 3
9:0 (0/1 F5) Fm/F 2
9:1  Fm/F 4
10:2  Fm/F 9
10:0 (0/1 E5) Em/E 3
10:1  Em/E 5
11:2 (0/1 B4) Em/E 7
11:0 (0/1 B4) Em/E 2
11:1  Em/E 4
12:2  Em/E 2
12:0 (0/1 F#4) B7 3
12:1 (0/1 B4) B7 1
13:2 (0/1 E-5) B7 8
13:0 (0/1 F#5) B7 7
13:1 (1/2 E5) B7 1
14:2 (0/1 E-5) B7 6
14:0 (0/1 B4) Em/E 7
14:1  Em/E 8
15:2 (0/1 E4), (1/2 G4) Em/E 1
15:0 (0/1 E4) Em/E 0
46: Invalid pattern: 0
0 pattern
ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
  libavutil      55. 78.100 / 55. 78.100
  libavcodec     57.107.100 / 57.107.100
  libavformat    57. 83.100 / 57. 83.100
  libavdevice    57. 10.100 / 57. 10.100
  libavfilter     6.107.100 /  6.107.100
  libavresample   3.  7.  0 /  3.  7.  0
  libswscale      4.  8.100 /  4.  8.100
  libswresample   2.  9.100 /  2.  9.100
  libpostproc    54.  7.100 / 54.  7.100
Guessed Channel Layout for Input Stream #0.0 : mono
Input #0, wav, from '/tmp/tmp_345nbx1/out.wav':
  Duration: 00:00:29.20, bitrate: 2822 kb/s
    Stream #0:0: Audio: pcm_f64le ([3][0][0][0] / 0x0003), 44100 Hz, mono, dbl, 2822 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (pcm_f64le (native) -> mp3 (libmp3lame))
Press [q] to stop, [?] for help
Output #0, mp3, to '/tmp/tmp_345nbx1/out.mp3':
  Metadata:
    TSSE            : Lavf57.83.100
    Stream #0:0: Audio: mp3 (libmp3lame), 44100 Hz, mono, fltp
    Metadata:
      encoder         : Lavc57.107.100 libmp3lame
size=     226kB time=00:00:28.83 bitrate=  64.1kbits/s speed=71.9x
video:0kB audio:226kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.098302%
LY output to `/tmp/tmp_345nbx1/score.ly'...
Changing working directory to: `/tmp/tmp_345nbx1'
Processing `/tmp/tmp_345nbx1/score.ly'
Parsing...
Interpreting music...[8][16][16]
Preprocessing graphical objects...
Interpreting music...
MIDI output to `score.midi'...
Finding the ideal number of pages...
Fitting music on 1 page...
Drawing systems...
Layout output to `score.ps'...
Converting to PNG...
Success: compilation successfully completed