andreasjansson/music-inpainting-bert:58bdc207 – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

andreasjansson /music-inpainting-bert:58bdc207

Input

notes

*string

Shift + Return to add a new line

c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?

Notes in tinynotation, with each bar separated by '|'. Use '?' for bars you want in-painted.

chords

*string

Shift + Return to add a new line

Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7

Chords (one chord per bar), with each bar separated by '|'. Use '?' for bars you want in-painted.

time_signature

integer

Time signature

Default: 4

tempo

integer

(minimum: 60, maximum: 200)

Tempo (beats per minute)

Default: 120

sample_width

integer

(minimum: 1, maximum: 200)

Number of potential predictions to sample from. The higher, the more chaotic the output.

Default: 10

seed

integer

Random seed, -1 for random

Default: -1

Run this model in Node.js with one line of code:

npx create-replicate --model=andreasjansson/music-inpainting-bert

or set up a project from scratch

Install Replicate’s Node.js client library

npm install replicate

Set the REPLICATE_API_TOKEN environment variable

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run andreasjansson/music-inpainting-bert using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "andreasjansson/music-inpainting-bert:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1",
  {
    input: {
      seed: -1,
      notes: "c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?",
      tempo: 120,
      chords: "Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7",
      sample_width: 10,
      time_signature: 4
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library

pip install replicate

Set the REPLICATE_API_TOKEN environment variable

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client

import replicate

Run andreasjansson/music-inpainting-bert using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "andreasjansson/music-inpainting-bert:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1",
    input={
        "seed": -1,
        "notes": "c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?",
        "tempo": 120,
        "chords": "Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7",
        "sample_width": 10,
        "time_signature": 4
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run andreasjansson/music-inpainting-bert using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1",
    "input": {
      "seed": -1,
      "notes": "c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?",
      "tempo": 120,
      "chords": "Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7",
      "sample_width": 10,
      "time_signature": 4
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Install Cog

brew install cog

If you don’t have Homebrew, there are other installation options available.

Pull and run andreasjansson/music-inpainting-bert using Cog (this will download the full model and run it in your local environment):

cog predict r8.im/andreasjansson/music-inpainting-bert@sha256:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1 \
  -i 'seed=-1' \
  -i 'notes="c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?"' \
  -i 'tempo=120' \
  -i 'chords="Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7"' \
  -i 'sample_width=10' \
  -i 'time_signature=4'

To learn more, take a look at the Cog documentation.

Pull and run andreasjansson/music-inpainting-bert using Docker (this will download the full model and run it in your local environment):

docker run -d -p 5000:5000 --gpus=all r8.im/andreasjansson/music-inpainting-bert@sha256:58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "seed": -1,
      "notes": "c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?",
      "tempo": 120,
      "chords": "Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7",
      "sample_width": 10,
      "time_signature": 4
    }
  }' \
  http://localhost:5000/predictions

Output

mp3

Video Player is loading.

Current Time 00:00:000

Duration 00:00:000

Loaded: 0%

Stream Type LIVE

Remaining Time 00:00:000

midi

out.midi

score

{
  "completed_at": "2022-05-03T19:32:26.717006Z",
  "created_at": "2022-05-03T19:32:17.700984Z",
  "data_removed": false,
  "error": null,
  "id": "oz3dif2lijfa3ac2bkzidysbxa",
  "input": {
    "seed": -1,
    "notes": "c8 g4 f g.4 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ?",
    "tempo": "120",
    "chords": "Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Cmaj7 | Cmaj7 | E-maj7 | E-maj7 | Gmaj7 | Gmaj7 | Fm7 | Fm7 | D-maj7 | E-maj7 | Cmaj7 | Cmaj7",
    "sample_width": "10",
    "time_signature": "4"
  },
  "logs": "Using seed: 41511\n0.0 10\n0.1 8\n0.2 6\n0.3 6\n0.4 5\n0.5 4\n0.6 4\n0.7 3\n0.8 2\n0.9 2\n0:0 (0/1 C4), (1/2 G4) Cmaj7 0\n0:1 (1/2 F4) Cmaj7 0\n0:2 (1/2 G4) Cmaj7 0\n3: Invalid pattern: 0\n1:0 (0/1 G4) Cmaj7 1\n1:1 (1/2 G4) Cmaj7 5\n1:2  Cmaj7 9\n2:3  Cmaj7 8\n2:0 (0/1 G4), (1/2 G4) Ebmaj7 10\n2:1 (1/2 B-4) Ebmaj7 9\n2:2 (1/2 G4) Ebmaj7 5\n3:3  Ebmaj7 5\n3:0  Ebmaj7 8\n3:1  Ebmaj7 1\n3:2  Ebmaj7 9\n4:3  Ebmaj7 10\n4:0 (0/1 C4), (1/2 G4) Cmaj7 3\n4:1 (1/2 F4) Cmaj7 6\n4:2 (1/2 G4) Cmaj7 1\n5:3 (0/1 F4) Cmaj7 2\n5:0 (0/1 G4) Cmaj7 5\n5:1 (1/2 G4) Cmaj7 8\n5:2  Cmaj7 1\n6:3 (0/1 G4) Cmaj7 6\n6:0 (0/1 G4), (1/2 G4) Ebmaj7 2\n6:1 (1/2 B-4) Ebmaj7 6\n6:2 (1/2 G4) Ebmaj7 8\n7:3  Ebmaj7 2\n7:0 (1/2 G4) Ebmaj7 4\n7:1 (1/2 B-4) Ebmaj7 4\n7:2 (1/2 G4) Ebmaj7 3\n8:3  Ebmaj7 8\n8:0 (0/1 G4) Gmaj7 9\n8:1 (1/2 G4) Gmaj7 6\n8:2 (1/2 G4) Gmaj7 2\n9:3 (0/1 G4) Gmaj7 9\n9:0 (0/1 G4) Gmaj7 4\n9:1 (1/2 G4) Gmaj7 4\n9:2 (1/2 G4) Gmaj7 10\n10:3 (0/1 G4) Gmaj7 10\n10:0 (0/1 G#4) Fm7 5\n10:1  Fm7 3\n10:2  Fm7 8\n11:3  Fm7 9\n11:0  Fm7 5\n11:1  Fm7 4\n11:2  Fm7 2\n12:3  Fm7 7\n12:0 (0/1 C4), (1/2 G4) Dbmaj7 3\n12:1 (1/2 F4) Dbmaj7 7\n12:2 (1/2 G4) Dbmaj7 6\n13:3 (0/1 G#4) Dbmaj7 10\n13:0 (0/1 B-4) Ebmaj7 7\n13:1 (1/2 G#4) Ebmaj7 3\n13:2 (1/2 G4) Ebmaj7 1\n14:3  Ebmaj7 10\n14:0 (0/1 A4) Cmaj7 4\n14:1  Cmaj7 7\n14:2  Cmaj7 6\n15:3  Cmaj7 7\n15:0 (0/1 C4) Cmaj7 1\n15:1  Cmaj7 7\n15:2 (1/2 G4) Cmaj7 2\n0 pattern\nffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers\n  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)\n  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared\n  libavutil      55. 78.100 / 55. 78.100\n  libavcodec     57.107.100 / 57.107.100\n  libavformat    57. 83.100 / 57. 83.100\n  libavdevice    57. 10.100 / 57. 10.100\n  libavfilter     6.107.100 /  6.107.100\n  libavresample   3.  7.  0 /  3.  7.  0\n  libswscale      4.  8.100 /  4.  8.100\n  libswresample   2.  9.100 /  2.  9.100\n  libpostproc    54.  7.100 / 54.  7.100\nGuessed Channel Layout for Input Stream #0.0 : mono\nInput #0, wav, from '/tmp/tmpnuth5955/out.wav':\n  Duration: 00:00:32.50, bitrate: 2822 kb/s\n    Stream #0:0: Audio: pcm_f64le ([3][0][0][0] / 0x0003), 44100 Hz, mono, dbl, 2822 kb/s\nStream mapping:\n  Stream #0:0 -> #0:0 (pcm_f64le (native) -> mp3 (libmp3lame))\nPress [q] to stop, [?] for help\nOutput #0, mp3, to '/tmp/tmpnuth5955/out.mp3':\n  Metadata:\n    TSSE            : Lavf57.83.100\n    Stream #0:0: Audio: mp3 (libmp3lame), 44100 Hz, mono, fltp\n    Metadata:\n      encoder         : Lavc57.107.100 libmp3lame\nsize=     252kB time=00:00:32.15 bitrate=  64.1kbits/s speed=72.2x\nvideo:0kB audio:251kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.088168%\nLY output to `/tmp/tmpnuth5955/score.ly'...\nChanging working directory to: `/tmp/tmpnuth5955'\nProcessing `/tmp/tmpnuth5955/score.ly'\nParsing...\nInterpreting music...[8][16][16]\nPreprocessing graphical objects...\nInterpreting music...\nMIDI output to `score.midi'...\nFinding the ideal number of pages...\nFitting music on 1 page...\nDrawing systems...\nLayout output to `score.ps'...\nConverting to PNG...\nSuccess: compilation successfully completed",
  "metrics": {
    "predict_time": 8.793683,
    "total_time": 9.016022
  },
  "output": {
    "mp3": "https://replicate.delivery/mgxm/f1a45940-4144-47ce-9695-e994c47ad143/out.mp3",
    "midi": "https://replicate.delivery/mgxm/f9130a4a-ed2a-4a6a-91d0-bc9cba1df39f/out.midi",
    "score": "https://replicate.delivery/mgxm/08c47365-c531-403b-8a27-633229bd5932/score.png"
  },
  "started_at": "2022-05-03T19:32:17.923323Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/oz3dif2lijfa3ac2bkzidysbxa",
    "cancel": "https://api.replicate.com/v1/predictions/oz3dif2lijfa3ac2bkzidysbxa/cancel"
  },
  "version": "58bdc2073c9c07abcc4200fe808e15b1a555dbb1390e70f5daa6b3d81bd11fb1"
}

Generated in

8.8 seconds

Tweak itReport

Using seed: 41511
0.0 10
0.1 8
0.2 6
0.3 6
0.4 5
0.5 4
0.6 4
0.7 3
0.8 2
0.9 2
0:0 (0/1 C4), (1/2 G4) Cmaj7 0
0:1 (1/2 F4) Cmaj7 0
0:2 (1/2 G4) Cmaj7 0
3: Invalid pattern: 0
1:0 (0/1 G4) Cmaj7 1
1:1 (1/2 G4) Cmaj7 5
1:2  Cmaj7 9
2:3  Cmaj7 8
2:0 (0/1 G4), (1/2 G4) Ebmaj7 10
2:1 (1/2 B-4) Ebmaj7 9
2:2 (1/2 G4) Ebmaj7 5
3:3  Ebmaj7 5
3:0  Ebmaj7 8
3:1  Ebmaj7 1
3:2  Ebmaj7 9
4:3  Ebmaj7 10
4:0 (0/1 C4), (1/2 G4) Cmaj7 3
4:1 (1/2 F4) Cmaj7 6
4:2 (1/2 G4) Cmaj7 1
5:3 (0/1 F4) Cmaj7 2
5:0 (0/1 G4) Cmaj7 5
5:1 (1/2 G4) Cmaj7 8
5:2  Cmaj7 1
6:3 (0/1 G4) Cmaj7 6
6:0 (0/1 G4), (1/2 G4) Ebmaj7 2
6:1 (1/2 B-4) Ebmaj7 6
6:2 (1/2 G4) Ebmaj7 8
7:3  Ebmaj7 2
7:0 (1/2 G4) Ebmaj7 4
7:1 (1/2 B-4) Ebmaj7 4
7:2 (1/2 G4) Ebmaj7 3
8:3  Ebmaj7 8
8:0 (0/1 G4) Gmaj7 9
8:1 (1/2 G4) Gmaj7 6
8:2 (1/2 G4) Gmaj7 2
9:3 (0/1 G4) Gmaj7 9
9:0 (0/1 G4) Gmaj7 4
9:1 (1/2 G4) Gmaj7 4
9:2 (1/2 G4) Gmaj7 10
10:3 (0/1 G4) Gmaj7 10
10:0 (0/1 G#4) Fm7 5
10:1  Fm7 3
10:2  Fm7 8
11:3  Fm7 9
11:0  Fm7 5
11:1  Fm7 4
11:2  Fm7 2
12:3  Fm7 7
12:0 (0/1 C4), (1/2 G4) Dbmaj7 3
12:1 (1/2 F4) Dbmaj7 7
12:2 (1/2 G4) Dbmaj7 6
13:3 (0/1 G#4) Dbmaj7 10
13:0 (0/1 B-4) Ebmaj7 7
13:1 (1/2 G#4) Ebmaj7 3
13:2 (1/2 G4) Ebmaj7 1
14:3  Ebmaj7 10
14:0 (0/1 A4) Cmaj7 4
14:1  Cmaj7 7
14:2  Cmaj7 6
15:3  Cmaj7 7
15:0 (0/1 C4) Cmaj7 1
15:1  Cmaj7 7
15:2 (1/2 G4) Cmaj7 2
0 pattern
ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
  libavutil      55. 78.100 / 55. 78.100
  libavcodec     57.107.100 / 57.107.100
  libavformat    57. 83.100 / 57. 83.100
  libavdevice    57. 10.100 / 57. 10.100
  libavfilter     6.107.100 /  6.107.100
  libavresample   3.  7.  0 /  3.  7.  0
  libswscale      4.  8.100 /  4.  8.100
  libswresample   2.  9.100 /  2.  9.100
  libpostproc    54.  7.100 / 54.  7.100
Guessed Channel Layout for Input Stream #0.0 : mono
Input #0, wav, from '/tmp/tmpnuth5955/out.wav':
  Duration: 00:00:32.50, bitrate: 2822 kb/s
    Stream #0:0: Audio: pcm_f64le ([3][0][0][0] / 0x0003), 44100 Hz, mono, dbl, 2822 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (pcm_f64le (native) -> mp3 (libmp3lame))
Press [q] to stop, [?] for help
Output #0, mp3, to '/tmp/tmpnuth5955/out.mp3':
  Metadata:
    TSSE            : Lavf57.83.100
    Stream #0:0: Audio: mp3 (libmp3lame), 44100 Hz, mono, fltp
    Metadata:
      encoder         : Lavc57.107.100 libmp3lame
size=     252kB time=00:00:32.15 bitrate=  64.1kbits/s speed=72.2x
video:0kB audio:251kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.088168%
LY output to `/tmp/tmpnuth5955/score.ly'...
Changing working directory to: `/tmp/tmpnuth5955'
Processing `/tmp/tmpnuth5955/score.ly'
Parsing...
Interpreting music...[8][16][16]
Preprocessing graphical objects...
Interpreting music...
MIDI output to `score.midi'...
Finding the ideal number of pages...
Fitting music on 1 page...
Drawing systems...
Layout output to `score.ps'...
Converting to PNG...
Success: compilation successfully completed