Visual Music Search by MyPart

Instantly match REAL, great music for an image, a video or a whole set of visuals. Upload your media and get a ranked list of real, released tracks from MyPart’s catalog that fit what’s on screen.

• Images, videos and collections. One file searches that image or video; several files are searched together as one collection, such as a campaign or a moodboard.
• Optional text hint. Steer the results with mood, genre or a reference, e.g. "upbeat summer road trip", "Something in the style of Bruno Mars etc
• Song or section. Match whole songs, or the best-fitting part of each song with its start and end time.
• Licensed-only option. Restrict results to MyPart’s licensable catalogs.

Real music only: nothing is generated.

Get started

1. Get a MyPart API key. Request access at mypart.ai/api-access. Every request needs it.
2. Use your own Replicate API token to call the model, as with any model on Replicate.

Keep both in environment variables: MYPART_API_KEY and REPLICATE_API_TOKEN. The MyPart key is passed as the mypart_api_key input; Replicate treats it as a secret and redacts it from prediction logs.

Quick start

curl -s -X POST https://api.replicate.com/v1/predictions \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d '{
    "version": "myart-arch/visual-music-search:883f9a1b2d6e7c4ec57b1b2a93f7a60b966bb6f04ca3c5614e86557c2f1ffd2b",
    "input": {
      "mypart_api_key": "'"$MYPART_API_KEY"'",
      "media": ["https://example.com/your-video.mp4"]
    }
  }'

import os
import replicate

output = replicate.run(
    "myart-arch/visual-music-search:883f9a1b2d6e7c4ec57b1b2a93f7a60b966bb6f04ca3c5614e86557c2f1ffd2b",
    input={
        "mypart_api_key": os.environ["MYPART_API_KEY"],
        "media": [open("clip.mp4", "rb")],        # one file, or several for a collection
        "text": "upbeat summer road trip",        # optional
        "num_results": 10,
    },
)
for track in output["results"]:
    print(track["score"], track["artist"], "-", track["title"], track["url"])

media is always a list, even for a single file. Files can be uploaded, or passed as public or signed HTTPS URLs.

Inputs

Output

{
  "results": [
    {
      "id": "164779",
      "title": "Going Home",
      "artist": "Jon Allen",
      "score": 5.46,
      "url": "https://.../preview.mp3",
      "spotify_id": "4R19bxsqCY2NQUncOKG8Pe",
      "start_time_seconds": null,
      "end_time_seconds": null,
      "section_lyrics": null
    }
  ]
}

The order of the top results is varied on purpose; use score to rank them.

Tips

• Compress media before sending. Smaller files upload faster and results come back sooner: JPEG images around 1920 px on the long side, videos at 720p H.264, trimmed to the part that matters and ideally under 10 MB.
• Limits: each video up to 25 MB; a collection up to 100 MB in total.
• Long requests: with Prefer: wait Replicate waits up to 60 seconds. If the response comes back as starting or processing, poll urls.get until status is succeeded or failed.

Troubleshooting

About MyPart

MyPart builds music reasoning for creative tools: it understands what a visual or a brief needs and finds real music that fits. API access: mypart.ai/api-access.