wsmhj/green-screen-remover

Remove a green or blue screen from a video: transparent WebM, ProRes 4444 or alpha matte (demo: first 10 s, up to 720p)

Public
1 run

Run time and cost

This model runs on Nvidia T4 GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

Green Screen Remover

Remove a green, blue or teal screen from a video and get the subject back on a transparent background.

Outputs

  • transparent_webm — VP9 WebM with alpha (OBS, web pages)
  • prores_4444_mov — ProRes 4444 with alpha (Premiere Pro, After Effects, Final Cut Pro, DaVinci Resolve)
  • alpha_matte_mp4 — black/white alpha matte
  • mp4_on_color — the subject on a solid colour

This public demo processes the first 10 seconds at up to 720p. For full-length clips up to 3 minutes and 4K, use Zapmatte, the online green screen remover (first 10 seconds free, no install), or run the open-source code on your own GPU.

How it works

  1. Human matting — Robust Video Matting (RVM, MobileNetV3) gives a soft alpha for the people in each frame.
  2. Chroma key — the screen colour is matched locally around the subject, so uneven lighting doesn’t leave halos.
  3. Combine — RVM alpha and key alpha near people keep hair soft; a colour-only key away from people keeps props.
  4. Blue and teal screens — the screen hue is detected and rotated to green before keying.
  5. Despill and markers — green spill is pulled off edges, and tracking markers on the screen are removed.

Audio is kept (except in the matte).

Limits

  • Made for green/blue screen footage; ordinary videos without a screen are not what it is for.
  • Green clothing is kept but can look patchy; green props far from people are keyed out with the screen.

License

GPL-3.0, because it builds on Robust Video Matting (GPL-3.0). RVM © Shanchuan Lin et al.

Model created
Model updated