## Basic model info

Model name: runwayml/aleph-2
Model description: Edit one frame to update an entire video. Aleph 2.0 is Runway's in-context video editor: longer clips (up to 30s), multi-shot edits, and image-level precision via keyframe references.


## Model inputs

- prompt (required): Text prompt describing the edit to be applied to the input video. (string)
- video (required): Input video to edit. Videos must be between 2 and 30 seconds and less than 16MB. (string)
- keyframe_images (optional): Up to 5 optional keyframe images used as more precise control over edits. The position of each keyframe is given by keyframe_positions. (array)
- keyframe_positions (optional): Position of each keyframe in keyframe_images. One entry per image. Each value must be 'first', 'last', or a timestamp in seconds (e.g. '1.67'). (array)
- seed (optional): Random seed. Set for reproducible generation (integer)


## Model output schema

{
  "type": "string",
  "title": "Output",
  "format": "uri"
}

If the input or output schema includes a format of URI, it is referring to a file.


## Example inputs and outputs

Use these example outputs to better understand the types of inputs the model accepts, and the types of outputs the model returns:

### Example (https://replicate.com/p/r0pjh2x8d5rmy0cyhqh98kpe98)

#### Input

```json
{
  "video": "https://replicate.delivery/pbxt/PDBtfgR3ypced4Ijj1dBALbo0iIaR8jb3K2eQaiKMA1cOxrL/tmp3k1o50w7.mp4",
  "prompt": "Make the color scheme olive green",
  "keyframe_images": [],
  "keyframe_positions": []
}
```

#### Output

```json
"https://replicate.delivery/xezq/jtjw0NVscp67AFfY9tUfFihm9JixfpVQOu34DWV29JNsf7taB/tmpl_glajgl.mp4"
```


### Example (https://replicate.com/p/j4em1pdhfsrmr0cyhr38rsdcb0)

#### Input

```json
{
  "seed": 7,
  "video": "https://replicate.delivery/xezq/cfzezDWlUogXCEeVhG2qFmR5JMkB7ZXpa8ej7bDp6CRX8CNUB/tmp0v9ykzlp.mp4",
  "prompt": "Restyle the entire scene as a moody cyberpunk night with neon signs and rain"
}
```

#### Output

```json
"https://replicate.delivery/xezq/mR2fDqtNlF1MEKJCIkrrLWLoZ6fu6Jgqp69caya1ATMvXfWtA/tmp752yiztg.mp4"
```


## Model readme

> # Runway Aleph 2.0
> 
> Aleph 2.0 is Runway's flagship in-context video editing model. Give it a video and a prompt, and it makes the edit you describe while preserving everything you didn't ask to change. Give it an edited keyframe alongside the prompt and the model carries that exact look through the rest of the clip.
> 
> Compared to the original [runwayml/gen4-aleph](https://replicate.com/runwayml/gen4-aleph), Aleph 2.0:
> 
> - Works with up to **30 seconds** of input video
> - Applies edits across **multiple shots and cuts** in the same clip
> - Supports up to **5 keyframes** with positions (`first`, `last`, or an exact timestamp) for image-level precision over the edit
> 
> When attributing to Runway, please use "Powered by Runway" and link to runwayml.com from the user interface.
> 
> - [Runway's announcement](https://runwayml.com/news/introducing-aleph-2-and-edit-studio)
> - [Usage policy](https://help.runwayml.com/hc/en-us/articles/17944787368595-Runway-s-Usage-Policy)
> - [Terms of use](https://runwayml.com/terms-of-use)
> - [Privacy policy](https://runwayml.com/privacy-policy)
> 
> ## What it can do
> 
> - **Targeted edits.** Change a single product, color, hairstyle, or piece of clothing without touching the background, lighting, or other details.
> - **Environmental changes.** Swap locations, weather, seasons, or time of day. Lighting, shadows, and reflections update naturally.
> - **Object addition and removal.** Add or remove props, people, or scene elements with correct perspective and occlusion.
> - **Style transfer.** Apply a new visual style across the whole clip, including across multiple shots.
> - **Multi-shot consistency.** When a clip has cuts, the edit propagates across the relevant shots so you don't have to edit shot-by-shot.
> 
> ## Keyframes
> 
> Aleph 2.0 accepts up to 5 keyframe images. Each keyframe is paired with a position that tells the model where in the video it applies:
> 
> - `first` — start of the video
> - `last` — end of the video
> - A timestamp in seconds, like `1.67`, for any other point in the clip
> 
> Keyframes give you image-level control over the edit: you decide exactly what the change should look like in a specific frame, and Aleph 2.0 carries that look through the rest of the clip.
> 
> The `keyframe_images` and `keyframe_positions` inputs are parallel lists — one position per image.
> 
> ## Inputs
> 
> - `prompt`: Text description of the edit.
> - `video`: Input video. Must be between 2 and 30 seconds and under 16 MB.
> - `keyframe_images`: Up to 5 optional keyframe images.
> - `keyframe_positions`: Position for each keyframe (`first`, `last`, or a timestamp in seconds).
> - `seed`: Optional seed for reproducible generation.
> 
> ## Limitations
> 
> - Input video must be between 2 and 30 seconds.
> - Maximum input file size is 16 MB.
> - Output video matches the input video's aspect ratio.
> - This is an early-access model from Runway. Behavior and pricing may change before general availability.
> 
> ![](https://runway-static-assets.s3.amazonaws.com/site/images/api-page/powered-by-runway-black.png)

