google-research / frame-interpolation

Frame Interpolation for Large Scene Motion

  • Public
  • 272.5K runs
  • T4
  • GitHub
  • Paper
  • License

Input

*file
Preview
frame1

The first input frame

*file
Preview
frame2

The second input frame

integer
(minimum: 1, maximum: 8)

Controls the number of times the frame interpolator is invoked If set to 1, the output will be the sub-frame at t=0.5; when set to > 1, the output will be the interpolation video with (2^times_to_interpolate + 1) frames, fps of 30.

Default: 1

Output

Generated in

This example was created by a different version, google-research/frame-interpolation:53bc438f.

Run time and cost

This model costs approximately $0.045 to run on Replicate, or 22 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 4 minutes. The predict time for this model varies significantly based on the inputs.

Readme

FILM: Frame Interpolation for Large Scene Motion

Paper | YouTube | Benchmark Scores

Tensorflow 2 implementation of our high quality frame interpolation neural network. We present a unified single-network approach that doesn’t use additional pre-trained networks, like optical flow or depth, and yet achieve state-of-the-art results. We use a multi-scale feature extractor that shares the same convolution weights across the scales. Our model is trainable from frame triplets alone.

FILM: Frame Interpolation for Large Motion
Fitsum Reda, Janne Kontkanen, Eric Tabellion, Deqing Sun, Caroline Pantofaru, Brian Curless
Google Research
Technical Report 2022.

Citation

If you find this implementation useful in your works, please acknowledge it appropriately by citing:

@inproceedings{reda2022film,
 title = {Frame Interpolation for Large Motion},
 author = {Fitsum Reda and Janne Kontkanen and Eric Tabellion and Deqing Sun and Caroline Pantofaru and Brian Curless},
 booktitle = {arXiv},
 year = {2022}
}
@misc{film-tf,
  title = {Tensorflow 2 Implementation of "FILM: Frame Interpolation for Large Scene Motion"},
  author = {Fitsum Reda and Janne Kontkanen and Eric Tabellion and Deqing Sun and Caroline Pantofaru and Brian Curless},
  year = {2022},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/google-research/frame-interpolation}}
}