xiankgx / panda-70m-video-captioning

Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

  • Public
  • 1 run
  • GitHub
  • Paper
  • License

We propose a video captioning model to generate a caption for a short video clip. The model includes vision (green) and textual (blue) branches to benefit video captioning by both video and text inputs. We release the checkpoint trained on Panda-70M.