joehoover / falcon-40b-instruct

A 40 billion parameter language model trained to follow human instructions.

  • Public
  • 41.1K runs
  • GitHub
  • License

Input

Output

Run time and cost

This model costs approximately $0.068 to run on Replicate, or 14 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on 4x Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 13 seconds. The predict time for this model varies significantly based on the inputs.

Readme

Model Description

Falcon-40B-Instruct is a 40B parameter causal decoder-only model built by TII based on Falcon-40B and finetuned on a mixture of Baize. It is made available under the Apache 2.0 license.

For more information about this model, see here.

Licenses

  • All code in this repository is licensed under the Apache License 2.0 license.
  • Model code and weights are licensed under Apache 2.0 (see here).