joehoover / falcon-40b-instruct

A 40 billion parameter language model trained to follow human instructions.

  • Public
  • 40.6K runs
  • GitHub
  • License
Run with an API
Playground API Examples README Versions

Input

Output

Run time and cost

This model costs approximately $0.15 to run on Replicate, or 6 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on 4x Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 27 seconds.

Readme

Model Description

Falcon-40B-Instruct is a 40B parameter causal decoder-only model built by TII based on Falcon-40B and finetuned on a mixture of Baize. It is made available under the Apache 2.0 license.

For more information about this model, see here.

Licenses

  • All code in this repository is licensed under the Apache License 2.0 license.
  • Model code and weights are licensed under Apache 2.0 (see here).