Readme
CodeGen
This is an unofficial implementation not affiliated with Salesforce.
Sample from the codegen-6B-mono
checkpoint trained on python.
Arxiv: A Conversational Paradigm for Program Synthesis
Authors: Erik Nijkamp*, Bo Pang*, Hiroaki Hayashi*, Lifu Tu, Huan Wang, Yingbo Zhou, Silvio Savarese, and Caiming Xiong (* indicates equal contribution)
Released models
The models are named in the following format:
codegen-{model-size}-{data}
model-size
has 4 options: 350M
, 2B
, 6B
, 16B
, which represent the number of parameters in each model.
data
has 3 options: nl
, multi
, mono
.
nl
models are randomly initialized and trained on The Pile, a 825.18 GB English text corpous.multi
models are initialized fromnl
models and then trained on a corpus with code data consisting of multiple programming languages.mono
models are initialized frommulti
models and then trained on a corpus with Python code data.
Download the model parameters
codegen-350M-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-mono.tar.gz
codegen-2B-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-2B-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-2B-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-2B-mono.tar.gz
codegen-6B-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-6B-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-6B-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-6B-mono.tar.gz
codegen-16B-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-16B-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-16B-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-16B-mono.tar.gz
Citation
If you find our code or paper useful, please cite the paper:
@article{Nijkamp2022ACP,
title={A Conversational Paradigm for Program Synthesis},
author={Nijkamp, Erik and Pang, Bo and Hayashi, Hiroaki and Tu, Lifu and Wang, Huan and Zhou, Yingbo and Savarese, Silvio and Xiong, Caiming},
journal={arXiv preprint},
year={2022}
}
License
Our code is BSD-3 licensed. See LICENSE.txt for details.