Comment by moyix

Despite being only 1.1B params, SantaCoder outperforms Facebook's InCoder (6.7B params) and Salesforce's CodeGen-Multi-2.7B.

Paper: https://hf.co/datasets/bigcode/admin/resolve/main/BigCode_Sa...

Dataset search: https://huggingface.co/spaces/bigcode/santacoder-search

Model weights: https://huggingface.co/bigcode/santacoder