Comment Comment by espadrine A similar model from Replit was released this week: https://huggingface.co/replit/replit-code-v1-3bThe performance of StarCoder seems superior on HumanEval pass@1:• replit-code-v1-3b: 21.9%• replit-finetuned-v1-3b: 30.5%• StarCoder: 33.6%• StarCoder prompted: 40.8% parent espadrine 3 years ago
The performance of StarCoder seems superior on HumanEval pass@1:
• replit-code-v1-3b: 21.9%
• replit-finetuned-v1-3b: 30.5%
• StarCoder: 33.6%
• StarCoder prompted: 40.8%