WizardCoder is a new model that utilizes complex instruction fine-tuning to enhance Code Large Language Models (Code LLMs) for code-related tasks. This model has been tested on four benchmarks and has shown superior performance compared to other Code LLMs and even outperforms the largest closed LLMs on some benchmarks.