WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructionshttps://github.com/nlpxucan/WizardLM
WizardLM is a pre-trained language model that can follow complex instructions using Evol-Instruct - a method that uses language models instead of humans to automatically produce open-domain instructions of various difficulty levels. WizardLM is still in development and will continue to improve by training on larger scales, adding more training data, and innovating more advanced large-model training methods. To fine-tune WizardLM model, alpaca_evol_instruct_70k.json containing 70K instruction-following data generated from Evol-Instruct was used. In terms of human evaluation, WizardLM achieved significantly better results than Alpaca and Vicuna-7b models on diverse user-oriented instructions including difficult coding generation, debugging, math, reasoning, complex formats, academic writing, and extensive disciplines. Additionally, in the high-difficulty section of the human evaluation test set, WizardLM even outperforms ChatGPT, indicating its significant potential to handle complex instructions.