ZCode-DeltaLM

ZCode-DeltaLM is a large-scale multilingual language model developed by Microsoft as part of their ZCode project. It is designed to improve multilingual and cross-lingual natural language understanding and generation tasks. ZCode-DeltaLM leverages delta tuning, a parameter-efficient fine-tuning technique, to adapt pre-trained language models for various downstream tasks while maintaining performance across multiple languages. The model is particularly focused on enhancing translation, summarization, and cross-lingual transfer learning capabilities.