Robust Language Representation Learning via Multi-task Knowledge Distillation
Language Representation Learning maps symbolic natural language texts (for example, words, phrases and sentences) to semantic vectors. Robust and universal language representations are crucial to achieving state-of-the-art results on many Natural Language Processing (NLP) tasks. Ensemble learning is one of the most effective approaches for…