Pre-training Tasks for User Intent Detection and Embedding Retrieval in E-commerce Search
Pre-training Tasks for User Intent Detection and Embedding Retrieval in E-commerce Search
BERT-style models pre-trained on the general corpus (e.g., Wikipedia) and fine-tuned on specific task corpus, have recently emerged as breakthrough techniques in many NLP tasks: question answering, text classification, sequence labeling and so on. However, this tech- nique may not always work, especially for two scenarios: a corpus that contains …