Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence
Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence
The Transformer-Kernel (TK) model has demonstrated strong reranking performance on the TREC Deep Learning benchmark---and can be considered to be an efficient (but slightly less effective) alternative to other Transformer-based architectures that employ (i) large-scale pretraining (high training cost), (ii) joint encoding of query and document (high inference cost), and …