Towards Equipping Transformer with the Ability of Systematic Compositionality
Towards Equipping Transformer with the Ability of Systematic Compositionality
One of the key factors in language productivity and human cognition is the ability of Systematic Compositionality, which refers to understanding composed, unseen examples of seen primitives. However, recent evidence reveals that the Transformers have difficulty in generalizing the composed context based on the seen primitives. To this end, we …