Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer
Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer
Developing neural architectures that are capable of logical reasoning has become increasingly important for a wide range of applications (e.g., natural language processing). Towards this grand objective, we propose a symbolic reasoning architecture that chains many join operators together to model output logical expressions. In particular, we demonstrate that such …