Variational Reasoning for Question Answering With Knowledge Graph

Type: Article

Publication Date: 2018-04-26

Citations: 313

DOI: https://doi.org/10.1609/aaai.v32i1.12057

Abstract

Knowledge graph (KG) is known to be helpful for the task of question answering (QA), since it provides well-structured relational information between entities, and allows one to further infer indirect facts. However, it is challenging to build QA systems which can learn to reason over knowledge graphs based on question-answer pairs alone. First, when people ask questions, their expressions are noisy (for example, typos in texts, or variations in pronunciations), which is non-trivial for the QA system to match those mentioned entities to the knowledge graph. Second, many questions require multi-hop logic reasoning over the knowledge graph to retrieve the answers. To address these challenges, we propose a novel and unified deep learning architecture, and an end-to-end variational learning algorithm which can handle noise in questions, and learn multi-hop reasoning simultaneously. Our method achieves state-of-the-art performance on a recent benchmark dataset in the literature. We also derive a series of new benchmark datasets, including questions for multi-hop reasoning, questions paraphrased by neural translation model, and questions in human voice. Our method yields very promising results on all these challenging datasets.

Locations

  • Proceedings of the AAAI Conference on Artificial Intelligence - View - PDF
  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ Variational Reasoning for Question Answering with Knowledge Graph 2017 Yuyu Zhang
Hanjun Dai
Zornitsa Kozareva
Alexander J. Smola
Le Song
+ An Inference Approach To Question Answering Over Knowledge Graphs 2021 Aayushee Gupta
K. M. Annervaz
Ambedkar Dukkipati
Shubhashis Sengupta
+ PDF Chat Relation-Aware Language-Graph Transformer for Question Answering 2023 Jinyoung Park
Hyeong Kyu Choi
Juyeon Ko
Hyeonjin Park
Ji‐Hoon Kim
Jisu Jeong
Kyungmin Kim
Hyunwoo Kim
+ PDF Chat ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph 2023 Jinhao Jiang
Kun Zhou
Wayne Xin Zhao
Yaliang Li
Ji-Rong Wen
+ ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph 2024 Jinhao Jiang
Kun Zhou
Wayne Xin Zhao
Yaliang Li
Ji-Rong Wen
+ Structured Knowledge Grounding for Question Answering 2022 Yujie Lu
Siqi Ouyang
Kairui Zhou
+ QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering 2021 Michihiro Yasunaga
Hongyu Ren
Antoine Bosselut
Percy Liang
Jure Leskovec
+ Structured Context and High-Coverage Grammar for Conversational Question Answering over Knowledge Graphs 2021 Pierre Marion
Paweł Krzysztof Nowak
Francesco Piccinno
+ Relation-Aware Language-Graph Transformer for Question Answering 2022 Jinyoung Park
Hyeong Kyu Choi
Juyeon Ko
Hyeonjin Park
Ji‐Hoon Kim
Jisu Jeong
Kyungmin Kim
Hyunwoo J. Kim
+ Structured Context and High-Coverage Grammar for Conversational Question Answering over Knowledge Graphs 2021 Pierre Marion
Paweł Krzysztof Nowak
Francesco Piccinno
+ PDF Chat Structured Context and High-Coverage Grammar for Conversational Question Answering over Knowledge Graphs 2021 Pierre Marion
Paweł Krzysztof Nowak
Francesco Piccinno
+ SPBERT: Pre-training BERT on SPARQL Queries for End-to-end Question Answering over Knowledge Graphs 2021 Hieu Tran
Long Phan
Truong-Son Nguyen
+ Contrastive Representation Learning for Conversational Question Answering over Knowledge Graphs 2022 Endri Kacupaj
Kuldeep Singh
Maria Maleshkova
Jens Lehmann
+ PDF Chat Contrastive Representation Learning for Conversational Question Answering over Knowledge Graphs 2022 Endri Kacupaj
Kuldeep Singh
Maria Maleshkova
Jens Lehmann
+ Graph Reasoning for Question Answering with Triplet Retrieval 2023 Shiyang Li
Yifan Gao
Haoming Jiang
Qingyu Yin
Zheng Li
Xifeng Yan
Chao Zhang
Bing Yin
+ PDF Chat Graph Reasoning for Question Answering with Triplet Retrieval 2023 Shiyang Li
Yifan Gao
Haoming Jiang
Qingyu Yin
Zheng Li
Xifeng Yan
Chao Zhang
Bing Yin
+ PDF Chat JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering 2022 Yueqing Sun
Qi Shi
Le Qi
Yu Zhang
+ JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering 2021 Yueqing Sun
Qi Shi
Le Qi
Yu Zhang
+ PDF Chat Explore then Determine: A GNN-LLM Synergy Framework for Reasoning over Knowledge Graph 2024 Guangyi Liu
Yongqi Zhang
Yong Li
Quanming Yao
+ Single Sequence Prediction over Reasoning Graphs for Multi-hop QA 2023 G. Ramesh
Makesh Narsimhan Sreedhar
Junjie Hu

Works That Cite This (75)

Action Title Year Authors
+ A Comprehensive Survey on Automatic Knowledge Graph Construction 2023 Lingfeng Zhong
Jia Wu
Qian Li
Hao Peng
Xindong Wu
+ PDF Chat Knowledge-Enhanced Iterative Instruction Generation and Reasoning for Knowledge Base Question Answering 2022 Haowei Du
Quzhe Huang
Chen Zhang
Dongyan Zhao
+ Knowledge Graphs in Manufacturing and Production: A Systematic Literature Review 2020 Georg Buchgeher
David Gabauer
Jorge Martínez-Gil
Lisa Ehrlinger
+ PDF Chat StructGPT: A General Framework for Large Language Model to Reason over Structured Data 2023 Jinhao Jiang
Kun Zhou
Zican Dong
Keming Ye
Wayne Xin Zhao
Ji-Rong Wen
+ Variational Knowledge Graph Reasoning 2018 Wenhu Chen
Wenhan Xiong
Xifeng Yan
William Yang Wang
+ Dirichlet Variational Autoencoder for Text Modeling 2018 Yijun Xiao
Tiancheng Zhao
William Yang Wang
+ HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data 2020 Wenhu Chen
Hanwen Zha
Zhiyu Chen
Wenhan Xiong
Hong Wang
William Yang Wang
+ Variational Knowledge Graph Reasoning 2018 Wenhu Chen
Wenhan Xiong
Xifeng Yan
William Yang Wang
+ PDF Chat From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Base 2023 Wangzhen Guo
Linyin Luo
Hanjiang Lai
Jian Yin
+ PDF Chat ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph 2023 Jinhao Jiang
Kun Zhou
Wayne Xin Zhao
Yaliang Li
Ji-Rong Wen