Towards Versatile Graph Learning Approach: from the Perspective of Large Language Models

Type: Preprint

Publication Date: 2024-02-18

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2402.11641

Abstract

Graph-structured data are the commonly used and have wide application scenarios in the real world. For these diverse applications, the vast variety of learning tasks, graph domains, and complex graph learning procedures present challenges for human experts when designing versatile graph learning approaches. Facing these challenges, large language models (LLMs) offer a potential solution due to the extensive knowledge and the human-like intelligence. This paper proposes a novel conceptual prototype for designing versatile graph learning methods with LLMs, with a particular focus on the ``where'' and ``how'' perspectives. From the ``where'' perspective, we summarize four key graph learning procedures, including task definition, graph data feature engineering, model selection and optimization, deployment and serving. We then explore the application scenarios of LLMs in these procedures across a wider spectrum. In the ``how'' perspective, we align the abilities of LLMs with the requirements of each procedure. Finally, we point out the promising directions that could better leverage the strength of LLMs towards versatile graph learning methods.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ Graph Learning and Its Advancements on Large Language Models: A Holistic Survey 2022 Shaopeng Wei
Yu Zhao
+ PDF Chat A Survey of Large Language Models for Graphs 2024 Xubin Ren
Jiabin Tang
Dawei Yin
Nitesh V. Chawla
Chao Huang
+ PDF Chat A Survey of Large Language Models for Graphs 2024 Xubin Ren
Jiabin Tang
Dawei Yin
Nitesh V. Chawla
Chao Huang
+ PDF Chat Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques 2024 Qiheng Mao
Zemin Liu
Chenghao Liu
Zhuo Li
Jianling Sun
+ PDF Chat Graph Machine Learning in the Era of Large Language Models (LLMs) 2024 Wenqi Fan
Shijie Wang
Jiani Huang
Zhikai Chen
Yu Song
Wenzhuo Tang
Haitao Mao
Hui Liu
Xiaorui Liu
Dawei Yin
+ PDF Chat LangGFM: A Large Language Model Alone Can be a Powerful Graph Foundation Model 2024 Tianqianjin Lin
Pengwei Yan
Kaisong Song
Zhuoren Jiang
Yangyang Kang
Jun Lin
Weikang Yuan
Junjie Cao
Changlong Sun
Xiaozhong Liu
+ PDF Chat Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining 2024 Yuxin You
Zhen Liu
Xiangchao Wen
Yongtao Zhang
Wei Ai
+ PDF Chat Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks 2024 Xunkai Li
Zhengyu Wu
Jiayi Wu
Hanwen Cui
Jishuo Jia
Rong-Hua Li
Guoren Wang
+ PDF Chat MuseGraph: Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Mining 2024 Yanchao Tan
Hang Lv
Xinyi Huang
Jiawei Zhang
Shiping Wang
Carl Yang
+ PDF Chat Integrating Graphs With Large Language Models: Methods and Prospects 2024 Shirui Pan
Yizhen Zheng
Yixin Liu
+ PDF Chat Graph2text or Graph2token: A Perspective of Large Language Models for Graph Learning 2025 Shuo Yu
Yingbo Wang
Ruolin Li
Gang Liu
Yanming Shen
Shaoxiong Ji
B. Li
Fengling Han
Xiuzhen Zhang
Feng Xia
+ PDF Chat GraphEdit: Large Language Models for Graph Structure Learning 2024 Zirui Guo
Lianghao Xia
Yanhua Yu
Yuling Wang
Zixuan Yang
Wei Wei
Liang Pang
Tat‐Seng Chua
Chao Huang
+ PDF Chat Graph-Aware Language Model Pre-Training on a Large Graph Corpus Can Help Multiple Graph Applications 2023 Han Xie
Da Zheng
Jun Ma
Houyu Zhang
Vassilis N. Ioannidis
Xiang Song
Qing Ping
Sheng Wang
Carl Yang
Yi Xu
+ Graph-Aware Language Model Pre-Training on a Large Graph Corpus Can Help Multiple Graph Applications 2023 Han Xie
Da Zheng
Jun Ma
Houyu Zhang
Vassilis N. Ioannidis
Xiang Song
Ping Qing
Sheng Wang
Carl Yang
Yi Xu
+ Towards Graph Foundation Models: A Survey and Beyond 2023 Jiawei Liu
Cheng Yang
Zhiyuan Lu
Junze Chen
Yibo Li
Mengmei Zhang
Ting Bai
Yuan Fang
Lichao Sun
Philip S. Yu
+ PDF Chat Exploring the Potential of Large Language Models (LLMs)in Learning on Graphs 2024 Zhikai Chen
Haitao Mao
Hang Li
Wei Jin
Hongzhi Wen
Xiaochi Wei
Shuaiqiang Wang
Dawei Yin
Wenqi Fan
Hui Liu
+ Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs 2023 Zhikai Chen
Haitao Mao
Hang Li
Wei Jin
Hongzhi Wen
Xiaochi Wei
Shuaiqiang Wang
Dawei Yin
Wenqi Fan
Hui Liu
+ PDF Chat Bootstrapping Heterogeneous Graph Representation Learning via Large Language Models: A Generalized Approach 2024 Hang Gao
Chenhao Zhang
Fengge Wu
Junsuo Zhao
Changwen Zheng
Huaping Liu
+ PDF Chat LLaGA: Large Language and Graph Assistant 2024 Runjin Chen
Tong Zhao
Ajay Jaiswal
Neil Shah
Shuicheng Yan
+ Beyond Text: A Deep Dive into Large Language Models' Ability on Understanding Graph Data 2023 Yuntong Hu
Zheng Zhang
Liang Zhao

Works That Cite This (0)

Action Title Year Authors

Works Cited by This (0)

Action Title Year Authors