DispFormer: Pretrained Transformer for Flexible Dispersion Curve Inversion from Global Synthesis to Regional Applications

Type: Preprint

Publication Date: 2025-01-08

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2501.04366

Abstract

Surface wave dispersion curve inversion is essential for estimating subsurface Shear-wave velocity ($v_s$), yet traditional methods often struggle to balance computational efficiency with inversion accuracy. While deep learning approaches show promise, previous studies typically require large amounts of labeled data and struggle with real-world datasets that have varying period ranges, missing data, and low signal-to-noise ratios. This study proposes DispFormer, a transformer-based neural network for inverting the $v_s$ profile from Rayleigh-wave phase and group dispersion curves. DispFormer processes dispersion data at each period independently, thereby allowing it to handle data of varying lengths without requiring network modifications or alignment between training and testing data. The performance is demonstrated by pre-training it on a global synthetic dataset and testing it on two regional synthetic datasets using zero-shot and few-shot strategies. Results indicate that zero-shot DispFormer, even without any labeled data, produces inversion profiles that match well with the ground truth, providing a deployable initial model generator to assist traditional methods. When labeled data is available, few-shot DispFormer outperforms traditional methods with only a small number of labels. Furthermore, real-world tests indicate that DispFormer effectively handles varying length data, and yields lower data residuals than reference models. These findings demonstrate that DispFormer provides a robust foundation model for dispersion curve inversion and is a promising approach for broader applications.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ PDF Chat Dispersionet: Joint Inversion of Rayleigh-Wave Multimode Phase Velocity Dispersion Curves Using Convolutional Neural Networks 2023 R. K. Sharma
Divakar Vashisth
Bharath Shekar
+ DispersioNET: Joint Inversion of Rayleigh-Wave Multimode Phase Velocity Dispersion Curves using Convolutional Neural Networks 2023 Rohan Sharma
Divakar Vashisth
Bharath Shekar
+ Deep Learning-based extraction of surface wave dispersion curves from seismic shot gathers 2023 Danilo Chamorro
Jiahua Zhao
Claire Birnie
Myrna Staring
Fliedner Moritz
Matteo Ravasi
+ PDF Chat Automatic Differentiation-based Full Waveform Inversion with Flexible Workflows 2024 Feng Liu
Haipeng Li
Guibin Zou
Junlun Li
+ PDF Chat Deep learningā€based extraction of surface wave dispersion curves from seismic shot gathers 2024 Danilo Chamorro
Jiahua Zhao
Claire Birnie
Myrna Staring
Moritz M. Fliedner
Matteo Ravasi
+ A Frequency-Velocity CNN for Developing Near-Surface 2D Vs Images from Linear-Array, Active-Source Wavefield Measurements 2022 Aser Abbas
Joseph P. Vantassel
Brady R. Cox
Krishna Kumar
Jodie Crocker
+ An Unsupervised Deep Learning Approach for the Wave Equation Inverse Problem 2023 Xiong-Bin Yan
Keke Wu
Zhiā€Qin John Xu
Zheng Ma
+ PDF Chat Fourier-Deeponet: Fourier-Enhanced Deep Operator Networks for Full Waveform Inversion with Improved Accuracy, Generalizability, and Robustness 2023 Min Zhu
Shihang Feng
Youzuo Lin
Lu Lu
+ Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness 2023 Min Zhu
Shihang Feng
Youzuo Lin
Lu Lu
+ An empirical study of large-scale data-driven full waveform inversion 2024 Peng Jin
Yinan Feng
Shihang Feng
Hanchen Wang
Yinpeng Chen
Benjamin Consolvo
Zicheng Liu
Youzuo Lin
+ PDF Chat Parameter Efficient Fine-Tuning for Deep Learning-Based Full-Waveform Inversion 2024 Koustav Ghosal
Abhranta Panigrahi
Arnav Chavan
ArunSingh
Deepak Gupta
+ A frequency-velocity CNN for developing near-surface 2D vs images from linear-array, active-source wavefield measurements 2023 Aser Abbas
Joseph P. Vantassel
Brady R. Cox
Krishna Kumar
Jodie A Crocker
+ Data-Driven Seismic Waveform Inversion: A Study on the Robustness and Generalization 2020 Zhongping Zhang
Youzuo Lin
+ Data-driven Seismic Waveform Inversion: A Study on the Robustness and Generalization 2018 Zhongping Zhang
Youzuo Lin
+ PDF Chat Inversion-DeepONet: A Novel DeepONet-Based Network with Encoder-Decoder for Full Waveform Inversion 2024 Zekai Guo
Lihui Chai
Sheng-Jun Huang
Ye Li
+ PDF Chat Advancing data-driven broadband seismic wavefield simulation with multi-conditional diffusion model 2025 Zhengfa Bi
Nori Nakata
Rie Nakata
Renhai Pu
Xinming Wu
Michael W. Mahoney
+ PDF Chat Progressive transfer learning for low frequency data prediction in full waveform inversion 2019 Wenyi Hu
Yuchen Jin
Xuqing Wu
Jiefu Chen
+ PDF Chat Progressive transfer learning for low frequency data prediction in full waveform inversion 2019 Wenyi Hu
Yuchen Jin
Xuqing Wu
Jiefu Chen
+ Progressive transfer learning for low frequency data prediction in full waveform inversion 2019 Wenyi Hu
Yuchen Jin
Xuqing Wu
Jiefu Chen
+ Progressive transfer learning for low frequency data prediction in full waveform inversion 2019 Wenyi Hu
Yuchen Jin
Xuqing Wu
Jiefu Chen

Works That Cite This (0)

Action Title Year Authors

Works Cited by This (0)

Action Title Year Authors