CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks

Chao Pang, Xinzhuo Jiang, Krishna S. Kalluri, Henry M. Spotnitz, Ruijun Chen, Adler Perotte, Karthik Natarajan

Type: Preprint

Publication Date: 2021-01-01

Citations: 8

DOI: https://doi.org/10.48550/arxiv.2111.08585

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks	2021	Chao Pang Xinzhuo Jiang Krishna S. Kalluri Henry M. Spotnitz Ruijun Chen Adler Perotte Karthik Natarajan
+ PDF Chat	Med-BERT: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction	2021	Laila Rasmy Yang Xiang Ziqian Xie Cui Tao Degui Zhi
+ PDF Chat	Temporal Cross-Attention for Dynamic Embedding and Tokenization of Multimodal Electronic Health Records	2024	Yingbo Ma Suraj Kolla Dhruv Kaliraman Victoria Nolan Zhenhong Hu Ziyuan Guan Yuanfang Ren Brooke Armfield Tezcan Ozrazgat‐Baslanti Tyler J. Loftus
+	Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction	2020	Laila Rasmy Yang Xiang Ziqian Xie Cui Tao Degui Zhi
+	Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records	2021	Yikuan Li Mohammad Mamouei Gholamreza Salimi Khorshidi Shishir Rao Abdelǎali Hassaïne Dexter Canoy Thomas Lukasiewicz Kazem Rahimi
+ PDF Chat	Hi-BEHRT: Hierarchical Transformer-Based Model for Accurate Prediction of Clinical Events Using Multimodal Longitudinal Electronic Health Records	2022	Yikuan Li Mohammad Mamouei Gholamreza Salimi‐Khorshidi Shishir Rao Abdelǎali Hassaïne Dexter Canoy Thomas Lukasiewicz Kazem Rahimi
+ PDF Chat	BiteNet: Bidirectional Temporal Encoder Network to Predict Medical Outcomes	2020	Xueping Peng Guodong Long Tao Shen Sen Wang Jing Jiang Chengqi Zhang
+	BiteNet: Bidirectional Temporal Encoder Network to Predict Medical Outcomes	2020	Xueping Peng Guodong Long Tao Shen Sen Wang Jing Jiang Chengqi Zhang
+	Self-Supervised Graph Learning with Hyperbolic Embedding for Temporal Health Event Prediction	2021	Chang Lü Chandan K. Reddy Yue Ning
+ PDF Chat	Self-Supervised Graph Learning With Hyperbolic Embedding for Temporal Health Event Prediction	2021	Chang Lü Chandan K. Reddy Yue Ning
+ PDF Chat	Dynamic Healthcare Embeddings for Improving Patient Care	2022	Hankyu Jang Sulyun Lee Doaa Hasan Philip M. Polgreen Sriram V. Pemmaraju Bijaya Adhikari
+	Dynamic Healthcare Embeddings for Improving Patient Care	2023	Hankyu Jang Sulyun Lee Doaa Hasan Philip M. Polgreen Sriram V. Pemmaraju Bijaya Adhikari
+ PDF Chat	Time-aware Heterogeneous Graph Transformer with Adaptive Attention Merging for Health Event Prediction	2024	Shibo Li Hengliang Cheng Runze Li Weihua Li
+	BEHRT: Transformer for Electronic Health Records	2019	Yikuan Li Shishir Rao José Roberto Ayala Solares Abdelǎali Hassaïne Dexter Canoy Yajie Zhu Kazem Rahimi Gholamreza Salimi‐Khorshidi
+ PDF Chat	Temporal Self-Attention Network for Medical Concept Embedding	2019	Xueping Peng Guodong Long Tao Shen Sen Wang Jing Jiang Michael Blumenstein
+ PDF Chat	Scalable Numerical Embeddings for Multivariate Time Series: Enhancing Healthcare Data Representation Learning	2024	Chun‐Kai Huang Yi‐Hsien Hsieh Ta-Jung Chien Li-Cheng Chien Shao-Hua Sun Tung‐Hung Su Jia–Horng Kao Che Lin
+	MOTOR: A Time-To-Event Foundation Model For Structured Medical Records	2023	Ethan Steinberg Yizhe Xu Jason Fries Nigam H. Shah
+	On the Importance of Step-wise Embeddings for Heterogeneous Clinical Time-Series	2023	Rita Kuznetsova Alizée Pace M. Burger Hugo Yèche Gunnar Rätsch
+ PDF Chat	Bidirectional Representation Learning From Transformers Using Multimodal Electronic Health Record Data to Predict Depression	2021	Yiwen Meng William Speier Michael Ong Corey Arnold
+	DuETT: Dual Event Time Transformer for Electronic Health Records	2023	Alex Labach Aslesha Pokhrel Xiao Shi Huang Saba Zuberi Seung Eun Yi Maksims Volkovs Tomi Poutanen Rahul G. Krishnan

Works That Cite This (1)

Action	Title	Year	Authors
+ PDF Chat	Hi-BEHRT: Hierarchical Transformer-Based Model for Accurate Prediction of Clinical Events Using Multimodal Longitudinal Electronic Health Records	2022	Yikuan Li Mohammad Mamouei Gholamreza Salimi‐Khorshidi Shishir Rao Abdelǎali Hassaïne Dexter Canoy Thomas Lukasiewicz Kazem Rahimi

Works Cited by This (8)

Action	Title	Year	Authors
+	Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Record	2018	Jinghe Zhang Kamran Kowsari James H. Harrison Jennifer M. Lobo Laura E. Barnes
+	Deep Contextualized Word Representations	2018	Matthew E. Peters Mark E Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer
+ PDF Chat	Recurrent Neural Networks for Multivariate Time Series with Missing Values	2018	Zhengping Che Sanjay Purushotham Kyunghyun Cho David Sontag Yan Liu
+	Adam: A Method for Stochastic Optimization	2014	Diederik P. Kingma Jimmy Ba
+	Pre-training of Graph Augmented Transformers for Medication Recommendation	2019	Junyuan Shang Tengfei Ma Cao Xiao Jimeng Sun
+ PDF Chat	Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Data	2019	Andrew L. Beam Benjamin Kompa Allen Schmaltz Inbar Fried Griffin M. Weber Nathan Palmer Xu Shi Tianxi Cai Isaac S. Kohane
+ PDF Chat	Temporal Self-Attention Network for Medical Concept Embedding	2019	Xueping Peng Guodong Long Tao Shen Sen Wang Jing Jiang Michael Blumenstein
+ PDF Chat	Med-BERT: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction	2021	Laila Rasmy Yang Xiang Ziqian Xie Cui Tao Degui Zhi