How to Construct Deep Recurrent Neural Networks

Razvan Pascanu, Çaǧlar Gülçehre, Kyunghyun Cho, Yoshua Bengio

Type: Article

Publication Date: 2014-01-01

Citations: 610

Locations

International Conference on Learning Representations - View

Similar Works

Action	Title	Year	Authors
+	How to Construct Deep Recurrent Neural Networks	2013	Razvan Pascanu Çaǧlar Gülçehre Kyunghyun Cho Yoshua Bengio
+	Music Generation Using an LSTM	2022	Michael Conner Lucas Gral Kevin Adams David Hunger Reagan Strelow Alexander Neuwirth
+	Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling	2014	Jun‐Young Chung Çaǧlar Gülçehre Kyunghyun Cho Yoshua Bengio
+ PDF Chat	Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure	2021	Zixun Guo Dimos Makris Dorien Herremans
+	Comparison between DeepESNs and gated RNNs on multivariate time-series prediction	2018	Claudio Gallicchio Alessio Micheli Luca Pedrelli
+	Comparison between DeepESNs and gated RNNs on multivariate time-series prediction.	2018	Claudio Gallicchio Alessio Micheli Luca Pedrelli
+ PDF Chat	Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure	2021	Zixun Guo Dimos Makris Dorien Herremans
+	A Critical Review of Recurrent Neural Networks for Sequence Learning	2015	Zachary C. Lipton John Berkowitz Charles Elkan
+	A Clockwork RNN	2014	Jan Koutník Klaus Greff Faustino Gomez Jürgen Schmidhuber
+	A Clockwork RNN	2014	Jan Koutník Klaus Greff Faustino Gomez Jürgen Schmidhuber
+	Algorithmic Composition of Melodies with Deep Recurrent Neural Networks	2016	Florian Colombo Samuel P. Muscinelli Alexander Seeholzer Johanni Brea Wulfram Gerstner
+	Algorithmic Composition of Melodies with Deep Recurrent Neural Networks	2016	Florian Colombo Samuel P. Muscinelli Alexander Seeholzer Johanni Brea Wulfram Gerstner
+	Diagonal RNNs in Symbolic Music Modeling	2017	Y. Cem Sübakan Paris Smaragdis
+	Diagonal RNNs in Symbolic Music Modeling	2017	Y. Subakan Paris Smaragdis
+	A Hierarchical Recurrent Neural Network for Symbolic Melody Generation	2017	Jian Wu Changran Hu Yulong Wang Xiaolin Hu Jun Zhu
+	Convolutional Recurrent Neural Networks for Music Classification	2016	Keunwoo Choi George Fazekas M. Sandler Kyunghyun Cho
+ PDF Chat	Convolutional recurrent neural networks for music classification	2017	Keunwoo Choi György Fazekas M. Sandler Kyunghyun Cho
+ PDF Chat	A Hierarchical Recurrent Neural Network for Symbolic Melody Generation	2019	Jian Wu Changran Hu Yulong Wang Xiaolin Hu Jun Zhu
+ PDF Chat	Diagonal rnns in symbolic music modeling	2017	Y. Cem Sübakan Paris Smaragdis
+	Advances in Optimizing Recurrent Networks	2012	Yoshua Bengio Nicolas Boulanger-Lewandowski Razvan Pascanu

Works That Cite This (184)

Action	Title	Year	Authors
+ PDF Chat	Hack Me If You Can: Aggregating Autoencoders for Countering Persistent Access Threats within Highly Imbalanced Data	2024	Sidahmed Benabderrahmane Ngoc T. Hoang Petko Valtchev James Cheney Talal Rahwan
+ PDF Chat	Dimensioning V2N Services in 5G Networks Through Forecast-Based Scaling	2022	Jorge Martín‐Pérez Koteswararao Kondepu Danny De Vleeschauwer Venkatarami Reddy Carlos Guimarães Andrea Sgambelluri Luca Valcarenghi Chrysa Papagianni Carlos J. Bernardos
+	Real-Time Power System State Estimation and Forecasting via Deep Unrolled Neural Networks	2019	Liang Zhang Gang Wang Georgios B. Giannakis
+ PDF Chat	A novel CNN-LSTM-based approach to predict urban expansion	2021	Wadii Boulila Hamza Ghandorh Mehshan Ahmed Khan Fawad Ahmed Jawad Ahmad
+	Recurrent Memory Array Structures.	2016	Kamil Rocki
+ PDF Chat	Multivariate LSTM-FCNs for time series classification	2019	Fazle Karim Somshubra Majumdar Houshang Darabi Samuel Harford
+ PDF Chat	A Character-level Decoder without Explicit Segmentation for Neural Machine Translation	2016	Jun‐Young Chung Kyunghyun Cho Yoshua Bengio
+	Reservoir computing approaches for representation and classification of multivariate time series.	2018	Filippo Maria Bianchi Simone Scardapane Sigurd Løkse Robert Jenssen
+	Single-Model Encoder-Decoder with Explicit Morphological Representation for Reinflection	2016	Katharina Kann Hinrich Schütze
+	First Step toward Model-Free, Anonymous Object Tracking with Recurrent Neural Networks	2015	Quan Gan Qipeng Guo Zheng Zhang Kyunghyun Cho

Works Cited by This (12)

Action	Title	Year	Authors
+	Better Mixing via Deep Representations	2012	Yoshua Bengio Grégoire Mesnil Yann Dauphin Salah Rifai
+	Theano: new features and speed improvements	2012	Frédéric Bastien Pascal Lamblin Razvan Pascanu James Bergstra Ian J. Goodfellow Arnaud Bergeron Nicolas Bouchard David Warde-Farley Yoshua Bengio
+	Efficient Estimation of Word Representations in Vector Space	2013	Tomáš Mikolov Kai Chen Greg S. Corrado Jay B. Dean
+	Generating Sequences With Recurrent Neural Networks	2013	Alex Graves
+	On the difficulty of training Recurrent Neural Networks	2012	Razvan Pascanu Tomáš Mikolov Yoshua Bengio
+	Revisiting Natural Gradient for Deep Networks	2013	Razvan Pascanu Yoshua Bengio
+	Improving neural networks by preventing co-adaptation of feature detectors	2012	Geoffrey E. Hinton Nitish Srivastava Alex Krizhevsky Ilya Sutskever Ruslan Salakhutdinov
+	On the number of response regions of deep feed forward networks with piece-wise linear activations	2013	Razvan Pascanu Guido Montúfar Yoshua Bengio
+ PDF Chat	Speech recognition with deep recurrent neural networks	2013	Alex Graves Abdelrahman Mohamed Geoffrey E. Hinton
+	Recurrent Convolutional Neural Networks for Scene Parsing	2013	Pedro H. O. Pinheiro Ronan Collobert