[Adapt] [Seminar] ORDERED NEURONS: Integrating Tree Structures into RNNs
kiwisher at sjtu.edu.cn
Tue Oct 22 15:11:47 CST 2019
In this paper(https://openreview.net/pdf?id=B1l6qiR5F7), the authors propose a novel RNN structure that integrates inductive bias to empower RNNs with the ability to model latent hierarchy of language. They introduce two master gates: forget master gate and input master gate, to guide information updates that are time-scale-aware. The model they propose are naturally differentiable, light-weight, and eligible for unsupervised grammar induction.
The authors conducted experiments on three different tasks to prove the general merits of their model.
Time: 16:30 October 22
Venue: SEIEE 3-414
More information about the Adapt