[Adapt] [Seminar] ORDERED NEURONS: Integrating Tree Structures into RNNs

[sh]

Hi Adapters,

In this paper(https://openreview.net/pdf?id=B1l6qiR5F7), the authors propose a novel RNN structure that integrates inductive bias to empower RNNs with the ability to model latent hierarchy of language. They introduce two master gates: forget master gate and input master gate, to guide information updates that are time-scale-aware. The model they propose are naturally differentiable, light-weight, and eligible for unsupervised grammar induction.

The authors conducted experiments on three different tasks to prove the general merits of their model.

Time: 16:30 October 22
Venue: SEIEE 3-414

Best,
Kiwi
______________