[Adapt] 【Adapt】Seminar

CH 2275135452 at qq.com
Tue Nov 13 22:46:36 CST 2018


Hi, Adapters,


For the seminar tomorrow, I will introduce a representation model which is proposed in the paper "A structed self-attentive sentence embedding" (https://arxiv.org/abs/1703.03130). This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention. Instead of using a vector, they use a 2-D matrix to represent the embedding, with each row of the matrix attending on a different part of the sentence. They also propose a self-attention mechanism and a special regularization term for the model. As a side effect, the embedding comes with an easy way of visualizing what specific parts of the sentence are encoded into the embedding. 
Hope this model can bring you some ideas and see you tomorrow afternoon.


Time: 17:00 November 14
Venue: SEIEE 3-517A


Good night!
Brandon
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://cs.sjtu.edu.cn/pipermail/adapt/attachments/20181113/7b7f3296/attachment.html>


More information about the Adapt mailing list