[Adapt] [Seminar] Pretrained Language Model and Commonsense Reasoning: A Brief Survey

hongru onedesire at sjtu.edu.cn
Wed Oct 28 09:47:01 CST 2020

Hi Adapters,
After large pretrained language model, like BERT, was proposed, they have achieved significant improvement in varied of question answering tasks, including commonsense reasoning. However, why pretrained language model can achieve such improvement still remains an open question. In this talk, I will introduce some recent research work that focus on probing the knowledge in pretrained language model and how to teach them.

Time: Wed 4:00pm
Venue: SEIEE 3-414

Best Regards,

发送自 Windows 10 版邮件应用

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://cs.sjtu.edu.cn/pipermail/adapt/attachments/20201028/3cfc95a3/attachment.html>

More information about the Adapt mailing list