[Adapt] Seminar Talk - Try to evaluate multiple chitchat bots at the same time

[李子通]

Hi Adapters,

How to evaluate chitchat bots? And how to evaluate multiple chitchat bots at the same time? I will introduce 2 papers about chitbot evaluation this week.

The first one is from EMNLP2020: Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems. In this work, many bots are evaluated at the same time by human.

The second one is accepted by ACL2022: ChatMatch: Evaluating Chatbots by Autonomous Chat Tournaments (Ruolan Yang, Zitong Li, Haifeng Tang, Kenny Q. Zhu). This paper proposes a framework for automatically evaluating multiple chitchat bots at the same time.

I hope my talk make you feel interesting and helpful.

Time: Wed 4:00pm
Tencent meeting number: 294-121-929
Best wishes.
Zitong