[Adapt] [Seminar] A Chapter-Wise Understanding System for Text-To-Speech in Chinese Novels

[章志凌]

During commuting and resting, audiobook APPs like 喜马拉雅 has become a popular choice for people to spend their eye-free times. However, the production of audiobooks are very time-consuming and also requires professional skills and devices. TTS is a promising alternative for audiobook production. However, traditional TTS systems are lacking in expressive features like emotions and the distinction of different characters, which may make the user boring. 

In this ICASSP 2021 paper: " A Chapter-Wise Understanding System for Text-To-Speech in Chinese Novels ", researchers from ByteDance AI Lab propose to use a "novel" NLU system to improve the expressiveness of TTS. The resulting system has been applied in 番茄免费小说 and 番茄畅听, and achieved remarkable success (over a billion downloads in HUAWEI APP store). 

As one of the contributors of the project, I will introduce the interesting points inside and beyond what's written in the paper. Hope you can draw inspirations from it. 

Related: 
My previous talk on TTS, covering the basics of a TTS system (mainly frontend) 
[ https://tx9k8kh0gj.feishu.cn/file/boxcn8s0uCVXmd1AYbW8HIMDhHb | [2019-12-11][zhiling] TTS frontend：NLP as backbone of speech synthesis ] 

Time: Wed 4:00pm 

Venue: SEIEE 3-526A 

Best, 
Zhiling 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://cs.sjtu.edu.cn/pipermail/adapt/attachments/20211116/d2bddd48/attachment.htm>