Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

停顿是如何实现的? #124

Open
v-yunbin opened this issue Sep 1, 2023 · 3 comments
Open

停顿是如何实现的? #124

v-yunbin opened this issue Sep 1, 2023 · 3 comments

Comments

@v-yunbin
Copy link

v-yunbin commented Sep 1, 2023

大概看了下是通过bert提取char embedding,和音素拼接输入给模型,没有看到停顿是如何处理的。

@MaxMax2016
Copy link
Collaborator

这个bert模型是用停顿训练的;bert的char embedding通过softmax可以得到停顿标注 #1 #2 ~~~;用显示的停顿标注训练TTS,需要将将停顿标注转换成embedding;有点多余的感觉,所以就直接用的char embedding。

@v-yunbin
Copy link
Author

v-yunbin commented Sep 1, 2023

这个bert模型是用停顿训练的;bert的char embedding通过softmax可以得到停顿标注 #1 #2 ~~~;用显示的停顿标注训练TTS,需要将将停顿标注转换成embedding;有点多余的感觉,所以就直接用的char embedding。

所以说可以理解为这个bert embedding用来控制停顿+韵律,输入文本,bert会自动预测停顿,和文本中的标点符号没有直接关系呗?

@MaxMax2016
Copy link
Collaborator

所以说可以理解为这个bert embedding用来控制停顿+韵律,输入文本,bert会自动预测停顿
--是的
和文本中的标点符号没有直接关系呗?
--bert支持标点吧,时间有点久了,记不太清了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants