Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fast_inference] 回退策略,减少padding影响,开放选项,同步代码 #986

Merged
merged 30 commits into from
Apr 19, 2024

Conversation

ChasonJiang
Copy link

改动

  • 回退mask策略至上一个版本;
  • 回退pad策略至上一个版本;
  • 在T2SBlock中添加padding_mask,以减少padding的影响;
  • 开放repetition_penalty参数,让用户自行调整重复惩罚的强度;
  • 增加parallel_infer参数,用于开启或关闭并行推理,关闭时与0307版本保持一致;
  • 在webui中增加“保持随机”选项;
  • 同步main分支代码。

讨论

  • pad的策略会影响复读。在推理时,当使用0207版本和此PR,pad到相同长度时,均出现了明显的复读情况。
  • 已知的是,当num_dim>1时,改变张量形状之后(如pad),会使接下来的张量计算产生误差(与没有改变形状相比)。
  • 令人困惑的是,产生的误差是在精度范围内的,所以无法直接确定,复读现象是否是由于误差累积导致的。
  • 如图:
    2c88465aeae9eec6d1995952f84461fe

Lion-Wu and others added 28 commits March 17, 2024 13:06
修复中文标点在英文中的问题,添加所有格匹配
调整英文格式化输出和英文G2P逻辑
Update README.md
Update some outdated file paths and commands
* Fix homograph dict

* Add JSON in dict

* Adjust hot dict to hot reload

* Add English name dict

* Adjust get name dict logic
* Add zh/jp/en mix

* Optimize code readability and formatted output.

* Try OGG streaming

* Add stream mode arg

* Add media type arg

* Add cut punc arg

* Eliminate punc risk
* Update README

* Update README

* update README

* update README
在colab中使用git下载uvr5模型时报错:
fatal: destination path 'uvr5_weights' already exists and is not an empty directory.
通过在下载前将原本从本仓库下载的uvr5_weights文件夹删除可以解决问题。
* remove glob

* rename

* reset mirror pos
回退pad策略;
在T2SBlock中添加padding_mask,以减少pad的影响;
开放repetition_penalty参数,让用户自行调整重复惩罚的强度;
增加parallel_infer参数,用于开启或关闭并行推理,关闭时与0307版本保持一致;
在webui中增加“保持随机”选项;
同步main分支代码。
@ChasonJiang ChasonJiang reopened this Apr 16, 2024
@RVC-Boss
Copy link
Owner

这回退的东西有点多啊,只回退你写的部分吧

@ChasonJiang
Copy link
Author

这回退的东西有点多啊,只回退你写的部分吧

看着commit多是因为merge了 main分支,或者你先merge一下main分支我再提PR

@RVC-Boss RVC-Boss merged commit 29f2211 into RVC-Boss:fast_inference_ Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet