This leaves a bit of a mess because sometimes un-marked text is narration and sometimes its the character talking, leaving no clear way to know where to split sentences and what voice to use. Whilst there is no 100% solution at the moment many models lean more one way or the other as to what that unmarked text will be - (character or narrator). + (character or narrator). +
As such, the "Text not inside" function at least gives you the choice to set how you want the TTS engine to handle situations of un-marked text.
- When you dont have enough VRAM free after loading your LLM model +
When you don't have enough VRAM free after loading your LLM + model into your VRAM (Normal Mode example below), you can see that with so little working space, your GPU will have to swap in and out bits of the TTS model, which causes horrible slowdown.
Note: An Nvidia Graphics @@ -588,7 +590,7 @@
The audio you will use:
I would suggest that if its in an interview format, you cut out the - interviewer speaking in audacity or your chosen audio editing package. You dont have to worry about being + interviewer speaking in audacity or your chosen audio editing package. You don't have to worry about being perfect with your cuts, the finetuning Step 1 will go and find spoken audio and cut it out for you. Is there is music over the spoken parts, for best quality you would cut out those parts, though its not 100% necessary. As always, try to avoid bad quality audio with noises in it (humming sounds, hiss etc). You can try something like @@ -700,7 +702,8 @@ Toolkit 11.8 or 12.1
Removal - If it became necessary to uninstall DeepSpeed, you can do so with ./cmd_linux.sh and then pip uninstall deepspeed
Removal - If it became necessary to uninstall DeepSpeed, you can do so with cmd_windows.bat and then + So it could end up sounding too monotone.
The factory setting for temperature is 0.70
@@ -879,8 +884,8 @@A basic environment check to ensure everything should work e.g. is the model already downloaded, are the configuration files set correctly etc.
AllTalk will download the Xtts model (version 2.0.2) into - your models folder. Many people didnt like the quality of the 2.0.3 model, however the latest model will be - accessable on the API TTS setting (2.0.3 at the time of writing) so you have the best of both worlds.
+ your models folder. Many people didn't like the quality of the 2.0.3 model, however the latest model will be + accessible on the API TTS setting (2.0.3 at the time of writing) so you have the best of both worlds.Custom TTS Models and Model path
@@ -890,8 +895,9 @@ stored on your OS of choice).Many people did not like the sound quality of the Coqui 2.0.3 model, and as such the AllTalk downloads the 2.0.2 model seperately from the 2.0.3 model that TTS service downloads and manages.
+ style="color: #000000;">2.0.2 model separately from the 2.0.3 model that TTS service downloads and manages. +Typically the 2.0.2 model is stored in your /alltalk_tts/models folder and it is downloaded on first start-up of the AllTalk_tts extension. However, you may either want to use a custom model @@ -935,7 +941,7 @@
When you are happy it's' working correctly, you are welcome to go delete the models folder stored at /alltalk_tts/models.
If you wish to change the files that the modeldownloader is pulling at startup, - you can futher edit the modeldownload.json and change the https + you can further edit the modeldownload.json and change the https addresses within this files files_to_download section e.g.
"files_to_download": {
"LICENSE.txt": "
autoplay: Feature not yet available. Enable or +
autoplay: Enable or disable autoplay. Still needs to be specified in the JSON request.
-d "autoplay=true"
-d "autoplay=false"
autoplay_volume: Feature not yet available. Set +
autoplay_volume: Set the autoplay volume. Should be between 0.1 and 1.0. Still needs to be specified in the JSON request.
-d "autoplay_volume=0.8"
@@ -1377,12 +1383,12 @@ style="color: black;"> [AllTalk Startup] Warning TTS Subprocess has NOT started up yet, Will keep trying for 80 seconds maximumThis is normal - behavior if the subprocess is taking a while to start, however, if there is an issue starting the + behaviour if the subprocess is taking a while to start, however, if there is an issue starting the subprocess, you may see multiples of this message and an it will time out after 80 seconds, resulting in the TTS engine not starting. Its likely that you are not in the correct python environment or one that has a TTS engine inside, if this happens, though the system will output a warning about that ahead of this message -
Typically the command line console will output any warning - or error messages. If you need to reset your default configuation, the settings are all listed above in the +
Typically, the command line console will output any warning + or error messages. If you need to reset your default configuration, the settings are all listed above in the configuration details.