2023-12-09 20:31:46 +00:00
2023-12-09 19:14:54 +00:00
2023-12-08 09:35:53 +00:00
2023-12-08 09:35:19 +00:00
2023-12-09 19:14:54 +00:00
2023-12-08 09:35:53 +00:00
2023-12-08 09:35:53 +00:00
2023-12-08 09:35:53 +00:00
2023-12-09 19:49:32 +00:00
2023-12-09 20:31:46 +00:00
2023-12-09 19:48:28 +00:00
2023-12-09 19:14:54 +00:00
2023-12-08 09:35:53 +00:00
2023-12-09 19:14:54 +00:00

AllTalk TTS

AllTalk is an updated version of the Coqui_tts extension for Text Generation web UI. Features include:

  • Custom Startup Settings: Adjust your standard startup settings. Screenshot
  • Nararator: Use different voices for main character and narration. Screenshot
  • Low VRAM mode: Improve generation performance if your VRAM is filled by your LLM. Screenshot
  • DeepSpeed: When DeepSpeed is installed you can get a 3-4x performance boost generating TTS.
  • Local/Custom models: Use any of the XTTSv2 models (API Local and XTTSv2 Local).
  • Wav file maintenance: Configurable deletion of old output wav files. Screenshot
  • Documentation: Fully documented with a built in webpage. Screenshot
  • Console output Clear command line output for any warnings or issues.
  • 3rd Party support via JSON calls Can be used with 3rd party applications via JSON calls.

Note: Mac compatibility is not yet guaranteed due to CUDA requirement

Installation on Text generation web UI

This has been tested on the current Dec 2023 release of Text generation webUI. If you have not updated it for a while, you may wish to update Text generation webUI, instructions here

In a command prompt/terminal window you need to move into your Text generation webUI folder:

cd text-generation-webui

Start the Text generation webUI Python environment for your OS:

cmd_windows.bat or ./cmd_linux.sh (read note below about Mac support)

move into your extensions folder:

cd extensions

Once there git clone this repository e.g.

git clone https://github.com/erew123/alltalk_tts

Install the requirements:

pip install -r requirements.txt

You can now start Text generation webUI and load the AllTalk extension in the Text generation webUI session tab.

Other installation notes

On first startup, AllTalk will download the Coqui XTTSv2 2.0.2 model to its models folder (1.8GB space required). You can customse your model or use the TTS latest model within the interface (details in documentation).

Once the extension is loaded, please find all documentation and settings on the link provided in the interface (as shown in the screenshot below).

To start AllTalk every Text generation webUI loads, edit the Text generation webUI CMD_FLAGS.txt file in the main text-generation-webui folder and add --extensions alltalk_tts.

Screenshots

Main Page

image

Settings Page

Screenshot 2023-12-09 190108

S
Description
AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of advanced features, such as a settings page, low VRAM support, DeepSpeed, narrator, model finetuning, custom models,
Readme AGPL-3.0
94 MiB
0 Stars 1 Watchers 0 Forks
Languages
HTML 46.8%
Python 37.1%
JavaScript 9.9%
Batchfile 3%
Shell 2.4%
Other 0.8%