Merge pull request #155 from erew123/main

Pull from main to dev
2024-04-01 10:44:21 +01:00
commit 043648e24a
@@ -39,8 +39,16 @@ AllTalk is an updated version of the Coqui_tts extension for Text Generation web
 - 🔴 [Future to-do list & Upcoming updates](https://github.com/erew123/alltalk_tts?#-future-to-do-list)

 ---
-### 🛠️ **About this project** 
-AllTalk is a labour of love, developed and supported in my personal free time. As such, my ability to respond to support requests is limited. I prioritize issues based on their impact and the number of users affected. I appreciate your understanding and patience. If your inquiry isn't covered by the documentation or existing discussions, and it's not related to a bug or feature request, I'll do my best to assist as time allows.
+### 🛠️ **About this project & me** 
+AllTalk is a labour of love that has been developed, supported and sustained in my personal free time. As a solo enthusiast (not a business or team) my resources are inherently limited. This project has been one of my passions, but I must balance it with other commitments.
+
+To manage AllTalk sustainably, I prioritize support requests based on their overall impact and the number of users affected. I encourage you to utilize the comprehensive documentation and engage with the AllTalk community discussion area. These resources often provide immediate answers and foster a supportive user network.
+
+Should your inquiry extend beyond the documentation, especially if it concerns a bug or feature request, I assure you I’ll offer my best support as my schedule permits. However, please be prepared for varying response times, reflective of the personal dedication I bring to AllTalk. Your understanding and patience in this regard are greatly appreciated.
+
+It's important to note that **I am not** the developer of any TTS models utilized by AllTalk, nor do I claim to be an expert on them, including understanding all their nuances, issues, and quirks. For specific TTS model concerns, I’ve provided links to the original developers in the Help section for direct assistance.
+
+Thank you for your continued support and understanding. 

 ---

@@ -68,7 +76,7 @@ To set up AllTalk within Text-generation-webui, follow either method:
   - **Via Terminal/Console (Recommended)**:
     - `cd \text-generation-webui\extensions\`
     - `git clone https://github.com/erew123/alltalk_tts`
-   - **Via Releases Page**:
+   - **Via Releases Page (Cannot be automatically updated after install as its not linked to Github)**:
     - Download the latest `alltalk_tts.zip` from [Releases](https://github.com/erew123/alltalk_tts/releases) and extract it to `\text-generation-webui\extensions\alltalk_tts\`.

 2. **Start Python Environment**:
@@ -104,7 +112,7 @@ To perform a Standalone installation of AllTalk:
   - **Via Terminal/Console (Recommended)**:
     - Navigate to your preferred directory: `cd C:\myfiles\`
     - Clone the AllTalk repository: `git clone https://github.com/erew123/alltalk_tts`
-   - **Via Releases Page**:
+   - **Via Releases Page (Cannot be automatically updated after install as its not linked to Github)**:
     - Download `alltalk_tts.zip` from [Releases](https://github.com/erew123/alltalk_tts/releases) and extract it to your chosen directory, for example, `C:\myfiles\alltalk_tts\`.

 2. **Start AllTalk Setup**:
@@ -114,7 +122,7 @@ To perform a Standalone installation of AllTalk:
     - Linux: `./atsetup.sh`

 3. **Follow the Setup Prompts**:
-   - Comply with the on-screen instructions to install the required files. Verify AllTalk's functionality before proceeding with DeepSpeed installation.
+   - Select Standalone Installation and then Option 1 and follow any on-screen instructions to install the required files. DeepSpeed is automatically installed on **Windows** based system, but will only work on Nvidia GPU's. **Linux** based system users will have to follow the DeepSpeed installation instructions.

 > If you're unfamiliar with Python environments and wish to learn more, consider reviewing **Understanding Python Environments Simplified** in the Help section.

@@ -126,6 +134,14 @@ Refer to `🟩 Other installation notes` for further details, including informat

 ---

+### 🟩 Docker Builds and Google Colab's
+
+While an AllTalk Docker build exists, it's important to note that this version is based on an earlier iteration of AllTalk and was set up by a third party. At some point, my goal is to deepen my understanding of Docker and its compatibility with AllTalk. This exploration may lead to significant updates to AllTalk to ensure a seamless Docker experience. However, as of now, the Docker build should be considered a BETA version and isn't directly supported by me.
+
+As for Google Colab, there is partial compatibility with AllTalk, though with some quirks. I am currently investigating these issues and figuring out the necessary adjustments to enhance the integration. Until I can ensure a smooth experience, I won't be officially releasing any Google Colab implementations of AllTalk.
+
+---
+
 ### 🟩 Manual Installation - As part of Text generation web UI (inc. macOSX)
 <details>
 	<summary>MANUAL INSTALLATION - Text-Generation-webui</summary>
@@ -775,7 +791,69 @@ Also, is your text-generation-webui up to date? [instructions here](https://gith
 As far as I am aware, these are to do with the chrome browser the gradio text-generation-webui in some way. I raised an issue about this on the text-generation-webui [here](https://github.com/oobabooga/text-generation-webui/issues/4788) where you can see that AllTalk is not loaded and the messages persist. Either way, this is more a warning than an actual issue, so shouldnt affect any functionality of either AllTalk or text-generation-webui, they are more just an annoyance.
 </details>

-### Performance and Compatibility Issues
+### Startup, Performance and Compatibility Issues
+
+<details>
+	<summary>🟨 AllTalk is only loading into CPU, but I have an Nvidia GPU so it should be loading into CUDA</summary><br>
+	
+This is caused by Pytorch (Torch) not having the CUDA extensions installed (You can check by running the diagnostics). Typically this happens (on Standalone installations) because when the setup routine goes to install Pytorch with CUDA, it looks in the PIP cache and if a previous application has downloaded a version of Pytorch that **doesn't** have CUDA extensions, the PIP installer doesnt recognise this fact and just uses the cached version for installation. To resolve this:
+
+1) On the `atsetup` utility, on the `Standalone menu` select to `Purge the PIP cache`. This will remove cached packages from the PIP cache, meaning it will have to download fresh copies.
+2) As we need to force the upgrade to the Python environment, the easiest way to do this will be to use `atsetup` to `Delete AllTalk's custom Python environment`. This means it will have to rebuild the Python environment. **Note**, you may have to run this step twice, as it has to exit the current Python environment, then you have to re-load `atsetup` and select `Delete AllTalk's custom Python environment` again.
+3) You can now use `atsetup` to `Install AllTalk as a Standalone Application` which will download fresh copies of everything and re-install the Python environment. 
+4) Once this is done you can check if CUDA is now working with the diagnostics or starting AllTalk and checking the model loads into CUDA.
+
+</details>
+
+
+<details>
+	<summary>🟨 RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory</summary><br>
+	
+This error message is caused by the model being corrupted or damaged in some way. This error can occur if Huggingface, where the model is downloaded from, have an error (when the model is downloaded) or potentailly internet issues occuring while the model is downloaded on first start-up. 
+
+```
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory
+
+ERROR: Application startup failed. Exiting.
+[AllTalk Startup] Warning TTS Subprocess has NOT started up yet, Will keep trying for 120 seconds maximum. Please wait.
+```
+
+To resolve this, first look in your `alltalk_tts/models/xttsv2_2.0.2` (or whichever) model folder and confirm that the file sizes are correct.
+
+![image](https://github.com/erew123/screenshots/raw/main/modelsfiles.jpg)
+
+You can delete one or more suspect files and a factory fresh copy of that file or files will be downloaded on next start-up of AllTalk.
+
+</details>
+
+<details>
+	<summary>🟨 RuntimeError: Found no NVIDIA driver on your system.</summary><br>
+	
+This error message is caused by DeepSpeed being enabled when you do not have a Nvidia GPU. To resolve this, edit `confignew.json` and change `"deepspeed_activate": true,` to `"deepspeed_activate": false,` then restart AllTalk.
+
+```
+  File "C:\alltalk_tts\alltalk_environment\env\Lib\site-packages\torch\cuda\__init__.py", line 302, in _lazy_init
+    torch._C._cuda_init()
+RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
+
+ERROR:    Application startup failed. Exiting.
+[AllTalk Startup] Warning TTS Subprocess has NOT started up yet, Will keep trying for 120 seconds maximum. Please wait.
+```
+
+</details>
+
+<details>
+	<summary>🟨 raise RuntimeError("PyTorch version mismatch! DeepSpeed ops were compiled and installed.</summary><br>
+	
+This error message is caused by having DeepSpeed enabled, but you have a version of DeepSpeed installed that was compiled for a different version of Python, PyTorch or CUDA (or any mix of those). You will need to start your Python environment and run `pip uninstall deepspeed` to remove DeepSpeed from your Python environment and then install the correct version of DeepSpeed.
+
+```
+raise RuntimeError("PyTorch version mismatch! DeepSpeed ops were compiled and installed 
+RuntimeError: PyTorch version mismatch! DeepSpeed ops were compiled and installed with a different version than what is being used at runtime. Please re-install DeepSpeed or switch torch versions. Install torch version=2.1, Runtime torch version=2.2
+```
+
+</details>

 <details>
 	<summary>🟨 Warning TTS Subprocess has NOT started up yet, Will keep trying for 120 seconds maximum. Please wait. It times out after 120 seconds.</summary><br>
@@ -833,7 +911,7 @@ Depending on which of your Nvidia GPU's is the more powerful one, you can change
 <details>
 	<summary>🟨 Firefox - Streaming Audio doesnt work on Firefox</summary><br>
 	
-This is a long standing issue with Firefox and one I am unable to resolve. The solution is to use another web browser if you want to use Streaming audio. For details of my prior invesitigation please look at this [ticket](https://github.com/erew123/alltalk_tts/issues/143)
+This is a long standing issue with Mozilla & Firefox and one I am unable to resolve as Mozilla have not resolved the issue with Firefox. The solution is to use another web browser if you want to use Streaming audio. For details of my prior invesitigation please look at this [ticket](https://github.com/erew123/alltalk_tts/issues/143)
 </details>

 ### Application Specific Issues
@@ -1102,6 +1180,8 @@ You will be able to see the ID's and Text (orignal and as interpreted) by lookin

 The Analyze TTS feature uses the Whisper Larger-v2 AI engine, which will download on first use if necessary. This will require about 2.5GB's of disk space and could take a few minutes to download, depending on your internet connection.

+You can use this feature on systems that do not have an Nvidia GPU, however, unless you have a very powerful CPU, expect it to be slow.
+
 #### ⬜ Tricks to get the model to say things correctly
 Sometimes the AI model won’t say something the way that you want it to. It could be because it’s a new word, an acronym or just something it’s not good at for whatever reason. There are some tricks you can use to improve the chances of it saying something correctly.

@@ -383,14 +383,14 @@ echo     Downloading and installing PyTorch. This step can take a long time
 echo     depending on your internet connection and hard drive speed. Please
 echo     be patient.
 echo.
-pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --extra-index-url https://download.pytorch.org/whl/cu121
+pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --upgrade --force-reinstall --extra-index-url https://download.pytorch.org/whl/cu121
 echo Installing other requirements.
 echo.
 pip install -r system\requirements\requirements_standalone.txt
-curl -LO https://github.com/erew123/alltalk_tts/releases/download/DeepSpeed-12.7/deepspeed-0.12.7+d058d4b-cp311-cp311-win_amd64.whl
+curl -LO https://github.com/erew123/alltalk_tts/releases/download/DeepSpeed-14.0/deepspeed-0.14.0+ce78a63-cp311-cp311-win_amd64.whl
 echo Installing DeepSpeed...
-pip install deepspeed-0.12.7+d058d4b-cp311-cp311-win_amd64.whl
-del deepspeed-0.12.7+d058d4b-cp311-cp311-win_amd64.whl
+pip install deepspeed-0.14.0+ce78a63-cp311-cp311-win_amd64.whl
+del deepspeed-0.14.0+ce78a63-cp311-cp311-win_amd64.whl


@rem Create start_environment.bat to run AllTalk environment
@@ -524,14 +524,14 @@ echo     Downloading and installing PyTorch. This step can take a long time
 echo     depending on your internet connection and hard drive speed. Please
 echo     be patient.
 echo.
-pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --extra-index-url https://download.pytorch.org/whl/cu121
+pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --upgrade --force-reinstall --extra-index-url https://download.pytorch.org/whl/cu121
 echo Installing other requirements.
 echo.
 pip install -r system\requirements\requirements_standalone.txt
-curl -LO https://github.com/erew123/alltalk_tts/releases/download/DeepSpeed-12.7/deepspeed-0.12.7+d058d4b-cp311-cp311-win_amd64.whl
+curl -LO https://github.com/erew123/alltalk_tts/releases/download/DeepSpeed-14.0/deepspeed-0.14.0+ce78a63-cp311-cp311-win_amd64.whl
 echo Installing DeepSpeed...
-pip install deepspeed-0.12.7+d058d4b-cp311-cp311-win_amd64.whl
-del deepspeed-0.12.7+d058d4b-cp311-cp311-win_amd64.whl
+pip install deepspeed-0.14.0+ce78a63-cp311-cp311-win_amd64.whl
+del deepspeed-0.14.0+ce78a63-cp311-cp311-win_amd64.whl
 if %ERRORLEVEL% neq 0 (
    echo.
    echo    There was an error.
@@ -291,7 +291,7 @@ install_custom_standalone() {
    echo "    Downloading and installing PyTorch. This step can take a long time"
    echo "    depending on your internet connection and hard drive speed. Please"
    echo "    be patient."
-    pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --extra-index-url https://download.pytorch.org/whl/cu121
+    pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --upgrade --force-reinstall --extra-index-url https://download.pytorch.org/whl/cu1
    echo
    echo "    Installing additional requirements."
    echo
@@ -469,7 +469,7 @@ reapply_standalone() {
    echo "    Downloading and installing PyTorch. This step can take a long time"
    echo "    depending on your internet connection and hard drive speed. Please"
    echo "    be patient."
-    pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --extra-index-url https://download.pytorch.org/whl/cu121
+    pip install torch>=2.2.1+cu121 torchaudio>=2.2.1+cu121 --upgrade --force-reinstall --extra-index-url https://download.pytorch.org/whl/cu1
    echo
    echo "    Installing additional requirements."
    echo
@@ -0,0 +1,171 @@
+absl-py==2.1.0
+aiofiles==23.2.1
+aiohttp==3.9.3
+aiosignal==1.3.1
+altair==5.2.0
+annotated-types==0.6.0
+anyascii==0.3.2
+anyio==4.3.0
+attrs==23.2.0
+audioread==3.0.1
+av==11.0.0
+Babel==2.14.0
+bangla==0.0.2
+blinker==1.7.0
+blis==0.7.11
+bnnumerizer==0.0.2
+bnunicodenormalizer==0.1.6
+catalogue==2.0.10
+certifi==2024.2.2
+cffi==1.16.0
+charset-normalizer==3.3.2
+click==8.1.7
+cloudpathlib==0.16.0
+colorama==0.4.6
+coloredlogs==15.0.1
+confection==0.1.4
+contourpy==1.2.0
+coqpit==0.0.17
+ctranslate2==4.1.0
+cutlet==0.4.0
+cycler==0.12.1
+cymem==2.0.8
+Cython==3.0.9
+dateparser==1.1.8
+decorator==5.1.1
+docopt==0.6.2
+einops==0.7.0
+encodec==0.1.1
+fastapi==0.110.0
+faster-whisper==1.0.1
+ffmpy==0.3.2
+filelock==3.13.3
+Flask==3.0.2
+flatbuffers==24.3.25
+fonttools==4.50.0
+frozenlist==1.4.1
+fsspec==2024.3.1
+fugashi==1.3.1
+fuzzywuzzy>=0.18.0
+g2pkk==0.1.2
+gradio==3.50.2
+gradio_client==0.6.1
+grpcio==1.62.1
+gruut==2.2.3
+gruut-ipa==0.13.0
+gruut-lang-de==2.0.0
+gruut-lang-en==2.0.0
+gruut-lang-es==2.0.0
+gruut-lang-fr==2.0.2
+h11==0.14.0
+hangul-romanize==0.1.0
+httpcore==1.0.4
+httpx==0.27.0
+huggingface-hub==0.22.1
+humanfriendly==10.0
+idna==3.6
+importlib_metadata==7.1.0
+importlib_resources==6.4.0
+inflect==7.0.0
+itsdangerous==2.1.2
+jaconv==0.3.4
+jamo==0.4.1
+jieba==0.42.1
+Jinja2==3.1.3
+joblib==1.3.2
+jsonlines==1.2.0
+jsonschema==4.21.1
+jsonschema-specifications==2023.12.1
+kiwisolver==1.4.5
+langcodes==3.3.0
+lazy_loader==0.3
+librosa==0.10.1
+llvmlite==0.42.0
+Markdown==3.6
+MarkupSafe==2.1.5
+matplotlib==3.8.3
+mojimoji==0.0.13
+mpmath==1.3.0
+msgpack==1.0.8
+multidict==6.0.5
+murmurhash==1.0.10
+networkx==2.8.8
+nltk==3.8.1
+num2words==0.5.13
+numba==0.59.1
+numpy>=1.17.0,<1.29.0
+nvidia-cublas-cu11>=11.11.3.6
+nvidia-cudnn-cu11>=9.0.0.312
+onnxruntime==1.17.1
+orjson==3.9.15
+packaging==24.0
+pandas==1.5.3
+pillow==10.2.0
+platformdirs==4.2.0
+pooch==1.8.1
+preshed==3.0.9
+protobuf==5.26.0
+psutil==5.9.8
+pycparser==2.21
+pydantic==2.6.4
+pydantic_core==2.16.3
+pydub==0.25.1
+pynndescent==0.5.11
+pyparsing==3.1.2
+pypinyin==0.51.0
+pyreadline3==3.4.1
+pysbd==0.3.4
+python-crfsuite==0.9.10
+python-dateutil==2.9.0.post0
+python-Levenshtein>=0.25.0
+python-multipart==0.0.9
+pytz==2024.1
+PyYAML==6.0.1
+referencing==0.34.0
+regex==2023.12.25
+requests==2.31.0
+rpds-py==0.18.0
+safetensors==0.4.2
+scikit-learn==1.4.1.post1
+scipy==1.12.0
+semantic-version==2.10.0
+six==1.16.0
+smart-open==6.4.0
+sniffio==1.3.1
+sounddevice==0.4.6
+soundfile==0.12.1
+soxr==0.3.7
+spacy==3.7.4
+spacy-legacy==3.0.12
+spacy-loggers==1.0.5
+srsly==2.4.8
+starlette==0.36.3
+SudachiDict-core==20240109
+SudachiPy==0.6.8
+sympy==1.12
+tensorboard==2.16.2
+tensorboard-data-server==0.7.2
+thinc==8.2.3
+threadpoolctl==3.4.0
+tokenizers==0.15.2
+toolz==0.12.1
+torch>=2.2.0
+torchaudio>=2.2.0
+tqdm==4.66.2
+trainer==0.0.36
+transformers==4.39.1
+typer==0.9.4
+typing_extensions==4.10.0
+tzdata==2024.1
+tzlocal==5.2
+umap-learn==0.5.5
+Unidecode==1.3.8
+unidic-lite==1.0.8
+urllib3==2.2.1
+uvicorn==0.29.0
+wasabi==1.1.2
+weasel==0.3.4
+websockets==11.0.3
+Werkzeug==3.0.1
+yarl==1.9.4
+zipp==3.18.1