From 48a02da11d8822c4fdd6a421e729bf6c6a6c16df Mon Sep 17 00:00:00 2001 From: erew123 <35898566+erew123@users.noreply.github.com> Date: Sun, 17 Dec 2023 12:18:57 +0000 Subject: [PATCH] Update README.md --- README.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 38da3e5..c9feaa8 100644 --- a/README.md +++ b/README.md @@ -203,23 +203,23 @@ DeepSpeed Version 11.2 with CUDA 11.8 or 12.1 - Installation Instructions: If you are using the **text-generation-webui** python environment, then in the `text-generation-webui` folder you will run `cmd_windows.bat` to start the python evnironment.
5. Launch the Command Prompt cmd with Administrator privilege as it requires admin to allow creating symlink folders. -6. Install PyTorch, 2.1.0 with CUDA 12.1 into your Python 3.11 environment e.g:

+6. Install PyTorch, 2.1.0 with CUDA 11.8 or 12.1 into your Python 3.1x.x environment e.g:

```activate pythonenv``` (activate your python environment)
```conda install pytorch==2.1.0 torchvision==0.16.0 torchaudio==2.1.0 pytorch-cuda=12.1 -c pytorch -c nvidia```
or
```conda install pytorch==2.1.0 torchvision==0.16.0 torchaudio==2.1.0 pytorch-cuda=11.8 -c pytorch -c nvidia```
-7. Edit your Windows environment variables to ensure that CUDA_HOME and CUDA_PATH are set to your Nvidia Cuda Toolkit path. (The folder above the bin folder that nvcc.exe is installed in). Examples are:

+7. Set your CUDA Windows environment variables in the command prompt to ensure that CUDA_HOME and CUDA_PATH are set to your Nvidia Cuda Toolkit path. (The folder above the bin folder that nvcc.exe is installed in). Examples are:

```set CUDA_HOME=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.1```
```set CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.1```
-rr
+or
```set CUDA_HOME=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8```
```set CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8```
-8. Navigate to your deepspeed folder in the Command Prompt:

-```cd c:\deepspeed``` (wherever you extracted it to) +8. Navigate to wherever you extracted the deepspeed folder in the Command Prompt:

+```cd c:\DeepSpeed-0.11.2``` (wherever you extracted it to) 9. Modify the following files:
-**(These modified files are included in the git-pull of AllTalk, in the DeepSpeed Windows folder but if you want to modify them yourself, please follow the below)**
+**(These modified files are included in the git-pull of AllTalk, in the DeepSpeed Windows folder and so can just be copied over the top of the exsting folders/files, but if you want to modify them yourself, please follow the below)**
deepspeed-0.11.2/build_win.bat** - at the top of the file, add:

```set DS_BUILD_EVOFORMER_ATTN=0```