Commit Graph
52 Commits
Author SHA1 Message Date
Azalea Gui 0c6e113aff [F] Fix #251: Expected a value of type 'str' 2024-11-28 22:19:44 -05:00
erew123 af29b1ed75 Added "hi" hindi language
I believe the tokenizers now support Hindi, but don't know for sure. Will require the XTTS 2.0.3 model. Anything earlier doesn't support Hindi.
2024-11-27 05:11:01 +00:00
erew123 87cb4e2754 Correct Finetune CSS 2024-11-22 19:41:35 +00:00
erew123 ac24e5fc9a Added debugging to Training section 2024-11-17 04:38:46 +00:00
erew123 9a2b4309a5 Custom dataset - ensure lang set
When using custom datasets that are not built within finetune, ensure lang.txt is read correctly.
2024-11-16 23:51:56 +00:00
erew123 80dd102da8 Fix Dataset Validation when no errors found
Fixes an issue where the dataframe errors if no transcription errors found.
Added debugging option for dataset validation
2024-11-16 15:49:41 +00:00
erew123 adc9bb8cc6 Lint clean & documentation
Cleaned finetune lint
Moved documentation out
Moved metrics logger
2024-11-16 05:09:48 +00:00
erew123 5c4726de96 New Finetune
added subprocess
2024-11-15 00:38:43 +00:00
erew123 1bd8f6aed9 New Finetune for XTTS
Interface cleaned
Documentation improved & expanded
Dataset generation improved:
- Better VAD detection
- Better debugging/information
- Better editing/managing transcriptions
- Basic audio editing
- Re-transcription on detections of duplicate audio when splitting large files.
- Control over model precision fp16/fp32/mixed
- Migrate to openai-whisper (also saving 1.5GB on installation requirements for cublas)
Testing stage allows you to choose what minimum length audio
Model export exports all audio with text file descriptions of too long/too short
Misc other improvements too numerous to mention
2024-11-15 00:21:40 +00:00
erew123 51e0b21682 Improvements Dataset Management & Wav files.
Logging and console/terminal output may need some work correcting in future,
2024-11-10 17:25:02 +00:00
erew123 bb314fa60d minor additions
Close GPTTrainerConfig( on line 965
analytics_enabled=False for Gradio (stop it complaining about new versions of Gradio)
demo.queue().launch( line 2387 to launch Gradio.
2024-10-20 07:26:30 +01:00
IIEleven11 2e56cc91f3 Merge branch 'erew123:alltalkbeta' into alltalkbeta 2024-09-19 20:52:40 -07:00
erew123 d76b6c2903 Remove continue training 2024-08-28 12:48:27 +01:00
IIEleven11 8b373d50dc Merge branch 'erew123:alltalkbeta' into alltalkbeta 2024-08-09 00:18:24 -07:00
Bryant21 98d4d4fd25 BUGFIX: Exporting Model after Restart 2024-08-07 23:38:41 -04:00
IIEleven11 c6b7b39218 Merge branch 'erew123:alltalkbeta' into alltalkbeta 2024-08-06 23:01:58 -07:00
erew123 2560c29771 Updated dropdown size after Distil added 2024-08-04 18:54:06 +01:00
Bryant21 6b43c40a8c Update finetune.py 2024-08-04 13:33:53 -04:00
Bryant21 94c9257dee change default to distil 2024-08-04 13:27:42 -04:00
Bryant21 eaf38309a2 Update finetune.py 2024-08-04 13:22:51 -04:00
IIEleven11 44bd45a624 Fixed merge of vocab.json and new tokenizer for custom dataset
Fixed vocab.json merge, new tokenizer for custom dataset, dataset cleaner.
2024-08-02 21:40:23 -07:00
IIEleven11 9047dcb139 removed unecessary scripts and finetune.py edit 2024-08-01 00:07:46 -07:00
IIEleven11 7e2d3455d2 removed unecessary scripts and finetune.py edit 2024-08-01 00:05:42 -07:00
IIEleven11 d44d721d69 Tokenizer changes 2024-07-31 18:30:47 -07:00
erew123 21064be53a Update finetune.py 2024-07-21 18:10:56 +01:00
erew123 c03ab37dd2 Finetune - Allow number of workers selection 2024-07-21 17:31:52 +01:00
bmalaski e347f15046 add warmup 2024-07-02 00:14:54 -04:00
erew123 797a4b996a Update finetune.py 2024-07-01 08:32:56 +01:00
bmalaski e081442bf3 Update finetune.py 2024-06-25 15:49:20 -04:00
bmalaski a97ad658c1 ported changes form original branch 2024-06-20 22:54:57 -04:00
erew123 50f335255e Data validation/missing files printout @ console 2024-06-13 10:38:23 +01:00
erew123 af97384003 Changed a bit of documentation. 2024-06-12 15:21:23 +01:00
erew123 2a87d2d662 Updated numbering, added validation
Updated the numbering of generated wav's so they match within the CSV files.
Added a dataset validation option to compare the Whisper generated wav files vs the transcribed text in the CSV files. This is purely to point you in the direction of data that may need changing/editing within your training dataset.
2024-06-12 11:01:06 +01:00
erew123 af0bb11c4e Path normalisation when splitting files 2024-06-10 21:47:01 +01:00
erew123 98a74e9625 Add files via upload 2024-06-06 21:12:17 +01:00
erew123 3c123d3678 Delete finetune.py 2024-06-06 15:26:43 +01:00
erew123 a075495a0a Large Update
TTS Generator - Various interface bugs & filtering options cleaned up.
TTS Generator - TTSDiff now scans generated text and TTS for errors.
TTS Generator - TTSSRT now creates subtitle files for video production e.g. a Youtube video.
Finetune - Now uses a customised tokenizer to deal with Japanese.
Finetune - Pre flight check and warning messages.
Finetune - Extra documentation and warnings.
Entire file structure has been re-organised to simplify management and future changes.
Documentation (built in and Github) has been rewritten/tidied up.
Requirements files have been cleaned up and simplified.
ATsetup has been re-written as necessary with additional options.
DeepSpeed moved up to version 14.
Standalone Application moved to PyTorch 2.2.1.
Nvidia CUDA Toolkit installation is NO LONGER needed (other than to compile DeepSpeed on Linux)

Tested on Linux and Windows.
2024-03-28 21:49:33 +00:00
erew123 66dadbca25 Finetune - further tidy up
Amended instructions.
Tidied up Pre-Flight check.
Added  dropdowns refresh button for step 3.
2024-03-25 14:09:35 +00:00
erew123 a579c5e6d2 Additional checks, documentation & tokenizer
Added warnings if PFC is not passed.
Added a custom tokenizer to better handle Japanese.
2024-03-16 11:14:07 +00:00
erew123 7b03804f9e Finetune updated
Now uses TTS 0.22.0
Pre-flight check system & help documentation.
Cleaned up the interface a little
More yet to do re documentation.
2024-03-16 02:34:17 +00:00
erew123 49f98033b3 Added a few extra notes to instructions 2024-03-13 20:15:40 +00:00
erew123 86c64fc9ba Documentation & Japanese support
Improved some areas of the documentation to clarify some issues.
Dropped worker threads down ONLY when Japanese is used, due to limitations of the translation.
2024-03-10 15:17:31 +00:00
johnbenac 1f7842ef5a Made compatible with older GPUs (1070) 2024-03-09 20:42:01 -05:00
erew123 a91a83268f eval % option 2024-01-15 23:55:54 +00:00
erew123 5210d075c1 added an additional note to finetune. 2024-01-13 00:31:14 +00:00
erew123 b32df6ac15 Additional note in finetune re multiple GPU support 2023-12-30 14:45:42 +00:00
erew123 c128d0851b Updated Finetune 2023-12-30 14:00:36 +00:00
erew123 8d80151889 New version of Finetune
Simplified the final stages of finetuning.
Added model compaction. 
Added cleaning routines to tidy up after training.
2023-12-28 18:36:51 +00:00
erew123 993d065368 Few minor updates
Couple of documentation spelling mistakes
Set environment variable
2023-12-24 18:01:27 +00:00
erew123 2b175b13c4 update to find mp3 and flac
Forgot it was only looking for wav's!
2023-12-24 15:56:44 +00:00