Commit Graph
39 Commits
Author SHA1 Message Date
IIEleven11 8b373d50dc Merge branch 'erew123:alltalkbeta' into alltalkbeta 2024-08-09 00:18:24 -07:00
Bryant21 98d4d4fd25 BUGFIX: Exporting Model after Restart 2024-08-07 23:38:41 -04:00
IIEleven11 c6b7b39218 Merge branch 'erew123:alltalkbeta' into alltalkbeta 2024-08-06 23:01:58 -07:00
erew123 2560c29771 Updated dropdown size after Distil added 2024-08-04 18:54:06 +01:00
Bryant21 6b43c40a8c Update finetune.py 2024-08-04 13:33:53 -04:00
Bryant21 94c9257dee change default to distil 2024-08-04 13:27:42 -04:00
Bryant21 eaf38309a2 Update finetune.py 2024-08-04 13:22:51 -04:00
IIEleven11 44bd45a624 Fixed merge of vocab.json and new tokenizer for custom dataset
Fixed vocab.json merge, new tokenizer for custom dataset, dataset cleaner.
2024-08-02 21:40:23 -07:00
IIEleven11 9047dcb139 removed unecessary scripts and finetune.py edit 2024-08-01 00:07:46 -07:00
IIEleven11 7e2d3455d2 removed unecessary scripts and finetune.py edit 2024-08-01 00:05:42 -07:00
IIEleven11 d44d721d69 Tokenizer changes 2024-07-31 18:30:47 -07:00
erew123 21064be53a Update finetune.py 2024-07-21 18:10:56 +01:00
erew123 c03ab37dd2 Finetune - Allow number of workers selection 2024-07-21 17:31:52 +01:00
bmalaski e347f15046 add warmup 2024-07-02 00:14:54 -04:00
erew123 797a4b996a Update finetune.py 2024-07-01 08:32:56 +01:00
bmalaski e081442bf3 Update finetune.py 2024-06-25 15:49:20 -04:00
bmalaski a97ad658c1 ported changes form original branch 2024-06-20 22:54:57 -04:00
erew123 50f335255e Data validation/missing files printout @ console 2024-06-13 10:38:23 +01:00
erew123 af97384003 Changed a bit of documentation. 2024-06-12 15:21:23 +01:00
erew123 2a87d2d662 Updated numbering, added validation
Updated the numbering of generated wav's so they match within the CSV files.
Added a dataset validation option to compare the Whisper generated wav files vs the transcribed text in the CSV files. This is purely to point you in the direction of data that may need changing/editing within your training dataset.
2024-06-12 11:01:06 +01:00
erew123 af0bb11c4e Path normalisation when splitting files 2024-06-10 21:47:01 +01:00
erew123 98a74e9625 Add files via upload 2024-06-06 21:12:17 +01:00
erew123 3c123d3678 Delete finetune.py 2024-06-06 15:26:43 +01:00
erew123 a075495a0a Large Update
TTS Generator - Various interface bugs & filtering options cleaned up.
TTS Generator - TTSDiff now scans generated text and TTS for errors.
TTS Generator - TTSSRT now creates subtitle files for video production e.g. a Youtube video.
Finetune - Now uses a customised tokenizer to deal with Japanese.
Finetune - Pre flight check and warning messages.
Finetune - Extra documentation and warnings.
Entire file structure has been re-organised to simplify management and future changes.
Documentation (built in and Github) has been rewritten/tidied up.
Requirements files have been cleaned up and simplified.
ATsetup has been re-written as necessary with additional options.
DeepSpeed moved up to version 14.
Standalone Application moved to PyTorch 2.2.1.
Nvidia CUDA Toolkit installation is NO LONGER needed (other than to compile DeepSpeed on Linux)

Tested on Linux and Windows.
2024-03-28 21:49:33 +00:00
erew123 66dadbca25 Finetune - further tidy up
Amended instructions.
Tidied up Pre-Flight check.
Added  dropdowns refresh button for step 3.
2024-03-25 14:09:35 +00:00
erew123 a579c5e6d2 Additional checks, documentation & tokenizer
Added warnings if PFC is not passed.
Added a custom tokenizer to better handle Japanese.
2024-03-16 11:14:07 +00:00
erew123 7b03804f9e Finetune updated
Now uses TTS 0.22.0
Pre-flight check system & help documentation.
Cleaned up the interface a little
More yet to do re documentation.
2024-03-16 02:34:17 +00:00
erew123 49f98033b3 Added a few extra notes to instructions 2024-03-13 20:15:40 +00:00
erew123 86c64fc9ba Documentation & Japanese support
Improved some areas of the documentation to clarify some issues.
Dropped worker threads down ONLY when Japanese is used, due to limitations of the translation.
2024-03-10 15:17:31 +00:00
johnbenac 1f7842ef5a Made compatible with older GPUs (1070) 2024-03-09 20:42:01 -05:00
erew123 a91a83268f eval % option 2024-01-15 23:55:54 +00:00
erew123 5210d075c1 added an additional note to finetune. 2024-01-13 00:31:14 +00:00
erew123 b32df6ac15 Additional note in finetune re multiple GPU support 2023-12-30 14:45:42 +00:00
erew123 c128d0851b Updated Finetune 2023-12-30 14:00:36 +00:00
erew123 8d80151889 New version of Finetune
Simplified the final stages of finetuning.
Added model compaction. 
Added cleaning routines to tidy up after training.
2023-12-28 18:36:51 +00:00
erew123 993d065368 Few minor updates
Couple of documentation spelling mistakes
Set environment variable
2023-12-24 18:01:27 +00:00
erew123 2b175b13c4 update to find mp3 and flac
Forgot it was only looking for wav's!
2023-12-24 15:56:44 +00:00
erew123 fae15eecb1 minor spelling mistake
updating minor spelling mistake.
2023-12-24 12:54:08 +00:00
erew123 d26909a1d6 All the updates for Finetuning
Additional files to download
Updated documentation
Updated requirements files
2023-12-24 12:32:10 +00:00