Commit Graph
5 Commits
Author SHA1 Message Date
IIEleven11 c6b7b39218 Merge branch 'erew123:alltalkbeta' into alltalkbeta 2024-08-06 23:01:58 -07:00
IIEleven11 44bd45a624 Fixed merge of vocab.json and new tokenizer for custom dataset
Fixed vocab.json merge, new tokenizer for custom dataset, dataset cleaner.
2024-08-02 21:40:23 -07:00
IIEleven11 9047dcb139 removed unecessary scripts and finetune.py edit 2024-08-01 00:07:46 -07:00
IIEleven11 7e2d3455d2 removed unecessary scripts and finetune.py edit 2024-08-01 00:05:42 -07:00
IIEleven11 d44d721d69 Tokenizer changes 2024-07-31 18:30:47 -07:00