4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
IIEleven11	44bd45a624	Fixed merge of vocab.json and new tokenizer for custom dataset ... Fixed vocab.json merge, new tokenizer for custom dataset, dataset cleaner.	2024-08-02 21:40:23 -07:00
IIEleven11	9047dcb139	removed unecessary scripts and finetune.py edit	2024-08-01 00:07:46 -07:00
IIEleven11	7e2d3455d2	removed unecessary scripts and finetune.py edit	2024-08-01 00:05:42 -07:00
IIEleven11	d44d721d69	Tokenizer changes	2024-07-31 18:30:47 -07:00