LLM-Research

Colab notebooks and experimental code related to personal researches on Large Language Models.

Name		Name	Last commit message	Last commit date
Latest commit History 113 Commits
tools		tools
zh_tw_pythia		zh_tw_pythia
.gitignore		.gitignore
LM_Tokenizer_Traditional_Chinese_Support_Comparison.ipynb		LM_Tokenizer_Traditional_Chinese_Support_Comparison.ipynb
List_Transformers_Causal_LM_Model_Modules.ipynb		List_Transformers_Causal_LM_Model_Modules.ipynb
MLQA_Dataset_Converter_(en_zh_tw).ipynb		MLQA_Dataset_Converter_(en_zh_tw).ipynb
Minimal_Example_Fine_tuning_a_Transformers_Causal_LM.ipynb		Minimal_Example_Fine_tuning_a_Transformers_Causal_LM.ipynb
README.md		README.md
ShareGPT_Dataset_Processing.ipynb		ShareGPT_Dataset_Processing.ipynb
TW_Pythia_Embedding_Similarity.ipynb		TW_Pythia_Embedding_Similarity.ipynb
Transformers_Tokenizer_For_Training_Study.ipynb		Transformers_Tokenizer_For_Training_Study.ipynb
Very_Minimal_Example_Fine_tuning_a_Transformers_Causal_LM.ipynb		Very_Minimal_Example_Fine_tuning_a_Transformers_Causal_LM.ipynb
Wikipedia_Random_Page_Summaries_Dataset_Generator.ipynb		Wikipedia_Random_Page_Summaries_Dataset_Generator.ipynb

Provide feedback