GlmStateVisualization

A object to visualize hidden state of chatglm3 model.

Preparing

Make sure your chatglm3-6b model is correctly prepared.
Copy file THUDM\chatglm3-6b\config.json and THUDM\chatglm3-6b\modeling_chatglm_hid_save.py to your chatglm3 model path (which seems like E:\github_project\ChatGLM3\THUDM\chatglm3-6b), this will cause two original files to be overwritten.

Name		Name	Last commit message	Last commit date
Latest commit History 22 Commits
THUDM/chatglm3-6b		THUDM/chatglm3-6b
Taotie @ fa821ff		Taotie @ fa821ff
__pycache__		__pycache__
datas		datas
dialogues		dialogues
.gitignore		.gitignore
.gitmodules		.gitmodules
README.md		README.md
config_parse.py		config_parse.py
data_fetch.py		data_fetch.py
data_visual_analyse.ipynb		data_visual_analyse.ipynb
data_visual_analyse_combine.ipynb		data_visual_analyse_combine.ipynb
data_visual_analyse_counter.ipynb		data_visual_analyse_counter.ipynb
data_visual_analyse_llama.ipynb		data_visual_analyse_llama.ipynb
dataset_test.ipynb		dataset_test.ipynb
mmlu1.py		mmlu1.py
visual_config copy.json		visual_config copy.json
visual_config.json		visual_config.json
visual_logger.py		visual_logger.py