模型下载网站：https://www.opencsg.com/models

安装git：

sudo apt install git

安装git-lfs，这个很重要。

sudo apt-get install git-lfs

下载模型：THUDM/chatglm2-6b

mkdir THUDM
cd THUDMgit lfs intsall
git clone https://portal.opencsg.com/models/THUDM/chatglm2-6b.git

安装依赖：https://www.opencsg.com/models/THUDM/chatglm2-6b

pip install -i https://pypi.tuna.tsinghua.edu.cn/simple protobuf       
pip install -i https://pypi.tuna.tsinghua.edu.cn/simple transformers==4.30.2
pip install -i https://pypi.tuna.tsinghua.edu.cn/simple cpm_kernels
pip install -i https://pypi.tuna.tsinghua.edu.cn/simple torch
pip install -i https://pypi.tuna.tsinghua.edu.cn/simple gradio
pip install -i https://pypi.tuna.tsinghua.edu.cn/simple mdtex2html
pip install -i https://pypi.tuna.tsinghua.edu.cn/simple sentencepiece
pip install -i https://pypi.tuna.tsinghua.edu.cn/simple accelerate

接着，创建c01_token.py，填写如下代码进行测试：

from transformers import AutoTokenizer, AutoModeltokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm2-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("THUDM/chatglm2-6b", trust_remote_code=True).half().cuda()
model = model.eval()response, history = model.chat(tokenizer, "你好", history=[])
print(response)response, history = model.chat(tokenizer, "晚上睡不着应该怎么办", history=history)
print(response)