前提：当前提供 了8核64G的免费体验规格，每天三个小时限额
地址：https://console.huaweicloud.com/modelarts/?region=cn-north-4#/dashboard
下载模型：请参考另一个文章

创建环境（自带环境是pytorch1.8的，所以自己创建）conda info --envconda create --name pytorch2.0conda activate pytorch2.0安装必要的包conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidiaconda install pytorch torchvision torchaudio cpuonly -c pytorchconda update -n base -c defaults condaconda install transformers sentencepiecepip install rouge_chinese cpm_kernels运行代码from transformers import AutoTokenizer, AutoModeltokenizer = AutoTokenizer.from_pretrained("/home/ma-user/work/glm2/chatglm2-6b-int4", 
trust_remote_code=True)model = AutoModel.from_pretrained("/home/ma-user/work/glm2/chatglm2-6b-int4",trust_remote_code=True).cuda()model = AutoModel.from_pretrained("/home/ma-user/work/glm2/chatglm2-6b-int4",trust_remote_code=True).float()model = model.eval()response, history = model.chat(tokenizer, "晚上睡不着应该怎么办", history=[])print(response)