下载好OpenCompassData-core-20231110.zip 之后,解压压缩包
unzip OpenCompassData-core-20231110.zip
运行代码:
python run.py --datasets ceval_gen
--hf-path /hy-tmp/7B21/merged
--tokenizer-path /hy-tmp/7B21/merged
--tokenizer-kwargs padding_side='left' truncation='left' trust_remote_code=True
--model-kwargs trust_remote_code=True device_map='auto'
--max-seq-len 1024
--max-out-len 16
--batch-size 2
--num-gpus 1
--debug
运行结果: