南京网络推广建站,京东网站建设评估,网络营销推广的三板斧,公司logo设计在线制作文章目录 准备阶段避坑阶段添加代码结果展示 准备阶段
配套软件包Ascend-cann-toolkit和Ascend-cann-nnae适配昇腾的Pytorch适配昇腾的Torchvision Adapter下载ChatGLM3代码下载chatglm3-6b模型#xff0c;或在modelscope里下载
避坑阶段
每个人的服务器都不一样#xff0… 文章目录 准备阶段避坑阶段添加代码结果展示 准备阶段
配套软件包Ascend-cann-toolkit和Ascend-cann-nnae适配昇腾的Pytorch适配昇腾的Torchvision Adapter下载ChatGLM3代码下载chatglm3-6b模型或在modelscope里下载
避坑阶段
每个人的服务器都不一样在ChatGLM3/issues中别人只需要修改指定驱动但是我的不行 删除模型文件包中的model.safetensors.index.json否则加载模型时会自动加载safetensors文件而不加载bin文件
/home/anaconda3/envs/sakura/lib/python3.9/site-packages/torch_npu/contrib/transfer_to_npu.py:124: RuntimeWarning: torch.jit.script will be disabled by transfer_to_npu, which currently does not support it, if you need to enable torch.jit.script, please do not use transfer_to_npu.warnings.warn(msg, RuntimeWarning)
Loading checkpoint shards: 0%| | 0/7 [00:00?, ?it/s]
Traceback (most recent call last):File /home/HwHiAiUser/work/ChatGLM3/basic_demo/cli_demo.py, line 22, in modulemodel AutoModel.from_pretrained(MODEL_PATH, trust_remote_codeTrue).npu().eval()File /home/anaconda3/envs/sakura/lib/python3.9/site-packages/transformers/models/auto/auto_factory.py, line 558, in from_pretrainedreturn model_class.from_pretrained(File /home/anaconda3/envs/sakura/lib/python3.9/site-packages/transformers/modeling_utils.py, line 3187, in from_pretrained) cls._load_pretrained_model(File /home/anaconda3/envs/sakura/lib/python3.9/site-packages/transformers/modeling_utils.py, line 3560, in _load_pretrained_modelstate_dict load_state_dict(shard_file)File /home/anaconda3/envs/sakura/lib/python3.9/site-packages/transformers/modeling_utils.py, line 467, in load_state_dictwith safe_open(checkpoint_file, frameworkpt) as f:
FileNotFoundError: No such file or directory: /home/HwHiAiUser/models/chatglm3-6b/model-00001-of-00007.safetensors
/home/anaconda3/envs/sakura/lib/python3.9/tempfile.py:817: ResourceWarning: Implicitly cleaning up TemporaryDirectory /tmp/tmp1ygjyx3i_warnings.warn(warn_message, ResourceWarning)添加代码
找到ChatGLM3/basic_demo/cli_demo.py 添加以下代码
import torch
import torch_npu
import torchvision
import torchvision_npu
from torch_npu.contrib import transfer_to_npu
import os
import platform
import time
torch_device npu:3 # 0~7
torch.npu.set_device(torch.device(torch_device))
torch.npu.set_compile_mode(jit_compileFalse)
option {}
option[NPU_FUZZY_COMPILE_BLACKLIST] Tril
torch.npu.set_option(option)
print(torch torch_npu import successfully)模型加载部分修改为
model AutoModel.from_pretrained(MODEL_PATH, trust_remote_codeTrue).npu().eval()结果展示
