name | about | labels |
---|---|---|
Bug Report | Use this template for reporting a bug | kind/bug |
mindie请求do_sample=true,tok不配置,mindie报错,服务退出
报错如下:
[Model] >>> Exception:top_k
has to be a strictly positive integer, but is 0
Traceback (most recent call last):
File "/usr/local/python3.9.5/lib/python3.9/site-packages/model_wrapper/standard_model.py", line 47, in generate
request_tokens_np, eos_np = self.model.handle_requests(requests, is_prefill)
File "/usr/local/python3.9.5/lib/python3.9/site-packages/model_wrapper/utils/mf_wrapper.py", line 241, in handle_requests
tokens, eos_np = self.generate_token(requests, block_tables, is_prefill, metadata)
File "/usr/local/python3.9.5/lib/python3.9/site-packages/model_wrapper/utils/mf_wrapper.py", line 212, in generate_token
next_tokens, _ = self.model_runner.forward(input_ids=input_ids,
File "/home/jenkins0/ya/mindformers-dev/mindformers/model_runner.py", line 190, in forward
logits_warper = self.model.get_logits_warper(self.generation_config)
File "/home/jenkins0/ya/mindformers-dev/mindformers/generation/text_generator.py", line 238, in get_logits_warper
warpers.append(TopKLogitsWarper(top_k=generation_config.top_k, min_tokens_to_keep=min_tokens_to_keep))
File "/home/jenkins0/ya/mindformers-dev/mindformers/generation/logits_process.py", line 214, in init
raise ValueError(
ValueError: top_k
has to be a strictly positive integer, but is 0
Ascend
/GPU
/CPU
) / 硬件环境:Please delete the backend not involved / 请删除不涉及的后端:
/device ascend 910b3
Software Environment / 软件环境 (Mandatory / 必填):
-- MindSpore version (e.g., 1.7.0.Bxxx) :mindspore 2.3.0 .B521
-- Python version (e.g., Python 3.7.5) :
-- OS platform and distribution (e.g., Linux Ubuntu 16.04):
-- GCC/Compiler version (if compiled from source):
Excute Mode / 执行模式 (Mandatory / 必填)(PyNative
/Graph
):
Please delete the mode not involved / 请删除不涉及的模式:
/mode pynative
/mode graph
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。
感谢您的提问,您可以评论//mindspore-assistant更快获取帮助:
登录 后才可以发表评论