name | about | labels |
---|---|---|
Bug Report | Use this template for reporting a bug | kind/bug |
[r2.3][qwen_7b/14b][910B3 8P]网络训练失败,ValueError: Can't find class type optimizer class name AdamWeightDecayX in class registry
模型仓地址:https://gitee.com/mindspore/mindformers/blob/dev/research/qwen/qwen.md
Ascend
/GPU
/CPU
) / 硬件环境:Please delete the backend not involved / 请删除不涉及的后端:
/device ascend/
CANN版本:MILAN-Florence-ASL/ABL V100R001C17SPC001B240 Alpha
Mindspore版本:MindSpore_r2.3_d51c17c7(MindSporeDaily)
MindFormers版本:MindFormers_dev_a4fc9e6d(MindFormersDaily)
PyNative
/Graph
):Please delete the mode not involved / 请删除不涉及的模式:
/mode graph
用例仓地址:MindFormers_Test/cases/qwen/14b/train/
用例:
test_mf_qwen_14b_train_infer_alpaca_8p_0001
test_mf_qwen_7b_train_infer_alpaca_8p_0001
网络训练成功,编译时间达标
Traceback (most recent call last):
File "./qwen/run_qwen.py", line 200, in <module>
paged_attention=args.paged_attention)
File "./qwen/run_qwen.py", line 122, in main
trainer.finetune(finetune_checkpoint=ckpt, auto_trans_ckpt=auto_trans_ckpt)
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindspore/_checkparam.py", line 1372, in wrapper
return func(*args, **kwargs)
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/trainer/trainer.py", line 521, in finetune
is_full_config=True)
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/trainer/causal_language_modeling/causal_language_modeling.py", line 120, in train
**kwargs)
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/trainer/base_trainer.py", line 681, in training_process
optimizer = self.create_optimizer_scheduler(network, layer_scale=config.layer_scale)
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/trainer/base_trainer.py", line 446, in create_optimizer_scheduler
"learning_rate": lr_schedule})
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/core/optim/build_optim.py", line 68, in build_optim
config, MindFormerModuleType.OPTIMIZER, default_args=default_args)
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/tools/register/register.py", line 184, in get_instance_from_cfg
obj_cls = cls.get_cls(module_type, obj_type)
File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/tools/register/register.py", line 141, in get_cls
in class registry".format(module_type, class_name))
ValueError: Can't find class type optimizer class name AdamWeightDecayX in class registry
走给李洋
Please assign maintainer to check this issue.
请为此issue分配处理人。
@sunjiawei999
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。
感谢您的提问,您可以评论//mindspore-assistant更快获取帮助:
问题根因:run_qwen.py未引入新的优化器依赖,配置文件优化器默认给的新优化器
回归版本:
r2.3构建版本
编译时间:2024-4-19
回归步骤:参考issue复现步骤
基本功能:问题解决
测试结论:回归通过
回归人员:孙佳伟
回归时间:2024-4-19
登录 后才可以发表评论