Describe the current behavior / 问题描述 (Mandatory / 必填)

模型仓库地址：https://gitee.com/mindspore/mindformers/blob/dev/research/baichuan2/baichuan2.md

Environment / 环境信息 (Mandatory / 必填)

• Hardware Environment(Ascend/GPU/CPU) / 硬件环境:

Please delete the backend not involved / 请删除不涉及的后端:
/device ascend/GPU/CPU/kirin/等其他芯片

• Software Environment / 软件环境 (Mandatory / 必填):
  -- MindSpore version (e.g., 2.2.11) :
  -- Python version (e.g., Python 3.9.19) :
  -- OS platform and distribution (e.g., eulerosv2r10.aarch64 ):
  -- GCC/Compiler version (if compiled from source):

• Excute Mode / 执行模式 (Mandatory / 必填)(PyNative/Graph):

Please delete the mode not involved / 请删除不涉及的模式:
/mode graph

Related testcase / 关联用例 (Mandatory / 必填)

用例：belle_chat_ramdon_10k.json数据集
Baichuan2-7B-Base
Baichuan2-7B-Chat
Baichuan2-13B-Base
Baichuan2-13B-Chat

Steps to reproduce the issue / 重现步骤 (Mandatory / 必填)

1. get code from mindformers
2. cd mindformers/reserach
3. 修改配置文件中的权重、数据集路径
4. bash run_singlenode.sh
   "python baichuan2/run_baichuan2.py
   --config baichuan2/run_baichuan2_7b_910b.yaml
   --load_checkpoint /data1/tff/mindformers_update/research/baichuan2/model_dir/rank_0/Baichuan2_7B_Chat.ckpt
   --auto_trans_ckpt True
   --use_parallel True
   --run_mode finetune
   --train_data /data1/tff/mindformers_update/research/baichuan2"
   /data1/tff/mindformers_update/rank_table_8.json [0,8] 8
5. 验证网络是否训练成功
6. 验证网络编译时间是否达标

Describe the expected behavior / 预期结果 (Mandatory / 必填)

网络训练成功，编译时间达标

Related log / screenshot / 日志 / 截图 (Mandatory / 必填)

Special notes for this issue/备注 (Optional / 选填)