1 Star 0 Fork 1

modelee / aragpt2-base

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
config.json 843 Bytes
一键复制 编辑 原始数据 按行查看 历史
aubmindlab 提交于 2021-01-01 11:56 . Added model files
{
"activation_function": "gelu_new",
"architectures": [
"GPT2LMHeadModel"
],
"attn_pdrop": 0.1,
"bos_token_id": 0,
"embd_pdrop": 0.1,
"eos_token_id": 0,
"gradient_checkpointing": false,
"initializer_range": 0.02,
"layer_norm_epsilon": 1e-05,
"model_type": "gpt2",
"n_ctx": 1024,
"n_embd": 768,
"n_head": 12,
"n_inner": null,
"n_layer": 12,
"n_positions": 1024,
"resid_pdrop": 0.1,
"summary_activation": null,
"summary_first_dropout": 0.1,
"summary_proj_to_labels": true,
"summary_type": "cls_index",
"summary_use_proj": true,
"task_specific_params": {
"text-generation": {
"do_sample": true,
"max_length": 50,
"num_beams": 5,
"top_p": 0.95,
"repetition_penalty": 3.0,
"no_repeat_ngram_size": 3
}
},
"use_cache": true,
"vocab_size": 64000
}
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/modelee/aragpt2-base.git
git@gitee.com:modelee/aragpt2-base.git
modelee
aragpt2-base
aragpt2-base
main

搜索帮助

344bd9b3 5694891 D2dac590 5694891