1 Star 0 Fork 0

modelee/xtremedistil-l12-h384-uncased

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
config.json 527 Bytes
一键复制 编辑 原始数据 按行查看 历史
subho 提交于 2021-06-07 20:19 . adding xtremedistil-l12-h384-uncased
{
"_name_or_path": ".",
"architectures": [
"BertModel"
],
"attention_probs_dropout_prob": 0.1,
"gradient_checkpointing": false,
"hidden_act": "gelu",
"hidden_dropout_prob": 0.1,
"hidden_size": 384,
"initializer_range": 0.02,
"intermediate_size": 1536,
"layer_norm_eps": 1e-12,
"max_position_embeddings": 512,
"model_type": "bert",
"num_attention_heads": 12,
"num_hidden_layers": 12,
"pad_token_id": 0,
"position_embedding_type": "absolute",
"type_vocab_size": 2,
"vocab_size": 30522
}
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/modelee/xtremedistil-l12-h384-uncased.git
git@gitee.com:modelee/xtremedistil-l12-h384-uncased.git
modelee
xtremedistil-l12-h384-uncased
xtremedistil-l12-h384-uncased
main

搜索帮助