代码拉取完成,页面将自动刷新
同步操作将从 kevwan/go-stash 强制同步,此操作会覆盖自 Fork 仓库以来所做的任何修改,且无法恢复!!!
确定后同步将在后台操作,完成时将刷新页面,请耐心等待。
English | 简体中文
go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch.
go-stash is about 4x throughput more than logstash, and easy to deploy, only one executable file.
gostash -f etc/config.yaml
config.yaml example as below:
Clusters:
- Input:
Kafka:
Name: gostash
Brokers:
- "172.16.186.16:19092"
- "172.16.186.17:19092"
Topics:
- k8slog
Group: pro
Consumers: 16
Filters:
- Action: drop
Conditions:
- Key: k8s_container_name
Value: "-rpc"
Type: contains
- Key: level
Value: info
Type: match
Op: and
- Action: remove_field
Fields:
- message
- _source
- _type
- _score
- _id
- "@version"
- topic
- index
- beat
- docker_container
- Action: transfer
Field: message
Target: data
Output:
ElasticSearch:
Hosts:
- "172.16.141.4:9200"
- "172.16.141.5:9200"
# {.event} is the value of the json attribute from input
# {{yyyy-MM-dd}} means date, like 2020-09-09
Index: {.event}-{{yyyy-MM-dd}}
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。