Griffin docker images are pre-built on docker hub, users can pull them to try Apache Griffin in docker.
Install docker and docker compose.
Increase vm.max_map_count of your local machine(linux), to use elasticsearch.
sysctl -w vm.max_map_count=262144
For macOS, please increase enough memory available for docker (For example, set more than 4 GB in docker->preferences->Advanced) or decrease memory for es instance(For example, set -Xms512m -Xmx512m in jvm.options)
For other platforms, please reference to this link from elastic.co max_map_count kernel setting
Pull Apache Griffin pre-built docker images, but if you access docker repository easily(NOT in China).
docker pull apachegriffin/griffin_spark2:0.3.0
docker pull apachegriffin/elasticsearch
docker pull apachegriffin/kafka
docker pull zookeeper:3.5
For Chinese users, you can pull the images from the following mirrors.
docker pull registry.docker-cn.com/apachegriffin/griffin_spark2:0.3.0
docker pull registry.docker-cn.com/apachegriffin/elasticsearch
docker pull registry.docker-cn.com/apachegriffin/kafka
docker pull zookeeper:3.5
The docker images are the Apache Griffin environment images.
apachegriffin/griffin_spark2
: This image contains mysql, hadoop, hive, spark, livy, Apache Griffin service, Apache Griffin measure, and some prepared demo data, it works as a single node spark cluster, providing spark engine and Apache Griffin service.apachegriffin/elasticsearch
: This image is based on official elasticsearch, adding some configurations to enable cors requests, to provide elasticsearch service for metrics persist.apachegriffin/kafka
: This image contains kafka 0.8, and some demo streaming data, to provide streaming data source in streaming mode.zookeeper:3.5
: This image is official zookeeper, to provide zookeeper service in streaming mode.$ docker-compose -f docker-compose-batch.yml up -d
$ docker container ls
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
bfec3192096d apachegriffin/griffin_spark2:0.3.0 "/etc/bootstrap-al..." 5 hours ago Up 5 hours 6066/tcp, 8030-8033/tcp, 8040/tcp, 9000/tcp, 10020/tcp, 19888/tcp, 27017/tcp, 49707/tcp, 50010/tcp, 50020/tcp, 50070/tcp, 50075/tcp, 50090/tcp, 0.0.0.0:32122->2122/tcp, 0.0.0.0:33306->3306/tcp, 0.0.0.0:35432->5432/tcp, 0.0.0.0:38042->8042/tcp, 0.0.0.0:38080->8080/tcp, 0.0.0.0:38088->8088/tcp, 0.0.0.0:38998->8998/tcp, 0.0.0.0:39083->9083/tcp griffin
fb9d04285070 apachegriffin/elasticsearch "/docker-entrypoin..." 5 hours ago Up 5 hours 0.0.0.0:39200->9200/tcp, 0.0.0.0:39300->9300/tcp es
BASE_PATH
value to <your local IP address>:38080
.Basic -> Get griffin version
, to make sure Apache Griffin service has started up.Measures -> Add measure
, to create a measure in Apache Griffin.jobs -> Add job
, to schedule a job to execute the measure. In the example, the schedule interval is 5 minutes.curl -XGET '<IP Address>:39200/griffin/accuracy/_search?pretty&filter_path=hits.hits._source' \
-d '{"query":{"match_all":{}}, "sort": [{"tmst": {"order": "asc"}}]}'
# json metric data returned
{
"hits" : {
"hits" : [
{
"_source" : {
"name" : "metricName",
"tmst" : 1509599811123,
"value" : {
"__tmst" : 1509599811123,
"miss" : 11,
"total" : 125000,
"matched" : 124989
}
}
},
{
"_source" : {
"name" : "metricName",
"tmst" : 1509599811123,
"value" : {
"__tmst" : 1509599811123,
"miss" : 11,
"total" : 125000,
"matched" : 124989
}
}
}
]
}
}
docker-compose -f docker-compose-streaming.yml up -d
docker exec -it griffin bash
cd ~/measure
./streaming-accu.sh
tail -f streaming-accu.log
kill -9 `ps -ef | awk '/griffin-measure/{print $2}'`
./clear.sh
./streaming-prof.sh
tail -f streaming-prof.log
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。