龙空技术网

Zookeeper安装与调优部署参考文档(Linux)

运维Danrtsey 370

前言:

现时咱们对“ubuntu snap daemon”大概比较关切,兄弟们都想要知道一些“ubuntu snap daemon”的相关资讯。那么小编在网摘上搜集了一些有关“ubuntu snap daemon””的相关知识,希望你们能喜欢,我们一起来了解一下吧!

1. 安装环境准备1.1 主机环境准备1.1.1. 关闭selinux

sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/configsetenforce 0
1.1.2. 软件下载

apache-zookeeper-3.6.1-bin.tar.gz:下载地址

1.1.3. 部署规划

软件安装路径 /usr/local/zookeeper

端口规划 2192

1.1.4. 系统主机时间、时区、系统语言

 本节视实际情况需要操作

 修改时区

ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

 修改系统语言环境

echo 'LANG="en_US.UTF-8"' >> /etc/profile && source /etc/profile

 配置主机NTP时间同步

yum -y install ntpsystemctl enable ntpd && systemctl start ntpdecho 'server ntp1.aliyun.com' >> /etc/ntp.confecho 'server ntp2.aliyun.com' >> /etc/ntp.conf
2. Zookeeper安装部署2.1 Zookeeper依赖安装及部署

 添加用户与用户组(用户名请自行定义)

groupadd -r middleware && useradd -s /sbin/nologin -r -M -g middleware middleware

 JDK安装部署

tar -zxvf jdk-8u231-linux-x64.tar.gz -C /usr/local/cat >>/etc/profile<<EOFexport JAVA_HOME=/usr/local/jdk1.8.0_231export JRE_HOME=\${JAVA_HOME}/jreexport CLASSPATH=.:\${JAVA_HOME}/lib:\${JRE_HOME}/libexport PATH=\${JAVA_HOME}/bin:\$PATHEOFsource /etc/profilejava -version

 下载apache-zookeeper-3.6.1-bin.tar.gz安装包,并解压安装

yum -y install gcc gcc-c++ automake autoconf libevent-devel libevent make wget net-toolscd /optwget  -zxvf apache-zookeeper-3.6.1-bin.tar.gz -C /usr/local/cd /usr/local/mv apache-zookeeper-3.6.1-bin zookeepermkdir -p zookeeper/data/zookeepermkdir zookeeper/dataLogcd zookeeper/confcp zoo_sample.cfg zoo.cfg

 修改zookeeper数据存储路径与连接端口

vi zoo.cfgdataDir=/usr/local/zookeeper/data/zookeeperdataLogDir=/usr/local/zookeeper/dataLogclientPort=2192chown -R middleware:middleware /usr/local/zookeeper

 配置Zookeeper环境变量

cat >>/etc/profile<< EOFexport PATH="\$PATH:/usr/local/zookeeper/bin"EOFsource /etc/profile
2.2 配置zookeeper系统服务2.2.1. 针对6系统添加系统服务

1、添加防火墙策略

(1)所有机器可访问

iptables -A INPUT -p tcp --dport 2192 -j ACCEPTservice iptables save

(2)特定IP192.168.31.130可访问本机2192端口

iptables -A INPUT -p tcp -s 192.168.31.130 --dport 2192 -j ACCEPTservice iptables save

2、添加zookeeper系统服务启动脚本

cd /usr/local/zookeeper/bin/sed -i '77aJAVA_HOME="/usr/local/jdk1.8.0_231"' zkEnv.shvi /etc/init.d/zookeeper#!/bin/bash## zookeeper  start/stop the zookeeper daemon## chkconfig: 345 80 20# description: zookeeper is a message server.#ZOOKEEPER_HOME=/usr/local/zookeeperPIDFILE=/usr/local/zookeeper/data/zookeeper/zookeeper_server.pidcase $1 in    start)        if [ -f $PIDFILE ]        then                echo "$PIDFILE exists, process is already running"        else                echo "Starting zookeeper server..."                sudo -u middleware $ZOOKEEPER_HOME/bin/zkServer.sh start        fi        ;;    stop)        if [ ! -f $PIDFILE ]        then                echo "$PIDFILE does not exist, process is not running"        else                sudo -u middleware $ZOOKEEPER_HOME/bin/zkServer.sh stop        fi        ;;    status)        if [ ! -f $PIDFILE ]        then                echo "$PIDFILE does not exist, process is not running"        else                sudo -u middleware $ZOOKEEPER_HOME/bin/zkServer.sh status                echo "Zookeeper service is running..."        fi        ;;    restart)        sudo -u middleware $ZOOKEEPER_HOME/bin/zkServer.sh restart        ;;    *)        echo "Please use start|stop|status|restart as first argument"        ;;esac

3、配置zookeeper系统服务及自启动

chmod +x /etc/init.d/zookeeperchkconfig --add zookeeper && chkconfig zookeeper onchkconfig --list zookeeper

4、启动与停止zookeeper服务

service zookeeper startps -ef|grep zookeeperservice zookeeper stop
2.2.2. 针对7系统添加系统服务

1、添加防火墙策略

(1)所有机器可访问

firewall-cmd --permanent --zone=public --add-port=2192/tcpfirewall-cmd --reload

(2)特定IP192.168.31.130可访问本机2192端口

firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.31.130" port protocol="tcp" port="2192" accept"firewall-cmd --reload

(3)特定IP段192.168.142.0/24可访问本机2192端口

firewall-cmd --permanent --add-rich-rule="rule family="ipv4" source address="192.168.142.0/24" port protocol="tcp" port="2192" accept"firewall-cmd --reload

2、添加zookeeper系统服务启动脚本

获取当前服务器PATH路径信息,并将此信息添加到zookeeper系统服务中

echo $PATH/usr/local/jdk1.8.0_231/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bincat >/usr/lib/systemd/system/zookeeper.service<<EOF[Unit]Description=ZookeeperAfter=network.target[Service]Type=forkingEnvironment=ZOO_LOG_DIR=/usr/local/zookeeper/logsEnvironment=PATH=/usr/local/jdk1.8.0_231/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/binPIDFile=/usr/local/zookeeper/data/zookeeper/zookeeper_server.pidExecStart=/usr/local/zookeeper/bin/zkServer.sh startExecStop=/usr/local/zookeeper/bin/zkServer.sh stopExecRestart=/usr/local/zookeeper/bin/zkServer.sh restartUser=middlewareGroup=middleware[Install]WantedBy=multi-user.targetEOF

3、配置zookeeper系统服务及自启动

systemctl daemon-reloadsystemctl enable zookeeper.service

4、启动与停止zookeeper服务

systemctl start zookeeperps -ef|grep zookeepersystemctl stop zookeeper
3. Zookeeper加固3.1 最小化权限用户启动

 用户名请自行定义

groupadd -r middleware && useradd -s /sbin/nologin -r -M -g middleware middleware
3.2 预防DOS攻击

 限制zookeeper客户端的最大连接数。

vi /usr/local/zookeeper/conf/zoo.cfgmaxClientCnxns=60
3.3 修改默认2181端口

 默认情况下,zookeeper默认使用2181端口,请修改默认监听端口,如本文档使用的是2192

vi /usr/local/zookeeper/conf/zoo.cfgclientPort=2192
3.4 禁用管理控制台

 如不需要使用zookeeper的管理控制台,建议禁用(zookeeper的管理控制台是由jetty启动的,默认为http,存在一定的信息泄露及安全隐患。)

 操作指导:

在bin/zkServer.sh文件中,将如下

vi /usr/local/zookeeper/bin/zkServer.shstart)    echo  -n "Starting zookeeper ... "    if [ -f "$ZOOPIDFILE" ]; then      if kill -0 `cat "$ZOOPIDFILE"` > /dev/null 2>&1; then         echo $command already running as process `cat "$ZOOPIDFILE"`.         exit 1      fi    fi    nohup "$JAVA" $ZOO_DATADIR_AUTOCREATE "-Dzookeeper.log.dir=${ZOO_LOG_DIR}" \"-Dzookeeper.log.file=${ZOO_LOG_FILE}" "-Dzookeeper.root.logger=${ZOO_LOG4J_PROP}" \修改为(即在nohup这一行,添加 "-Dzookeeper.admin.enableServer=false")start)    echo  -n "Starting zookeeper ... "    if [ -f "$ZOOPIDFILE" ]; then      if kill -0 `cat "$ZOOPIDFILE"` > /dev/null 2>&1; then         echo $command already running as process `cat "$ZOOPIDFILE"`.         exit 1      fi    fi    nohup "$JAVA" $ZOO_DATADIR_AUTOCREATE "-Dzookeeper.log.dir=${ZOO_LOG_DIR}" \    "-Dzookeeper.log.file=${ZOO_LOG_FILE}" "-Dzookeeper.admin.enableServer=false" "-Dzookeeper.root.logger=${ZOO_LOG4J_PROP}" \
3.5 日志清理

 建议设置对zookeeper日志的定期清理功能,在配置文件中清理日志策略,如下所示:

vi /usr/local/zookeeper/conf/zoo.cfgautopurge.snapRetainCount=10autopurge.purgeInterval=24参数说明:autopurge.snapRetainCount=10  //保留多少个快照autopurge.purgeInterval=24     //多少小时清理一次
3.6 配置事务日志与快照日志分离
vi /usr/local/zookeeper/conf/zoo.cfgdataDir=/usr/local/zookeeper/data/zookeeperdataLogDir=/usr/local/zookeeper/dataLog
3.7 添加对zookeeper的指定IP授权访问

 zookeeper在默认情况下,是允许任意客户端未经授权访问,存在很大的安全隐患。具体连接指令如下:

/usr/local/zookeeper/bin/zkCli.sh -server 127.0.0.1:2192WatchedEvent state:SyncConnected type:None path:null    //敲回车

 等待输入操作指令,如创建用户、授权等

[zk: 127.0.0.1:2192(CONNECTED) 0]

 getAcl / 表示查看当前权限 quit 表示退出客户端连接

[zk: 127.0.0.1:2192(CONNECTED) 3] getAcl /'world,'anyone: cdrwa

 添加可访问IP,一组可访问ip间符号,隔开,格式如下

[zk: 127.0.0.1:2192(CONNECTED) 3] setAcl / ip:192.168.31.130:cdrwa,ip:127.0.0.1:cdrwa

 查看权限是否添加成功

[zk: 127.0.0.1:2192(CONNECTED) 3] getAcl /'ip,'192.168.31.130: cdrwa'ip,'127.0.0.1: cdrwa

 回退方法

[zk: 127.0.0.1:2192(CONNECTED) 3] setAcl / world:anyone:cdrwa

 zookeeper身份的认证有4种方式:

(1)world:默认方式,相当于全世界都能访问

(2)auth:代表已经认证通过的用户(cli中可以通过addauth digest user:pwd 来添加当前上下文中的授权用户)

(3)digest:即用户名:密码这种方式认证,这也是业务系统中最常用的,用username:password 字符串来产生一个MD5串,然后该串被用来作为ACL ID,认证是通过明文发送username:password 来进行的,当用在ACL时,表达式为username:base64 ,base64是password的SHA1摘要的编码;

(4)ip:使用Ip地址认证

 ID授权对象ID是指,权限赋予的用户或者一个实体,例如:IP 地址或者机器,授权模式 授权对象有:

(1)IP:通常是一个IP地址或IP段,例如“192.168.29.100”或“192.168.29.100/110”

(2)Digest:自定义,通常是“username:BASE64(SHA-1(username:password))”,例如"foo:kWN6aNsbjcKWpqjiV7cg0N24raU="

(3)Word 只有一个ID:“anyone”

(4)Super:与Digest模式一致

 zookeeper支持的权限有5种分别是(其中delete是指对子节点的删除权限,其它4种权限指对自身节点的操作权限)

cdrwa:        create: 可以创建子节点;        read: 可以获取节点数据以及当前节点的子节点列表;        write: 可以为节点设置数据;        delete: 可以删除子节点;        admin: 可以为节点设置权限。
3.8 账号与认证
1、通过zkCli.cmd 进入zookeeper客户端/usr/local/zookeeper/bin/zkCli.sh -server 127.0.0.1:2192WatchedEvent state:SyncConnected type:None path:null    //敲回车2、使用auth方式加密,添加用户名crm和密码pwdaddauth digest crm:crm#pwd3、授予/dubbo auth权限setAcl /dubbo auth:crm:crm#pwd:rwadc4、查看目录加密后的权限getAcl /dubbo
3.9 配置防火墙策略

 根据操作系统的不同,参考2.2章节(注意如果是配置特定IP地址访问时,也要添加3.7章节中添加的指定IP)

3.10 定期升级

 使用官方最新稳定版本

4. Zookeeper优化4.1 优化内核参数

cat >>/etc/sysctl.conf<<EOFfs.file-max = 6815744net.ipv4.tcp_tw_reuse = 1 net.ipv4.tcp_tw_recycle = 1 net.ipv4.tcp_fin_timeout = 30 net.ipv4.ip_local_port_range = 10000 65000 net.ipv4.tcp_max_syn_backlog = 8192 net.ipv4.tcp_max_tw_buckets = 10000net.core.somaxconn=4000net.ipv4.tcp_syncookies = 1net.core.netdev_max_backlog = 262144net.ipv4.tcp_max_orphans = 262144EOFsysctl -p
4.2 系统资源限制
cat >>/etc/security/limits.conf<<EOF* soft nofile 65525* hard nofile 65525* soft nproc 65525* hard nproc 65525EOF
5. 结束

标签: #ubuntu snap daemon