深入淺析Docker容器中的Patroni
上一篇文章向大家介紹了Repmgr的搭建過程,實現(xiàn)了自動切換,今天將向大家介紹,如何搭建容器下的Patroni集群環(huán)境,Patroni作為開箱即用PG高可用工具,越來越多的被各個廠商用于云環(huán)境下使用。
patroni基本架構(gòu)如圖所示:
etcd作為分布式注冊中心、進(jìn)行集群選主工作;vip-manager為主節(jié)點設(shè)置漂移IP;patroni負(fù)責(zé)引導(dǎo)集群的創(chuàng)建、運行和管理工作,并可以使用patronictl來進(jìn)行終端訪問。
具體流程:
1、首先啟動etcd集群,本例中etcd數(shù)量為3個。
2、檢測etcd集群狀態(tài)健康后,啟動patroni并競爭選主,其他跟隨節(jié)點進(jìn)行數(shù)據(jù)同步過程。
3、啟動vip-manager,通過訪問etcd集群中/ S E R V I C E N A M E / {SERVICE_NAME}/ SERVICENAME/{CLUSTER_NAME}/leader鍵中的具體值,判斷當(dāng)前節(jié)點是否為主節(jié)點ip,如果是則為該節(jié)點設(shè)置vip,提供對外讀寫服務(wù)。
注:建議真實環(huán)境下將etcd部署到獨立容器上,對外提供服務(wù)。
創(chuàng)建鏡像
文件結(jié)構(gòu)
其中Dockerfile為鏡像主文件,docker服務(wù)通過該文件在本地倉庫創(chuàng)建鏡像;entrypoint.sh為容器入口文件,負(fù)責(zé)業(yè)務(wù)邏輯的處理;function為執(zhí)行業(yè)務(wù)方法的入口文件,負(fù)責(zé)啟動etcd,監(jiān)控etcd集群狀態(tài)、啟動patroni和vip-manager;generatefile為整個容器生成對應(yīng)的配置文件,包括etcd、patroni及vip-mananger。
目錄結(jié)構(gòu)大致如圖所示:
注:數(shù)據(jù)庫安裝包和patroni安裝包請自行構(gòu)建。
DockerFile
FROM centos:7 MAINTAINER wangzhibin <wangzhibin> ENV USER="postgresql" \ PASSWORD=123456 \ GROUP=postgresql RUN useradd ${USER} \ && chown -R ${USER}:${GROUP} /home/${USER} \ && yum -y update && yum install -y iptables sudo net-tools iproute openssh-server openssh-clients which vim sudo crontabs #安裝etcd COPY etcd/etcd /usr/sbin COPY etcd/etcdctl /usr/sbin #安裝database COPY lib/ /home/${USER}/lib COPY include/ /home/${USER}/include COPY share/ /home/${USER}/share COPY bin/ /home/${USER}/bin/ COPY patroni/ /home/${USER}/patroni #安裝vip-manager COPY vip-manager/vip-manager /usr/sbin #安裝執(zhí)行腳本 COPY runtime/ /home/${USER}/runtime COPY entrypoint.sh /sbin/entrypoint.sh #設(shè)置環(huán)境變量 ENV LD_LIBRARY_PATH /home/${USER}/lib ENV PATH /home/${USER}/bin:$PATH ENV ETCDCTL_API=3 #安裝Patroni RUN yum -y install epel-release python-devel && yum -y install python-pip \ && pip install /home/${USER}/patroni/1/pip-20.3.3.tar.gz \ && pip install /home/${USER}/patroni/1/psycopg2-2.8.6-cp27-cp27mu-linux_x86_64.whl \ && pip install --no-index --find-links=/home/${USER}/patroni/2/ -r /home/${USER}/patroni/2/requirements.txt \ && pip install /home/${USER}/patroni/3/patroni-2.0.1-py2-none-any.whl #修改執(zhí)行權(quán)限 RUN chmod 755 /sbin/entrypoint.sh \ && mkdir /home/${USER}/etcddata \ && chown -R ${USER}:${GROUP} /home/${USER} \ && echo 'root:root123456' | chpasswd \ && chmod 755 /sbin/etcd \ && chmod 755 /sbin/etcdctl \ && chmod 755 /sbin/vip-manager #設(shè)置Sudo RUN chmod 777 /etc/sudoers \ && sed -i '/## Allow root to run any commands anywhere/a '${USER}' ALL=(ALL) NOPASSWD:ALL' /etc/sudoers \ && chmod 440 /etc/sudoers #切換用戶 USER ${USER} #切換工作目錄 WORKDIR /home/${USER} #啟動入口程序 CMD ["/bin/bash", "/sbin/entrypoint.sh"]
entrypoint.sh
#!/bin/bash set -e # shellcheck source=runtime/functions source "/home/${USER}/runtime/function" configure_patroni
function
#!/bin/bash set -e source /home/${USER}/runtime/env-defaults source /home/${USER}/runtime/generatefile PG_DATADIR=/home/${USER}/pgdata PG_BINDIR=/home/${USER}/bin configure_patroni() { #生成配置文件 generate_etcd_conf generate_patroni_conf generate_vip_conf #啟動etcd etcdcount=${ETCD_COUNT} count=0 ip_temp="" array=(${HOSTLIST//,/ }) for host in ${array[@]} do ip_temp+="http://${host}:2380," done etcd --config-file=/home/${USER}/etcd.yml >/home/${USER}/etcddata/etcd.log 2>&1 & while [ $count -lt $etcdcount ] do line=(`etcdctl --endpoints=${ip_temp%?} endpoint health -w json`) count=`echo $line | awk -F"\"health\":true" '{print NF-1}'` echo "waiting etcd cluster" sleep 5 done #啟動patroni patroni /home/${USER}/postgresql.yml > /home/${USER}/patroni/patroni.log 2>&1 & #啟動vip-manager sudo vip-manager --config /home/${USER}/vip.yml }
generatefile
#!/bin/bash set -e HOSTNAME="`hostname`" hostip=`ping ${HOSTNAME} -c 1 -w 1 | sed '1{s/[^(]*(//;s/).*//;q}'` #generate etcd generate_etcd_conf() { echo "name : ${HOSTNAME}" >> /home/${USER}/etcd.yml echo "data-dir: /home/${USER}/etcddata" >> /home/${USER}/etcd.yml echo "listen-client-urls: http://0.0.0.0:2379" >> /home/${USER}/etcd.yml echo "advertise-client-urls: http://${hostip}:2379" >> /home/${USER}/etcd.yml echo "listen-peer-urls: http://0.0.0.0:2380" >> /home/${USER}/etcd.yml echo "initial-advertise-peer-urls: http://${hostip}:2380" >> /home/${USER}/etcd.yml ip_temp="initial-cluster: " array=(${HOSTLIST//,/ }) for host in ${array[@]} do ip_temp+="${host}=http://${host}:2380," done echo ${ip_temp%?} >> /home/${USER}/etcd.yml echo "initial-cluster-token: etcd-cluster-token" >> /home/${USER}/etcd.yml echo "initial-cluster-state: new" >> /home/${USER}/etcd.yml } #generate patroni generate_patroni_conf() { echo "scope: ${CLUSTER_NAME}" >> /home/${USER}/postgresql.yml echo "namespace: /${SERVICE_NAME}/ " >> /home/${USER}/postgresql.yml echo "name: ${HOSTNAME} " >> /home/${USER}/postgresql.yml echo "restapi: " >> /home/${USER}/postgresql.yml echo " listen: ${hostip}:8008 " >> /home/${USER}/postgresql.yml echo " connect_address: ${hostip}:8008 " >> /home/${USER}/postgresql.yml echo "etcd: " >> /home/${USER}/postgresql.yml echo " host: ${hostip}:2379 " >> /home/${USER}/postgresql.yml echo " username: ${ETCD_USER} " >> /home/${USER}/postgresql.yml echo " password: ${ETCD_PASSWD} " >> /home/${USER}/postgresql.yml echo "bootstrap: " >> /home/${USER}/postgresql.yml echo " dcs: " >> /home/${USER}/postgresql.yml echo " ttl: 30 " >> /home/${USER}/postgresql.yml echo " loop_wait: 10 " >> /home/${USER}/postgresql.yml echo " retry_timeout: 10 " >> /home/${USER}/postgresql.yml echo " maximum_lag_on_failover: 1048576 " >> /home/${USER}/postgresql.yml echo " postgresql: " >> /home/${USER}/postgresql.yml echo " use_pg_rewind: true " >> /home/${USER}/postgresql.yml echo " use_slots: true " >> /home/${USER}/postgresql.yml echo " parameters: " >> /home/${USER}/postgresql.yml echo " initdb: " >> /home/${USER}/postgresql.yml echo " - encoding: UTF8 " >> /home/${USER}/postgresql.yml echo " - data-checksums " >> /home/${USER}/postgresql.yml echo " pg_hba: " >> /home/${USER}/postgresql.yml echo " - host replication ${USER} 0.0.0.0/0 md5 " >> /home/${USER}/postgresql.yml echo " - host all all 0.0.0.0/0 md5 " >> /home/${USER}/postgresql.yml echo "postgresql: " >> /home/${USER}/postgresql.yml echo " listen: 0.0.0.0:5432 " >> /home/${USER}/postgresql.yml echo " connect_address: ${hostip}:5432 " >> /home/${USER}/postgresql.yml echo " data_dir: ${PG_DATADIR} " >> /home/${USER}/postgresql.yml echo " bin_dir: ${PG_BINDIR} " >> /home/${USER}/postgresql.yml echo " pgpass: /tmp/pgpass " >> /home/${USER}/postgresql.yml echo " authentication: " >> /home/${USER}/postgresql.yml echo " replication: " >> /home/${USER}/postgresql.yml echo " username: ${USER} " >> /home/${USER}/postgresql.yml echo " password: ${PASSWD} " >> /home/${USER}/postgresql.yml echo " superuser: " >> /home/${USER}/postgresql.yml echo " username: ${USER} " >> /home/${USER}/postgresql.yml echo " password: ${PASSWD} " >> /home/${USER}/postgresql.yml echo " rewind: " >> /home/${USER}/postgresql.yml echo " username: ${USER} " >> /home/${USER}/postgresql.yml echo " password: ${PASSWD} " >> /home/${USER}/postgresql.yml echo " parameters: " >> /home/${USER}/postgresql.yml echo " unix_socket_directories: '.' " >> /home/${USER}/postgresql.yml echo " wal_level: hot_standby " >> /home/${USER}/postgresql.yml echo " max_wal_senders: 10 " >> /home/${USER}/postgresql.yml echo " max_replication_slots: 10 " >> /home/${USER}/postgresql.yml echo "tags: " >> /home/${USER}/postgresql.yml echo " nofailover: false " >> /home/${USER}/postgresql.yml echo " noloadbalance: false " >> /home/${USER}/postgresql.yml echo " clonefrom: false " >> /home/${USER}/postgresql.yml echo " nosync: false " >> /home/${USER}/postgresql.yml } #........ 省略部分內(nèi)容
構(gòu)建鏡像
docker build -t patroni .
運行鏡像
運行容器節(jié)點1:
docker run --privileged --name patroni1 -itd --hostname patroni1 --net my_net3 --restart always --env ‘CLUSTER_NAME=patronicluster' --env ‘SERVICE_NAME=service' --env ‘ETCD_USER=etcduser' --env ‘ETCD_PASSWD=etcdpasswd' --env ‘PASSWD=zalando' --env ‘HOSTLIST=patroni1,patroni2,patroni3' --env ‘VIP=172.22.1.88' --env ‘NET_DEVICE=eth0' --env ‘ETCD_COUNT=3' patroni
運行容器節(jié)點2:
docker run --privileged --name patroni2 -itd --hostname patroni2 --net my_net3 --restart always --env ‘CLUSTER_NAME=patronicluster' --env ‘SERVICE_NAME=service' --env ‘ETCD_USER=etcduser' --env ‘ETCD_PASSWD=etcdpasswd' --env ‘PASSWD=zalando' --env ‘HOSTLIST=patroni1,patroni2,patroni3' --env ‘VIP=172.22.1.88' --env ‘NET_DEVICE=eth0' --env ‘ETCD_COUNT=3' patroni
運行容器節(jié)點3:
docker run --privileged --name patroni3 -itd --hostname patroni3 --net my_net3 --restart always --env ‘CLUSTER_NAME=patronicluster' --env ‘SERVICE_NAME=service' --env ‘ETCD_USER=etcduser' --env ‘ETCD_PASSWD=etcdpasswd' --env ‘PASSWD=zalando' --env ‘HOSTLIST=patroni1,patroni2,patroni3' --env ‘VIP=172.22.1.88' --env ‘NET_DEVICE=eth0' --env ‘ETCD_COUNT=3' patroni
總結(jié)
本操作過程僅限于試驗環(huán)境,為了演示etcd+patroni+vipmanager整體的容器化搭建。在真實環(huán)境下,etcd應(yīng)該部署在不同容器下,形成獨立的分布式集群,并且PG的存儲應(yīng)該映射到本地磁盤或網(wǎng)絡(luò)磁盤,另外容器集群的搭建盡量使用編排工具,例如docker-compose、docker-warm或者Kubernetes等。
附圖
etcd集群狀態(tài)如圖:
patroni集群狀態(tài)如圖:
vip-manager狀態(tài)如圖:
到此這篇關(guān)于深入淺析Docker容器中的Patroni的文章就介紹到這了,更多相關(guān)Docker容器Patroni內(nèi)容請搜索腳本之家以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持腳本之家!
相關(guān)文章
docker根據(jù)已生成的容器生成docker-compose.yml文件的實現(xiàn)步驟
這篇文章主要給大家介紹了docker 如何根據(jù)已生成的容器生成docker-compose.yml 文件,文中有詳細(xì)的代碼示例和實現(xiàn)步驟,對大家的學(xué)習(xí)有一定的幫助,需要的朋友可以參考下2023-10-10Docker+nacos+seata1.3.0安裝與使用配置教程
這篇文章主要介紹了Docker+nacos+seata1.3.0安裝與使用配置教程,本文給大家介紹的非常詳細(xì),對大家的學(xué)習(xí)或工作具有一定的參考借鑒價值,需要的朋友可以參考下2021-07-07利用Docker搭建Nexus私有倉庫實現(xiàn)Maven私服
Maven大家應(yīng)該都比較熟了,我這里就用安卓人狂喜的Gradle來演示一下,在build.gradle中編寫腳本即可上傳,接下來通過本文給大家介紹下利用Docker搭建Nexus私有倉庫實現(xiàn)Maven私服的問題,感興趣的朋友一起看看吧2022-01-01IDEA集成docker實現(xiàn)遠(yuǎn)程部署的步驟
本文主要介紹了IDEA集成docker實現(xiàn)遠(yuǎn)程部署的步驟,文中通過示例代碼介紹的非常詳細(xì),具有一定的參考價值,感興趣的小伙伴們可以參考一下2021-09-09Docker執(zhí)行DockerFile構(gòu)建過程指令解析
這篇文章主要為大家介紹了Docker執(zhí)行DockerFile構(gòu)建過程及DockerFile的指令解析,有需要的朋友可以借鑒參考下,希望能夠有所幫助,祝大家多多進(jìn)步早日升職加薪<BR>2022-04-04docker部署zookeeper集群方式(單主機(jī)、多主機(jī))
這篇文章主要介紹了docker部署zookeeper集群方式(單主機(jī)、多主機(jī)),具有很好的參考價值,希望對大家有所幫助。如有錯誤或未考慮完全的地方,望不吝賜教2023-04-04