一、TiDB介绍

　　1、TiDB介绍：

　　TiDB 是 PingCAP 公司受 Google Spanner / F1 论文启发而设计的开源分布式 HTAP (Hybrid Transactional and Analytical Processing) 数据库，结合了传统的 RDBMS 和 NoSQL 的最佳特性。TiDB 兼容 MySQL，支持无限的水平扩展，具备强一致性和高可用性。

　　2、逻辑图：

二、 离线安装部署

　　1、外网下载离线安装包

curl --proto '=https' --tlsv1.2 -sSf  | sh  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current                                 Dload  Upload   Total   Spent    Left  Speed100 4410k  100 4410k    0     0  2064k      0  0:00:02  0:00:02 --:--:-- 2063k

　　2、测试tiup工具

[root@localhost tidb-tiup]# source /root/.bash_profile[root@localhost tidb-tiup]# which tiup/root/.tiup/bin/tiup

　　3、查看可以下载的tidb版本

[root@deam tidb]# tiup list tidbAvailable versions for tidb:Version        Installed  Release                              Platforms-------        ---------  -------                              ---------nightly                   2020-07-08T06:39:00+08:00            linux/arm64,darwin/amd64,linux/amd64v3.0                      2020-04-16T16:58:06+08:00            darwin/amd64,linux/amd64v3.0.0                    2020-04-16T14:03:31+08:00            darwin/amd64,linux/amd64v3.0.1                    2020-04-27T19:38:36+08:00            linux/arm64,darwin/amd64,linux/amd64v3.0.2                    2020-04-16T23:55:11+08:00            darwin/amd64,linux/amd64v3.0.3                    2020-04-17T00:16:31+08:00            darwin/amd64,linux/amd64v3.0.4                    2020-04-17T00:22:46+08:00            darwin/amd64,linux/amd64v3.0.5                    2020-04-17T00:29:45+08:00            darwin/amd64,linux/amd64v3.0.6                    2020-04-17T00:39:33+08:00            darwin/amd64,linux/amd64v3.0.7                    2020-04-17T00:46:32+08:00            darwin/amd64,linux/amd64v3.0.8                    2020-04-17T00:54:19+08:00            darwin/amd64,linux/amd64v3.0.9                    2020-04-17T01:00:58+08:00            darwin/amd64,linux/amd64v3.0.10                   2020-03-13T14:11:53.774527401+08:00  darwin/amd64,linux/amd64v3.0.11                   2020-04-17T01:09:20+08:00            darwin/amd64,linux/amd64v3.0.12                   2020-04-17T01:16:04+08:00            darwin/amd64,linux/amd64v3.0.13                   2020-04-26T17:25:01+08:00            darwin/amd64,linux/amd64v3.0.14                   2020-05-09T21:11:49+08:00            linux/arm64,darwin/amd64,linux/amd64v3.0.15                   2020-06-05T16:50:59+08:00            linux/arm64,darwin/amd64,linux/amd64v3.0.16                   2020-07-03T20:05:15+08:00            linux/arm64,darwin/amd64,linux/amd64v3.1.0-beta               2020-05-22T14:35:59+08:00            linux/arm64,darwin/amd64,linux/amd64v3.1.0-beta.1             2020-05-22T15:22:30+08:00            linux/arm64,darwin/amd64,linux/amd64v3.1.0-beta.2             2020-05-22T15:28:20+08:00            linux/arm64,darwin/amd64,linux/amd64v3.1.0-rc                 2020-05-22T15:56:23+08:00            linux/arm64,darwin/amd64,linux/amd64v3.1.0                    2020-05-22T15:34:33+08:00            linux/arm64,darwin/amd64,linux/amd64v3.1.1                    2020-04-30T21:02:32+08:00            linux/arm64,darwin/amd64,linux/amd64v3.1.2                    2020-06-04T17:53:39+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.0-beta               2020-05-26T11:18:05+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.0-beta.1             2020-05-26T11:42:48+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.0-beta.2             2020-05-26T11:56:51+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.0-rc                 2020-05-26T14:56:06+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.0-rc.1               2020-04-29T01:03:31+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.0-rc.2               2020-05-15T21:54:51+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.0                    2020-05-28T16:23:23+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.1                    2020-06-15T12:00:45+08:00            linux/arm64,darwin/amd64,linux/amd64v4.0.2                    2020-07-01T19:57:14+08:00            linux/arm64,darwin/amd64,linux/amd64

　　4、生成需要的tidb离线版本（这儿生成的v4.0.2）

[root@localhost tidb-tiup]# tiup mirror clone tidb-community-server-v4.0.2-linux-amd64 v4.0.2 --os=linux --arch=amd64Start to clone mirror, targetDir is tidb-community-server-v4.0.2-linux-amd64, selectedVersions are [v4.0.2]If this does not meet expectations, please abort this process, read `tiup mirror clone --help` and run againArch [amd64]OS [linux]download  22.54 MiB / 22.54 MiB 100.00% 2.03 MiB p/s                                    download  3.55 MiB / 3.55 MiB 100.00% ? p/s                                                     download -

　　5、打包离线文件

tar czvf tidb-community-server-v4.0.2-linux-amd64.tar.gz tidb-community-server-v4.0.2-linux-amd64

　　6、内网tidb安装

　　将离线包发送到目标集群的中控机后，执行以下命令安装 TiUP 组件：

tar xzvf tidb-community-server-v4.0.2-linux-amd64.tar.gz && sh tidb-community-server-v4.0.2-linux-amd64/local_install.shsource /home/tidb/.bash_profile

　　7、TiKV 数据盘挂载

磁盘大于1T方法#fdisk -lDisk /dev/vdb: 1000 GB#parted -s -a optimal /dev/vdb mklabel gpt -- mkpart primary ext4 1 -1   #创建分区#mkfs.ext4 /dev/vdb1                                                     #格式化磁盘#echo "UUID=`lsblk -f|grep vdb1|awk '{print $3}'` /data1 ext4 defaults,nodelalloc,noatime 0 2" >> /etc/fstab  #配置开机自动挂载#more /etc/fstab#mkdir /data1  && mount -a  #挂载盘----------------------------磁盘小于1T方法pvcreate /dev/vdbvgcreate vg_data /dev/vdblvcreate -l 100%VG -n lv_tidb vg_data mkdir /data1mkfs.ext4 /dev/mapper/vg_data-lv_tidbecho "UUID=`lsblk -f|grep vg_data-lv_tidb|awk '{print $3}'` /data1 ext4 defaults,nodelalloc,noatime 0 2" >> /etc/fstab more /etc/fstabmount -a

　　8、配置ssh免密登陆

ssh-keygen                           #一直回车ssh-copy-id root@10.0.0.1   #输入密码配置免密登陆ssh-copy-id root@10.0.0.2ssh-copy-id root@10.0.0.3ssh-copy-id root@10.0.0.4ssh-copy-id root@10.0.0.5ssh-copy-id root@10.0.0.6ssh-copy-id root@10.0.0.7

　　9、集群初始化配置文件需要手动编写，需要在中控机上面创建 YAML 格式配置文件，例如 topology.yaml:

# # Global variables are applied to all deployments and used as the default value of# # the deployments if a specific deployment value is missing.global:  user: "tidb"  ssh_port: 22  deploy_dir: "/tidb-deploy"  data_dir: "/tidb-data"server_configs:  pd:    replication.enable-placement-rules: truepd_servers:  - host: 10.0.1.4  - host: 10.0.1.5  - host: 10.0.1.6tidb_servers:  - host: 10.0.1.7  - host: 10.0.1.8  - host: 10.0.1.9tikv_servers:  - host: 10.0.1.1  - host: 10.0.1.2  - host: 10.0.1.3tiflash_servers:  - host: 10.0.1.10    data_dir: /data1/tiflash/data,/data2/tiflash/datacdc_servers:  - host: 10.0.1.6  - host: 10.0.1.7  - host: 10.0.1.8monitoring_servers:  - host: 10.0.1.4grafana_servers:  - host: 10.0.1.4alertmanager_servers:  - host: 10.0.1.4

以前版本没有缓存服务器的配置

pd_servers:  - host: 172.16.5.134    name: pd-134  - host: 172.16.5.139    name: pd-139  - host: 172.16.5.140    name: pd-140tidb_servers:  - host: 172.16.5.134  - host: 172.16.5.139  - host: 172.16.5.140tikv_servers:  - host: 172.16.5.134  - host: 172.16.5.139  - host: 172.16.5.140grafana_servers:  - host: 172.16.5.134monitoring_servers:  - host: 172.16.5.134

　　10、部署 TiDB 集群

useradd tidb      #每台服务器创建tidb用户echo 'yourpasswd'|passwd --stdin tidbexport TIUP_MIRRORS=/path/to/mirror   #/path/to/mirror 是执行 local_install.sh 命令时输出的离线镜像包的位置tiup cluster deploy tidb-cluster v4.0.2 topology.yaml --user tidb  tiup cluster start tidb-cluster

　　11、tidb常用命令

[root@localhost tidb-tiup]# tiup clusterThe component `cluster` is not installed; downloading from repository.download  9.62 MiB / 9.62 MiB 100.00% 245.11 MiB p/s                                                          Starting component `cluster`: /root/.tiup/components/cluster/v1.0.7/tiup-clusterDeploy a TiDB cluster for productionUsage:  tiup cluster cluster [flags]  tiup cluster [command]Available Commands:  check       Perform preflight checks for the cluster.  deploy      Deploy a cluster for production  start       Start a TiDB cluster  stop        Stop a TiDB cluster  restart     Restart a TiDB cluster  scale-in    Scale in a TiDB cluster  scale-out   Scale out a TiDB cluster  destroy       upgrade     Upgrade a specified TiDB cluster  exec        Run shell command on host in the tidb cluster  display     Display information of a TiDB cluster  list        List all clusters  audit       Show audit log of cluster operation  import      Import an exist TiDB cluster from TiDB-Ansible  edit-config Edit TiDB cluster config  reload      Reload a TiDB cluster's config and restart if needed  patch       Replace the remote package with a specified package and restart the service  help        Help about any commandFlags:  -h, --help               help for tiup      --ssh-timeout int    Timeout in seconds to connect host via SSH, ignored for operations that don't need an SSH connection. (default 5)  -v, --version            version for tiup      --wait-timeout int   Timeout in seconds to wait for an operation to complete, ignored for operations that don't fit. (default 60)  -y, --yes                Skip all confirmations and assumes 'yes'Use "tiup cluster help [command]" for more information about a command.

三、在线部署安装

　　1、所有节点需配置ssh免密登录

ssh-keygen                           #一直回车ssh-copy-id root@10.0.0.1   #输入密码配置免密登陆ssh-copy-id root@10.0.0.2ssh-copy-id root@10.0.0.3ssh-copy-id root@10.0.0.4ssh-copy-id root@10.0.0.5ssh-copy-id root@10.0.0.6ssh-copy-id root@10.0.0.7

　　2、关闭SElinux、关闭防火墙

# 关闭防火墙systemctl stop firewalldsystemctl disable firewalld# 关闭selinuxsed -i 's/enforcing/disabled/' /etc/selinux/config  # 永久setenforce 0  # 临时

　　3、安装tiup工具

curl --proto '=https' --tlsv1.2 -sSf  | sh

　　4、安装完成后重新声明环境变量

source .bash_profile

　　5、确认安装位置

which tiup

　　6、安装 TiUP cluster 组件

tiup cluster

　　7、创建 topology.yaml 文件

global:  user: "bbders"  ssh_port: 51668  deploy_dir: "/ssd/tidb-deploy"  data_dir: "/ssd/tidb-data"monitored:  node_exporter_port: 9100  blackbox_exporter_port: 9115  deploy_dir: "/ssd/tidb-deploy/monitored-9100"  data_dir: "/ssd/tidb-data/monitored-9100"  log_dir: "/ssd/tidb-deploy/monitored-9100/log"server_configs:  pd:    replication.enable-placement-rules: truepd_servers:  - host: 10.28.100.151  - host: 10.28.100.160  - host: 10.28.100.161tidb_servers:  - host: 10.28.100.151  - host: 10.28.100.160  - host: 10.28.100.161tikv_servers:  - host: 10.28.100.151  - host: 10.28.100.160  - host: 10.28.100.161monitoring_servers:  - host: 10.28.100.161grafana_servers:  - host: 10.28.100.161alertmanager_servers:  - host: 10.28.100.161

　　8、TiDB基本操作命令

查看已部署的集群$ tiup cluster list启动集群$ tiup cluster start bbders-tidb查看集群状态$ tiup cluster display bbders-tidb

　　9、访问地址

dashboard访问地址：默认用户/密码：root/空Grafana访问地址：默认用户/密码：admin/admin

四、扩容主机

　　1、查看当前配置

tiup cluster list                                     #查看当前的集群名称列表tiup cluster edit-config <cluster-name>               #查看集群配置、拷贝对应的配置

　　2、编写扩容脚本，复制上一步看到的配置信息即可

vi scale-out.yamltikv_servers:- host: 192.168.112.60  ssh_port: 22  port: 20160  status_port: 20180  deploy_dir: /ssd/tidb-deploy/tikv-20160  data_dir: /ssd/tidb-data/tikv-20160  arch: amd64  os: linux- host: 192.168.112.61  ssh_port: 22  port: 20160  status_port: 20180  deploy_dir: /ssd/tidb-deploy/tikv-20160  data_dir: /ssd/tidb-data/tikv-20160  arch: amd64  os: linux- host: 192.168.112.62  ssh_port: 22  port: 20160  status_port: 20180  deploy_dir: /ssd/tidb-deploy/tikv-20160  data_dir: /ssd/tidb-data/tikv-20160  arch: amd64  os: linux

　　3、执行扩容脚本

tiup cluster scale-out <cluster-name> scale-out.yaml

　　4、检查集群状态

tiup cluster display <cluster-name>

　　5、重启grafana

 tiup cluster restart <cluster-name> -R grafana

五、缩容主机节点

　　1、 查看集群信息

tiup cluster display <cluster-name>       查看集群信息

　　2、执行缩容操作

tiup cluster scale-in <cluster-name> --node 10.0.1.5:20160