一:集群规划
1:集群规划
集群模式下,可以配置多个Master和多个woker通常来讲,2-3个Master若干个Worker是相对合理的。如果集群资源有限,此处配置一个 Master,三个Worker,进群规划如下:
|--------------------|-----------------------------|
| 192.168.67.133 | MySQL8.0.44 |
| 192.168.67.137 | Master、Worker、Zookeeper |
| 192.168.67.138 | Worker、Zookeeper |
| 192.168.67.139 | Worker、Zookeeper |
2:物理机准备工作
1:三台物理机都部署jdk1.8并且配置环境变量Hadoop home
2:部署MySQL数据库,数据库版本5.7+ 或者 PG 8.2.15+
3:需要部署Zookeeper(3.4.6+)这里我们选择3.6.14
4:三台节点均需要安装进程树分析工具psmisc
给三台物理机安装psmisc
[root@localhost ~]# yum install -y psmisc Loaded plugins: fastestmirror, langpacks Loading mirror speeds from cached hostfile * base: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.com base | 3.6 kB 00:00:00 docker-ce-stable | 3.5 kB 00:00:00 extras | 2.9 kB 00:00:00 updates | 2.9 kB 00:00:00 Package psmisc-22.20-17.el7.x86_64 already installed and latest version Nothing to do [root@localhost ~]#第二步:给192.168.67.133安装zookeeper