Ambari 集群配置
- 选择你需要安装的服务然后进入到配置界面
调整配置项
hadoop hue 依赖配置
- 检查确认是否有下列配置项,后面hue 要使用;
- hue for HDFS
## core-site.xml
hadoop.proxyuser.falcon.groups=*
hadoop.proxyuser.falcon.hosts=*
hadoop.proxyuser.hbase.groups=*
hadoop.proxyuser.hbase.hosts=*
hadoop.proxyuser.hcat.groups=*
hadoop.proxyuser.hcat.hosts=*
hadoop.proxyuser.httpfs.groups=*
hadoop.proxyuser.httpfs.hosts=*
hadoop.proxyuser.hue.groups=*
hadoop.proxyuser.hue.hosts=*
hadoop.proxyuser.root.hosts=*
hadoop.proxyuser.root.groups=*
hadoop.proxyuser.yarn.hosts=*
hadoop.proxyuser.yarn.groups=*
hadoop.proxyuser.mapred.hosts=*
hadoop.proxyuser.mapred.groups=*
## hdfs-site.xml
# 关闭权限
dfs.permissions.enabled=false
Hive
- 连接数据库时使用,ambari 页面会有提示根据提示进行操作即可
[root@dt1 ~]# ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java-5.1.48-bin.jar
Using python /usr/bin/python
Setup ambari-server
Copying /usr/share/java/mysql-connector-java-5.1.48-bin.jar to /var/lib/ambari-server/resources
If you are updating existing jdbc driver jar for mysql with mysql-connector-java-5.1.48-bin.jar. Please remove the old driver jar, from all hosts. Restarting services that need the driver, will automatically copy the new jar to the hosts.
JDBC driver was successfully initialized.
Ambari Server 'setup' completed successfully.
Oozie
- ambari 初始化安装时添加下列参数
## oozie-site.xml
oozie.service.ProxyUserService.proxyuser.hive.groups=*
oozie.service.ProxyUserService.proxyuser.hive.hosts=*
oozie.service.ProxyUserService.proxyuser.hue.groups=*
oozie.service.ProxyUserService.proxyuser.hue.hosts=*
oozie.processing.timezone=GMT+0800
- 最终安装结果如下图
Hadoop HA
- ambari 默认安装hadoop时,没有启用HA 高可用,所以当安装完成后需要再次点击启用HA
- 参考Ambari Hadoop安装启用HA
剩下的步骤根据提示一步步操作即可!
yarn HA
- 与hadoop ha 一样点击开启HA,根据步骤操作即可
hadoop-httpfs
yum install -y hadoop-httpfs
安装完成后,无法正常启动;原因是由于缺失相关目录:
打补丁:
-
下载 hadoop-httpfs_3.x_patch.tar.gz;解压后执行patch.sh
-
启动hadoop-httpfs
## root用户操作
# mkdir -p /var/run/hadoop/httpfs
# chmod 777 /var/run/hadoop/httpfs
# /usr/hdp/current/hadoop-httpfs/etc/rc.d/init.d/hadoop-httpfs start