本文共 2548 字,大约阅读时间需要 8 分钟。
配置IP地址并访问外网
确保虚拟机网卡配置正确,通过 uniformsorus注入图片Promise检查网络IP地址,并验证能够正常ping外网服务器。设置主机名和DNS解析
修改主机名为hadoop
,并在/etc/hosts
文件中添加记录:hostname hadoopvi /etc/hosts
示例内容:
127.0.0.1 localhost172.24.48.10 hadoop
禁用防火墙和SELINUX
禁用CentOS的防火墙:systemctl stop firewalldsystemctl disable firewalld
禁用SELINUX:
vi /etc/sysconfig/selinuxSELINUX=disabled
cd /usr/libmkdir javacd /usr/localmkdir soft
cd /usr/local/soft/tar -zxvf jdk-8u171-linux-x64.tar.gz -C /usr/local/javatar -zxvf hadoop-2.7.3.tar.gz -C /usr/local/ hadoop
vi /etc/profile
在文件末尾添加:
JAVA_HOME=/usr/local/java/jdk1.8.0_171export PATH=$PATH:$JAVA_HOME/binHADOOP_HOME=/usr/local/hadoopexport PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
应用修改:
source /etc/profile
java -version
输出示例:
java version "1.8.0_171"
修改hadoop-env.sh
:
vi hadoop-env.sh
添加:
export JAVA_HOME=/usr/local/java/jdk1.8.0_171
修改core-site.xml
:
vi core-site.xml
添加内容:
fs.defaultFS hdfs://hadoop:9000 hadoop.tmp.dir /opt/hadoop/tmp
修改hdfs-site.xml
:
vi hdfs-site.xml
添加内容:
dfs.replication 1
修改mapred-site.xml
:
mv mapred-site.xml.template mapred-site.xmlvi mapred-site.xml
添加内容:
mapreduce.framework.name yarn
修改yarn-site.xml
:
vi yarn-site.xml
添加内容:
yarn.resourcemanager.hostname hadoop yarn.nodemanager.aux-services mapreduce_shuffle
hdfs namenode -format
cd /usr/local/hadoop/bin/'start-all.sh
查看进程:
jps
输出示例:
9798 SecondaryNameNode9943 ResourceManager9528 NameNode9646 DataNode10318 Jps10223 NodeManager
hadoop fs -mkdir /userhadoop fs -put /opt/example-wordcount.txt /user/input/hdfs dfs -ls /user/input/
运行MapReduce任务:
hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount /user/input/example-wordcount.txt /user/input/wordcount-result
查看任务日志:
tail -f /tmp/hadoop/mapreduce/mapred*log
tar -zxvf apache-tomcat-10.0.5.tar.gz -C /optmv apache-tomcat-10.0.5/ tomcat10
cd /opt/tomcat10/bin/./startup.sh
查看启动日志:
tail -f /opt/tomcat10/conf Catalina.out
转载地址:http://xchwk.baihongyu.com/