centos6.5 64位下如何编译hadoop2.5.1源码

在CentOS 6.5 64位系统上如何编译Hadoop 2.5.1源码

下载Hadoop 2.5.1源码

wget http://www.us.apache.org/dist/hadoop/common/hadoop-2.5.1/hadoop-2.5.1-src.tar.gz

解压Hadoop 2.5.1源码

tar -zxvf hadoop-2.5.1-src.tar.gz

进入Hadoop 2.5.1源码目录

cd hadoop-2.5.1-src

修改Hadoop 2.5.1源码中的JAVA_HOME目录

vim hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

export JAVA_HOME=/usr/local/jdk1.8.0_144

修改Hadoop 2.5.1源码中的HADOOP_OPTS参数

vim hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

export HADOOP_OPTS="$HADOOP_OPTS -Djava.net.preferIPv4Stack=true"

编译Hadoop 2.5.1源码

mvn package -DskipTests

安装Hadoop 2.5.1

sudo mkdir -p /usr/local/hadoop/

sudo cp -r hadoop-dist/target/hadoop-2.5.1 /usr/local/hadoop/

配置Hadoop环境变量

vim /etc/profile

export HADOOP_HOME=/usr/local/hadoop/hadoop-2.5.1

export PATH=$PATH:$HADOOP_HOME/bin

使Hadoop环境变量生效

source /etc/profile

查看Hadoop版本

hadoop version