sqoop入门解析

安装

tar -xvf sqoop-1.99.7-bin-hadoop200.tar.gz

profile配置

vi ~/.bash_profile 
export SQOOP_HOME=/home/zkpk/sqoop-1.99.7-bin-hadoop200
export CATALINA_BASE=$SQOOP_HOME/server
export LOGDIR=$SQOOP_HOME/logs/
export PATH=$PATH:$SQOOP_HOME/bin

source ~/.bash_profile

$SQOOP_HOME/conf配置

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/bigdata/hadoop-2.7.3/etc/hadoop

$HADOOP/etc/hadoop/core-site.xml的代理配置

  
    hadoop.proxyuser.bigdata.hosts
    *
  
  
    hadoop.proxyuser.bigdata.groups
    *
  

$HADOOP/etc/hadoop/yarn-site.xml的代理配置

 
yarn.log-aggregation-enable 
true 

$HADOOP/etc/hadoop/mapred-site.xml的代理配置

  
   mapreduce.jobhistory.address  
     
   master:10020  

mysql的jdbc connector下载并移动

sudo yum install mysql-connector-java #下载
cd /usr/share/java   
cp mysql-connector-java-5.x.xx.jar $SQOOP_HOME/server/lib #jar拷贝

启动hdfs，yarn，historyserver

start-dfs.sh ;start-yarn.sh ;mr-jobhistory-daemon.sh historyserver;

6021 Jps
4647 NameNode
4952 SecondaryNameNode
5979 JobHistoryServer
5213 NodeManager
4751 DataNode

[bigdata@bigdata ~]$ hdfs dfsadmin -safemode leave
Safe mode is OFF

启动Sqoop服务

sqoop.sh server start

启动Sqoop客户端

sqoop2-shell