sqoop 1.4.5 导入 hbase 0.94.21

来源:互联网 发布:粒子群算法详解和实例 编辑:程序博客网 时间:2024/05/17 16:46


[jifeng@jifeng02 sqoop]$ bin/sqoop  import  --connect jdbc:mysql://10.x.x.x:3306/lir --username dss --password xxx123 --table bb_month --hbase-table bb_month --hbase-create-table --hbase-row-key ID --column-family diquWarning: /home/jifeng/sqoop/../hcatalog does not exist! HCatalog jobs will fail.Please set $HCAT_HOME to the root of your HCatalog installation.Warning: /home/jifeng/sqoop/../accumulo does not exist! Accumulo imports will fail.Please set $ACCUMULO_HOME to the root of your Accumulo installation.Warning: $HADOOP_HOME is deprecated.14/09/08 21:19:43 INFO sqoop.Sqoop: Running Sqoop version: 1.4.514/09/08 21:19:43 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.14/09/08 21:19:43 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.14/09/08 21:19:43 INFO tool.CodeGenTool: Beginning code generation14/09/08 21:19:44 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `bb_month` AS t LIMIT 114/09/08 21:19:44 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `bb_month` AS t LIMIT 114/09/08 21:19:44 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/jifeng/hadoop/hadoop-1.2.1注: /tmp/sqoop-jifeng/compile/42f3e8bac7bf9527e884da96d72ed7a9/bb_month.java使用或覆盖了已过时的 API。注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。14/09/08 21:19:44 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-jifeng/compile/42f3e8bac7bf9527e884da96d72ed7a9/bb_month.jar14/09/08 21:19:44 WARN manager.MySQLManager: It looks like you are importing from mysql.14/09/08 21:19:44 WARN manager.MySQLManager: This transfer can be faster! Use the --direct14/09/08 21:19:44 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.14/09/08 21:19:44 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)14/09/08 21:19:44 INFO mapreduce.ImportJobBase: Beginning import of bb_month14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:host.name=jifeng0214/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_6514/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.home=/home/jifeng/jdk1.7.0_45/jre14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/jifeng/hadoop/hadoop-1.2.1/libexec/../conf:/home/jifeng/jdk1.7.0_45/lib/tools.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/..:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../hadoop-core-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/asm-3.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjrt-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjtools-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-1.7.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-cli-1.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-codec-1.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-collections-3.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-configuration-1.6.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-daemon-1.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-digester-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-el-1.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-httpclient-3.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-io-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-lang-2.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-1.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-api-1.0.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-math-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-net-3.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/core-3.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-capacity-scheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-fairscheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-thriftfs-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hsqldb-1.8.0.10.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-compiler-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-runtime-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jdeb-0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-core-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-json-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-server-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jets3t-0.6.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-util-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsch-0.1.42.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/junit-4.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/kfs-0.2.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/log4j-1.2.15.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/mockito-all-1.8.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/oro-2.0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/servlet-api-2.5-20081211.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-api-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-log4j12-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/xmlenc-0.52.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/home/jifeng/sqoop/conf::/home/jifeng/sqoop/lib/ant-contrib-1.0b3.jar:/home/jifeng/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/home/jifeng/sqoop/lib/avro-1.7.5.jar:/home/jifeng/sqoop/lib/avro-mapred-1.7.5-hadoop2.jar:/home/jifeng/sqoop/lib/commons-compress-1.4.1.jar:/home/jifeng/sqoop/lib/commons-io-1.4.jar:/home/jifeng/sqoop/lib/hsqldb-1.8.0.10.jar:/home/jifeng/sqoop/lib/jackson-core-asl-1.9.13.jar:/home/jifeng/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/home/jifeng/sqoop/lib/libthrift-0.9.0.jar:/home/jifeng/sqoop/lib/mysql-connector-java-5.1.32-bin.jar:/home/jifeng/sqoop/lib/paranamer-2.3.jar:/home/jifeng/sqoop/lib/snappy-java-1.0.5.jar:/home/jifeng/sqoop/lib/xz-1.0.jar:/home/jifeng/hbase-0.94.21/conf:/home/jifeng/jdk1.7.0_45/lib/tools.jar:/home/jifeng/hbase-0.94.21:/home/jifeng/hbase-0.94.21/hbase-0.94.21.jar:/home/jifeng/hbase-0.94.21/hbase-0.94.21-tests.jar:/home/jifeng/hbase-0.94.21/lib/activation-1.1.jar:/home/jifeng/hbase-0.94.21/lib/asm-3.1.jar:/home/jifeng/hbase-0.94.21/lib/avro-1.5.3.jar:/home/jifeng/hbase-0.94.21/lib/avro-ipc-1.5.3.jar:/home/jifeng/hbase-0.94.21/lib/commons-beanutils-1.7.0.jar:/home/jifeng/hbase-0.94.21/lib/commons-beanutils-core-1.8.0.jar:/home/jifeng/hbase-0.94.21/lib/commons-cli-1.2.jar:/home/jifeng/hbase-0.94.21/lib/commons-codec-1.4.jar:/home/jifeng/hbase-0.94.21/lib/commons-collections-3.2.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-configuration-1.6.jar:/home/jifeng/hbase-0.94.21/lib/commons-digester-1.8.jar:/home/jifeng/hbase-0.94.21/lib/commons-el-1.0.jar:/home/jifeng/hbase-0.94.21/lib/commons-httpclient-3.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-io-2.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-lang-2.5.jar:/home/jifeng/hbase-0.94.21/lib/commons-logging-1.1.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-math-2.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-net-1.4.1.jar:/home/jifeng/hbase-0.94.21/lib/core-3.1.1.jar:/home/jifeng/hbase-0.94.21/lib/guava-11.0.2.jar:/home/jifeng/hbase-0.94.21/lib/hadoop-core-1.2.1.jar:/home/jifeng/hbase-0.94.21/lib/hamcrest-core-1.3.jar:/home/jifeng/hbase-0.94.21/lib/high-scale-lib-1.1.1.jar:/home/jifeng/hbase-0.94.21/lib/httpclient-4.1.2.jar:/home/jifeng/hbase-0.94.21/lib/httpcore-4.1.3.jar:/home/jifeng/hbase-0.94.21/lib/jackson-core-asl-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jackson-jaxrs-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jackson-mapper-asl-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jackson-xc-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jamon-runtime-2.3.1.jar:/home/jifeng/hbase-0.94.21/lib/jasper-compiler-5.5.23.jar:/home/jifeng/hbase-0.94.21/lib/jasper-runtime-5.5.23.jar:/home/jifeng/hbase-0.94.21/lib/jaxb-api-2.1.jar:/home/jifeng/hbase-0.94.21/lib/jaxb-impl-2.2.3-1.jar:/home/jifeng/hbase-0.94.21/lib/jersey-core-1.8.jar:/home/jifeng/hbase-0.94.21/lib/jersey-json-1.8.jar:/home/jifeng/hbase-0.94.21/lib/jersey-server-1.8.jar:/home/jifeng/hbase-0.94.21/lib/jettison-1.1.jar:/home/jifeng/hbase-0.94.21/lib/jetty-6.1.26.jar:/home/jifeng/hbase-0.94.21/lib/jetty-util-6.1.26.jar:/home/jifeng/hbase-0.94.21/lib/jruby-complete-1.6.5.jar:/home/jifeng/hbase-0.94.21/lib/jsp-2.1-6.1.14.jar:/home/jifeng/hbase-0.94.21/lib/jsp-api-2.1-6.1.14.jar:/home/jifeng/hbase-0.94.21/lib/jsr305-1.3.9.jar:/home/jifeng/hbase-0.94.21/lib/junit-4.11.jar:/home/jifeng/hbase-0.94.21/lib/libthrift-0.8.0.jar:/home/jifeng/hbase-0.94.21/lib/log4j-1.2.16.jar:/home/jifeng/hbase-0.94.21/lib/metrics-core-2.1.2.jar:/home/jifeng/hbase-0.94.21/lib/netty-3.2.4.Final.jar:/home/jifeng/hbase-0.94.21/lib/protobuf-java-2.4.0a.jar:/home/jifeng/hbase-0.94.21/lib/servlet-api-2.5-6.1.14.jar:/home/jifeng/hbase-0.94.21/lib/slf4j-api-1.4.3.jar:/home/jifeng/hbase-0.94.21/lib/slf4j-log4j12-1.4.3.jar:/home/jifeng/hbase-0.94.21/lib/snappy-java-1.0.3.2.jar:/home/jifeng/hbase-0.94.21/lib/stax-api-1.0.1.jar:/home/jifeng/hbase-0.94.21/lib/velocity-1.7.jar:/home/jifeng/hbase-0.94.21/lib/xmlenc-0.52.jar:/home/jifeng/hbase-0.94.21/lib/zookeeper-3.4.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../conf:/home/jifeng/jdk1.7.0_45/lib/tools.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/..:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../hadoop-core-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/asm-3.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjrt-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjtools-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-1.7.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-cli-1.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-codec-1.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-collections-3.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-configuration-1.6.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-daemon-1.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-digester-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-el-1.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-httpclient-3.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-io-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-lang-2.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-1.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-api-1.0.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-math-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-net-3.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/core-3.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-capacity-scheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-fairscheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-thriftfs-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hsqldb-1.8.0.10.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-compiler-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-runtime-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jdeb-0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-core-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-json-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-server-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jets3t-0.6.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-util-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsch-0.1.42.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/junit-4.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/kfs-0.2.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/log4j-1.2.15.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/mockito-all-1.8.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/oro-2.0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/servlet-api-2.5-20081211.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-api-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-log4j12-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/xmlenc-0.52.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/conf:/home/jifeng/sqoop/sqoop-1.4.5.jar:/home/jifeng/sqoop/sqoop-test-1.4.5.jar:14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/native/Linux-i386-3214/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:os.arch=i38614/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.el6.i68614/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:user.name=jifeng14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/jifeng14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/jifeng/sqoop14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=jifeng02:2181,jifeng01:2181 sessionTimeout=180000 watcher=hconnection14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Opening socket connection to server jifeng02/10.5.4.55:2181. Will not attempt to authenticate using SASL (unknown error)14/09/08 21:19:45 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 1516@jifeng0214/09/08 21:19:45 INFO zookeeper.ClientCnxn: Socket connection established to jifeng02/10.5.4.55:2181, initiating session14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Session establishment complete on server jifeng02/10.5.4.55:2181, sessionid = 0x1484b8856b20001, negotiated timeout = 18000014/09/08 21:19:45 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=jifeng02:2181,jifeng01:2181 sessionTimeout=180000 watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@b8acae14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Opening socket connection to server jifeng02/10.5.4.55:2181. Will not attempt to authenticate using SASL (unknown error)14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Socket connection established to jifeng02/10.5.4.55:2181, initiating session14/09/08 21:19:45 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 1516@jifeng0214/09/08 21:19:45 INFO zookeeper.ClientCnxn: Session establishment complete on server jifeng02/10.5.4.55:2181, sessionid = 0x1484b8856b20002, negotiated timeout = 18000014/09/08 21:19:45 INFO zookeeper.ZooKeeper: Session: 0x1484b8856b20002 closed14/09/08 21:19:45 INFO mapreduce.HBaseImportJob: Creating missing HBase table bb_month14/09/08 21:19:45 INFO zookeeper.ClientCnxn: EventThread shut down14/09/08 21:19:46 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=jifeng02:2181,jifeng01:2181 sessionTimeout=180000 watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@b8acae14/09/08 21:19:46 INFO zookeeper.ClientCnxn: Opening socket connection to server jifeng01/10.5.4.54:2181. Will not attempt to authenticate using SASL (unknown error)14/09/08 21:19:46 INFO zookeeper.ClientCnxn: Socket connection established to jifeng01/10.5.4.54:2181, initiating session14/09/08 21:19:46 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 1516@jifeng0214/09/08 21:19:46 INFO zookeeper.ClientCnxn: Session establishment complete on server jifeng01/10.5.4.54:2181, sessionid = 0x484b88593f0006, negotiated timeout = 18000014/09/08 21:19:46 INFO zookeeper.ZooKeeper: Session: 0x484b88593f0006 closed14/09/08 21:19:46 INFO zookeeper.ClientCnxn: EventThread shut down14/09/08 21:19:46 INFO db.DBInputFormat: Using read commited transaction isolation14/09/08 21:19:46 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`ID`), MAX(`ID`) FROM `bb_month`14/09/08 21:19:47 INFO mapred.JobClient: Running job: job_201409072150_001814/09/08 21:19:48 INFO mapred.JobClient:  map 0% reduce 0%14/09/08 21:20:02 INFO mapred.JobClient:  map 25% reduce 0%14/09/08 21:20:03 INFO mapred.JobClient:  map 75% reduce 0%14/09/08 21:20:04 INFO mapred.JobClient:  map 100% reduce 0%14/09/08 21:20:04 INFO mapred.JobClient: Job complete: job_201409072150_001814/09/08 21:20:04 INFO mapred.JobClient: Counters: 1714/09/08 21:20:04 INFO mapred.JobClient:   Job Counters 14/09/08 21:20:04 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=2636114/09/08 21:20:04 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=014/09/08 21:20:04 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=014/09/08 21:20:04 INFO mapred.JobClient:     Launched map tasks=414/09/08 21:20:04 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=014/09/08 21:20:04 INFO mapred.JobClient:   File Output Format Counters 14/09/08 21:20:04 INFO mapred.JobClient:     Bytes Written=014/09/08 21:20:04 INFO mapred.JobClient:   FileSystemCounters14/09/08 21:20:04 INFO mapred.JobClient:     HDFS_BYTES_READ=40914/09/08 21:20:04 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=37976314/09/08 21:20:04 INFO mapred.JobClient:   File Input Format Counters 14/09/08 21:20:04 INFO mapred.JobClient:     Bytes Read=014/09/08 21:20:04 INFO mapred.JobClient:   Map-Reduce Framework14/09/08 21:20:04 INFO mapred.JobClient:     Map input records=4314/09/08 21:20:04 INFO mapred.JobClient:     Physical memory (bytes) snapshot=28081766414/09/08 21:20:04 INFO mapred.JobClient:     Spilled Records=014/09/08 21:20:04 INFO mapred.JobClient:     CPU time spent (ms)=437014/09/08 21:20:04 INFO mapred.JobClient:     Total committed heap usage (bytes)=9633792014/09/08 21:20:04 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=175606169614/09/08 21:20:04 INFO mapred.JobClient:     Map output records=4314/09/08 21:20:04 INFO mapred.JobClient:     SPLIT_RAW_BYTES=40914/09/08 21:20:04 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 18.5066 seconds (0 bytes/sec)14/09/08 21:20:04 INFO mapreduce.ImportJobBase: Retrieved 43 records.[jifeng@jifeng02 sqoop]$ 
 Hbase查看

[jifeng@jifeng01 ~]$ hbase shellHBase Shell; enter 'help<RETURN>' for list of supported commands.Type "exit<RETURN>" to leave the HBase ShellVersion 0.94.21, r83b4a1ee9b9a2fa4c7ae1739259e041cabe8edc2, Fri Jun 27 16:14:16 UTC 2014hbase(main):001:0> listTABLE                                                                                                       bb_month                                                                                                    testtable                                                                                                   2 row(s) in 0.6190 secondshbase(main):002:0> count bb_month;hbase(main):003:0* hbase(main):004:0* [jifeng@jifeng01 ~]$ [jifeng@jifeng01 ~]$ hbase shellHBase Shell; enter 'help<RETURN>' for list of supported commands.Type "exit<RETURN>" to leave the HBase ShellVersion 0.94.21, r83b4a1ee9b9a2fa4c7ae1739259e041cabe8edc2, Fri Jun 27 16:14:16 UTC 2014hbase(main):001:0> listTABLE                                                                                                       bb_month                                                                                                    testtable                                                                                                   2 row(s) in 0.5700 secondshbase(main):009:0> describe 'bb_month'DESCRIPTION                                                            ENABLED                               'bb_month', {NAME => 'diqu', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILT true                                  ER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION                                        => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CEL                                       LS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_                                       DISK => 'true', BLOCKCACHE => 'true'}                                                                      1 row(s) in 0.0920 secondshbase(main):010:0> get 'bb_month','174'COLUMN                       CELL                                                                           0 row(s) in 0.0670 secondshbase(main):011:0> get 'bb_month','175'COLUMN                       CELL                                                                           0 row(s) in 0.0130 secondshbase(main):013:0> scan 'bb_month'ROW                          COLUMN+CELL                                                                     295                         column=diqu:FactPrice, timestamp=1410182401784, value=172499.0000               295                         column=diqu:Fcom, timestamp=1410182401784, value=CRO                            295                         column=diqu:HospPrice, timestamp=1410182401784, value=172499.0000               295                         column=diqu:Inputdate, timestamp=1410182401784, value=2014-02                   295                         column=diqu:RatePrice, timestamp=1410182401784, value=172499.0000               295                         column=diqu:Requestid, timestamp=1410182401784, value=986.0000                  295                         column=diqu:StandPrice, timestamp=1410182401784, value=149946.0000              295                         column=diqu:month, timestamp=1410182401784, value=2                             295                         column=diqu:quarter, timestamp=1410182401784, value=1                           295                         column=diqu:year, timestamp=1410182401784, value=2014                          ......                        715                         column=diqu:FactPrice, timestamp=1410182402013, value=22.0000                   715                         column=diqu:Fcom, timestamp=1410182402013, value=\xE5\xB9\xBF\xE5\xB7\x9E       715                         column=diqu:HospPrice, timestamp=1410182402013, value=22.0000                   715                         column=diqu:Inputdate, timestamp=1410182402013, value=2014-04                   715                         column=diqu:RatePrice, timestamp=1410182402013, value=22.0000                   715                         column=diqu:Requestid, timestamp=1410182402013, value=22.0000                   715                         column=diqu:StandPrice, timestamp=1410182402013, value=22.0000                  715                         column=diqu:month, timestamp=1410182402013, value=3                             715                         column=diqu:quarter, timestamp=1410182402013, value=1                           715                         column=diqu:year, timestamp=1410182402013, value=2014                          43 row(s) in 0.7130 secondshbase(main):014:0> get 'bb_month','295'COLUMN                       CELL                                                                            diqu:FactPrice              timestamp=1410182401784, value=172499.0000                                      diqu:Fcom                   timestamp=1410182401784, value=CRO                                              diqu:HospPrice              timestamp=1410182401784, value=172499.0000                                      diqu:Inputdate              timestamp=1410182401784, value=2014-02                                          diqu:RatePrice              timestamp=1410182401784, value=172499.0000                                      diqu:Requestid              timestamp=1410182401784, value=986.0000                                         diqu:StandPrice             timestamp=1410182401784, value=149946.0000                                      diqu:month                  timestamp=1410182401784, value=2                                                diqu:quarter                timestamp=1410182401784, value=1                                                diqu:year                   timestamp=1410182401784, value=2014                                            10 row(s) in 0.0270 secondshbase(main):015:0> 



0 0
原创粉丝点击