Hadoop启动命令

来源:互联网 发布:mp3什么牌子比较好知乎 编辑:程序博客网 时间:2024/04/30 02:51
Administrator@20110424-1659 ~
$ net start sshd
▒▒▒▒ķ▒▒▒▒Ѿ▒▒▒▒▒▒▒

▒▒▒▒▒ NET HELPMSG 2182 ▒Ի▒ø▒▒▒İ▒▒▒▒▒


Administrator@20110424-1659 ~
$ ssh localhost

Last login: Sat Nov  2 10:13:07 2013 from 127.0.0.1



Administrator@20110424-1659 ~
$ who
Administrator pty1         2013-11-03 07:26 (127.0.0.1)

Administrator@20110424-1659 ~
$ cd g:

Administrator@20110424-1659 /cygdrive/g
$ cd hadoop-0.20.1

Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1
$ ls
bin          docs                        input        logs
build.xml    hadoop-0.20.1-ant.jar       ivy          NOTICE.txt
c++          hadoop-0.20.1-core.jar      ivy.xml      README.txt
CHANGES.txt  hadoop-0.20.1-examples.jar  lib          src
conf         hadoop-0.20.1-test.jar      librecordio  webapps
contrib      hadoop-0.20.1-tools.jar     LICENSE.txt

Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1
$ cd bin

Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ ./hadoop namenode -format
cygwin warning:
  MS-DOS style path detected: G:\hadoop-0.20.1\/build/native
  Preferred POSIX equivalent is: /cygdrive/g/hadoop-0.20.1/build/native
  CYGWIN environment variable option "nodosfilewarning" turns off this warning.
  Consult the user's guide for more details about POSIX paths:
    http://cygwin.com/cygwin-ug-net/using.html#using-pathnames
13/11/03 07:30:03 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = 20110424-1659/192.168.1.106
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 0.20.1
STARTUP_MSG:   build = http://svn.apache.org/repos/asf/hadoop/common/tags/release-0.20.1-rc1 -r 810220; compiled by 'oom' on Tue Sep  1 20:55:56 UTC 2009
************************************************************/
Re-format filesystem in \tmp\hadoop-SYSTEM\dfs\name ? (Y or N) y
Format aborted in \tmp\hadoop-SYSTEM\dfs\name
13/11/03 07:30:09 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at 20110424-1659/192.168.1.106
************************************************************/

Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ ./start-all.sh
starting namenode, logging to /cygdrive/g/hadoop-0.20.1/bin/../logs/hadoop-Administrator-namenode-20110424-1659.out
localhost: starting datanode, logging to /cygdrive/g/hadoop-0.20.1/bin/../logs/hadoop-Administrator-datanode-20110424-1659.out
localhost: starting secondarynamenode, logging to /cygdrive/g/hadoop-0.20.1/bin/../logs/hadoop-Administrator-secondarynamenode-20110424-1659.out
starting jobtracker, logging to /cygdrive/g/hadoop-0.20.1/bin/../logs/hadoop-Administrator-jobtracker-20110424-1659.out
localhost: starting tasktracker, logging to /cygdrive/g/hadoop-0.20.1/bin/../logs/hadoop-Administrator-tasktracker-20110424-1659.out

Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ ./hadoop dfsadmin -report
Configured Capacity: 68409618432 (63.71 GB)
Present Capacity: 34119011328 (31.78 GB)
DFS Remaining: 34119000064 (31.78 GB)
DFS Used: 11264 (11 KB)
DFS Used%: 0%
Under replicated blocks: 1
Blocks with corrupt replicas: 0
Missing blocks: 0

-------------------------------------------------
Datanodes available: 1 (1 total, 0 dead)

Name: 127.0.0.1:50010
Decommission Status : Normal
Configured Capacity: 68409618432 (63.71 GB)
DFS Used: 11264 (11 KB)
Non DFS Used: 34290607104 (31.94 GB)
DFS Remaining: 34119000064(31.78 GB)
DFS Used%: 0%
DFS Remaining%: 49.87%
Last contact: Sun Nov 03 07:33:22 CST 2013


Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ ./hadoop fs -rmr output
Deleted hdfs://localhost:9000/user/Administrator/output



Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ ls
hadoop             rcc                start-dfs.sh      stop-dfs.sh
hadoop-config.sh   slaves.sh          start-mapred.sh   stop-mapred.sh
hadoop-daemon.sh   start-all.sh       stop-all.sh
hadoop-daemons.sh  start-balancer.sh  stop-balancer.sh

Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ ./hadoop fs -ls
Found 2 items
drwxr-xr-x   - Administrator supergroup          0 2013-11-02 10:50 /user/Administrator/in
drwxr-xr-x   - Administrator supergroup          0 2013-11-03 07:53 /user/Administrator/output


Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ ./hadoop fs -cat output/*
Bye     1
Goodbye 1
Hadoop  2
Hello   2
World   2


Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1/bin
$ cd ..


Administrator@20110424-1659 /cygdrive/g/hadoop-0.20.1
$ bin/hadoop fs -put input2 in  //本地要上传的文件路径  将文件夹input上传到分布式文件系统中。