Skip to content

Instantly share code, notes, and snippets.

@github101

github101/hadoop envirnoment for development

Created July 30, 2012 10:43
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save github101/3206135 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save github101/3206135 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. github101 created this gist Jul 30, 2012.
    43 changes: 43 additions & 0 deletions hadoop envirnoment for development
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,43 @@
    ### Hadoop 伪分布式开发环境

    ##### 创建账号 Hadoop账号
    <pre>
    groupadd hadoop
    mkdir /home/hadoop
    useradd -g hadoop -d /home/hadoop -s /bin/bash hadoop

    passwd hadoop

    cp /home/xxx/.bashrc /home/hadoop

    chown -R hadoop:hadoop /home/hadoop

    su - hadoop

    ssh-keygen -t rsa

    cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
    chmod 600 ~/.ssh/authorized_keys
    </pre>

    #### 设置个人Java运行环境变量，该安装包自带了JDK-1.6.u26版本


    ##### 在.bashrc尾部添加jdk环境变量
    <pre>
    export JAVA_HOME=/home/hadoop/jdk1.6.0_26
    export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
    export PATH=$JAVA_HOME/bin:$PATH

    source .bashrc
    </pre>

    ##### 软件包现在地址

    <http://dl.dropbox.com/u/62934464/hadoop_env.tar.gz/>

    ##### 解压hadoop_env.tar.gz文件
    <pre>
    cd hadoopbin/hadoop namenode -format
    bin/start-all
    </pre>