hadoop in win7 with cygwin

  • Download ‘setup.exe’ from Cygwin website
  • Download hadoop 0.20.2 and hbase 0.20.6 from apache website
  • Add user hadoop
    1
    2
    3
    $ net user hadoop password /add /yes
    $ net localgroup administrator hadoop /add
    $ mkpassd -l -u hadoop >> /etc/passwd
  • Add sshd service
    1
    2
    3
    $ cygrunsrv.exe –remove sshd (no necessary)
    $ ssh-host-config -y
    $ cygrunsrv.exe –start sshd
  • Generate ssh key
    1
    2
    3
    4
    $ ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
    $ cat ~/.ssh/id_dsa.pub » ~/.ssh/authorized_keys
    $ chmod 600 ~/.ssh/authorized_keys
    $ scp ~/.ssh/id_dsa.pub ~/.ssh/authorized_keys 10.13.136.250:/home/hadoop/.ssh
  • Edit file as below
    • core-site.xml
    • hdfs-site.xml
    • mapred-site.xml
    • hadoop-env.sh

Referece

Cygwin for Hadoop (Win 7)
Setting Up Hadoop 0.20.2 on Windows 7 With Cygwin
Hadoop for Windows using Cygwin