Dec 17
Cygwin Vs. Hadoop – DFS Copy
Cygwin makes Hadoop MUCH harder to run.
If you’re having problems setting up your DFS file share under Cygwin, see what happened to me. Notice that you have to use the WINDOWS path (C:\\cygwin\\home\\Rajat\\…..) With escape characters.
Rajat@rtde ~/hadoop-0.20.1
$ bin/hadoop dfs -copyFromLocal /home/Rajat/java/mrh/input inputs
copyFromLocal: File /home/Rajat/java/mrh/input does not exist.
Rajat@rtde ~/hadoop-0.20.1
$ bin/hadoop dfs -copyFromLocal C:\cygwin\home\Rajat\java\mrh\input input
copyFromLocal: File C:cygwinhomeRajatjavamrhinput does not exist.
Rajat@rtde ~/hadoop-0.20.1
$ bin/hadoop dfs -copyFromLocal C:\\cygwin\\home\\Rajat\\java\\mrh\\input input
(((THIS WORKED)))
Test:
Rajat@rtde ~/hadoop-0.20.1
$ bin/hadoop dfs -ls
Found 1 items
drwxr-xr-x – Rajat supergroup 0 2009-12-16 23:30 /user/Rajat/input
Rajat@rtde ~/hadoop-0.20.1
$ bin/hadoop dfs -ls input
Found 1 items
-rw-r–r– 1 Rajat supergroup 683956 2009-12-16 23:30 /user/Rajat/input/162523852.csv
2 Comments so far
Leave a comment
thanks, this was super useful, since I ran into the same issue!
- L
I was going through your blog, you have provided use ful tips on hadoop.
Yeah i agree that cygwin makes difficult. I too faced the same type of issues and solved finally
Thanks for your blog on hadoop.
I have blogged my experience with hadoop.
Learn Basics of HDFS in Hadoop
Kiran @ Learn Basis of HDFS and Hadoop? recently posted..Top 10 gzip examples in unix or linux