hdfs

HDFS Cheat Sheet

HDFS is a hadoop file system, notice is a FUSE filesystem.

Thus, to manipulate files from local folder to HDFS you may need to apply some commands which are quite similar to linux CMD commands. if you know linux – this should be trivial, just notice the source and destination paths

HDFS commands list to copy / move / files

haoop fs -put <localsrc> <dest>

hadoop fs -get <src> <localdest>

hadoop fs –mkdir /path/directory_name

hadoop fs –ls /path/directory_name

hadoop fs -copyFromLocal <localsrc> <hdfs destination>

hadoop fs -copyToLocal <hdfs source> <localdst>

hadoop fs –cat /path_to_file_in_hdfs

hadoop fs -mv <src> <dest>

Leave a Reply