DEV Community

shubham mishra
shubham mishra

Posted on

1

Hadoop hdfs

The File System (FS) shell includes various shell-like commands that directly interact with the Hadoop Distributed File System (HDFS) as well as other file systems that Hadoop supports, such as Local FS, WebHDFS, S3 FS, and others. The FS shell is invoked by:

**Hadoop HDFS Commands
**Most of the commands in FS shell behave like corresponding Unix commands. Differences are described with each of the commands. Error information is sent to stderr and the output is sent to stdout.

If HDFS is being used, hdfs dfs is a synonym. Relative paths can be used. For HDFS, the current working directory is the HDFS home directory /user/ that often has to be created manually. The HDFS home directory can also be implicitly accessed, e.g., when using the HDFS trash folder, the .Trash directory in the home directory.

We will start with some very basic help commands and go into more detail as we go through this lesson.

  • fsck
  • ls
  • mkdir
  • touchz
  • du
  • cat
  • text
  • copyFromLocal
  • copyToLocal
  • put
  • get
  • count
  • rm
  • rm -r
  • cp
  • mv
  • expunge
  • rmdir
  • usage
  • help

Heroku

Deliver your unique apps, your own way.

Heroku tackles the toil — patching and upgrading, 24/7 ops and security, build systems, failovers, and more. Stay focused on building great data-driven applications.

Learn More

Top comments (0)

Jetbrains image

Build Secure, Ship Fast

Discover best practices to secure CI/CD without slowing down your pipeline.

Read more

👋 Kindness is contagious

Value this insightful article and join the thriving DEV Community. Developers of every skill level are encouraged to contribute and expand our collective knowledge.

A simple “thank you” can uplift someone’s spirits. Leave your appreciation in the comments!

On DEV, exchanging expertise lightens our path and reinforces our bonds. Enjoyed the read? A quick note of thanks to the author means a lot.

Okay