DEV Community

shubham mishra
shubham mishra

Posted on

1

Hadoop hdfs

The File System (FS) shell includes various shell-like commands that directly interact with the Hadoop Distributed File System (HDFS) as well as other file systems that Hadoop supports, such as Local FS, WebHDFS, S3 FS, and others. The FS shell is invoked by:

**Hadoop HDFS Commands
**Most of the commands in FS shell behave like corresponding Unix commands. Differences are described with each of the commands. Error information is sent to stderr and the output is sent to stdout.

If HDFS is being used, hdfs dfs is a synonym. Relative paths can be used. For HDFS, the current working directory is the HDFS home directory /user/ that often has to be created manually. The HDFS home directory can also be implicitly accessed, e.g., when using the HDFS trash folder, the .Trash directory in the home directory.

We will start with some very basic help commands and go into more detail as we go through this lesson.

  • fsck
  • ls
  • mkdir
  • touchz
  • du
  • cat
  • text
  • copyFromLocal
  • copyToLocal
  • put
  • get
  • count
  • rm
  • rm -r
  • cp
  • mv
  • expunge
  • rmdir
  • usage
  • help

Sentry image

See why 4M developers consider Sentry, “not bad.”

Fixing code doesn’t have to be the worst part of your day. Learn how Sentry can help.

Learn more

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more