Hadoop - Winutils

About

Provide basic command line utilities for Hadoop on Windows.

• File System operation equivalent to HDFS - Fs Shell
• Hdfs Task and service operation

It works with hadoop.dll to get local access to the local file system ?

Articles Related

Syntax

winutils.exe --help

Usage: hadoop\bin\winutils.exe [command] ...
Provide basic command line utilities for Hadoop on Windows.

The available commands and their usages are:

chmod          Change file mode bits.

Usage: chmod [OPTION] OCTAL-MODE [FILE]
   or: chmod [OPTION] MODE [FILE]
Change the mode of the FILE to MODE.

   -R: change files and directories recursively

Each MODE is of the form '[ugoa]*([-+=]([rwxX]*|[ugo]))+'.


chown          Change file owner.

Usage: chown [OWNER][:[GROUP]] [FILE]
Change the owner and/or group of the FILE to OWNER and/or GROUP.

Note:
On Linux, if a colon but no group name follows the user name, the group of
the files is changed to that user's login group. Windows has no concept of
a user's login group. So we do not change the group owner in this case.


groups         List user groups.

Usage: groups [OPTIONS] [USERNAME]
Print group information of the specified USERNAME (the current user by default).

OPTIONS: -F format the output by separating tokens with a pipe


hardlink       Hard link operations.

Usage: hardlink create [LINKNAME] [FILENAME] |
       hardlink stat [FILENAME]
Creates a new hardlink on the existing file or displays the number of links
for the given file


ls             List file information.

Usage: ls [OPTIONS] [FILE]
List information about the FILE (the current directory by default).
Using long listing format and list directory entries instead of contents,
and do not dereference symbolic links.
Provides equivalent or similar function as 'ls -ld' on GNU/Linux.

OPTIONS: -L dereference symbolic links
         -F format the output by separating tokens with a pipe


symlink   Create a symbolic link.

Usage: symlink [LINKNAME] [FILENAME]
Creates a symbolic link

0 is returned on success.
2 is returned if the user does no have privilege to create symbolic links.
1 is returned for all other errors.

The default security settings in Windows disallow non-elevated administrators
and all non-administrators from creating symbolic links. The security settings
for symbolic links can be changed in the Local Security Policy management
console.


readlink  Print the target of a symbolic link.

Usage: readlink [LINKNAME]
Prints the target of a symbolic link
The output and returned error codes are similar to the UNIX
readlink command. However no options are accepted.

0 is returned on success.
1 is returned for all errors.



systeminfo     System information.

    Usage: systeminfo
    Prints machine information on stdout
    Comma separated list of the following values.
    VirtualMemorySize(bytes),PhysicalMemorySize(bytes),
    FreeVirtualMemory(bytes),FreePhysicalMemory(bytes),
    NumberOfProcessors,CpuFrequency(Khz),
    CpuTime(MilliSec,Kernel+User)


task           Task operations.

    Usage: task create [TASKNAME] [COMMAND_LINE] |
          task createAsUser [TASKNAME] [USERNAME] [PIDFILE] [COMMAND_LINE] |
          task isAlive [TASKNAME] |
          task kill [TASKNAME]
          task processList [TASKNAME]
    Creates a new task jobobject with taskname
    Creates a new task jobobject with taskname as the user provided
    Checks if task jobobject is alive
    Kills task jobobject
    Prints to stdout a list of processes in the task
    along with their resource usage. One process per line
    and comma separated info per process
    ProcessId,VirtualMemoryCommitted(bytes),
    WorkingSetSize(bytes),CpuTime(Millisec,Kernel+User)
service        Service operations.

    Usage: service
    Starts the nodemanager Windows Secure Container Executor helper service.
    The service must run as a high privileged account (LocalSystem)
    and is used by the nodemanager WSCE to spawn secure containers on Windows.