Try this:

    hdfs dfsadmin -report

With older versions of Hadoop, try this: 

    hadoop dfsadmin -report



### Methods

#### **1. dfsadmin**
In newer versions of HDFS the hadoop CLI for dfsadmin is deprecated:

    $ sudo -u hdfs hadoop dfsadmin -report
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.

So you should be using only `hdfs` at this point. Additionally when on systems where `sudo` is required you run it like so:

    $ sudo -u hdfs hdfs dfsadmin -report

#### **2. fs -df**
You have an additional method available via the `fs` module to `hadoop` as well:

    $ hadoop fs -df -h

### Example output

#### **dfsadmin**
Also to provide a more thorough answer here&#39;s what the output would look like from a single node installation.

    $ sudo -u hdfs hdfs dfsadmin -report
    Configured Capacity: 7504658432 (6.99 GB)
    Present Capacity: 527142912 (502.72 MB)
    DFS Remaining: 36921344 (35.21 MB)
    DFS Used: 490221568 (467.51 MB)
    DFS Used%: 93.00%
    Under replicated blocks: 128
    Blocks with corrupt replicas: 0
    Missing blocks: 0
    Missing blocks (with replication factor 1): 0
    
    -------------------------------------------------
    Live datanodes (1):
    
    Name: 192.168.114.48:50010 (host-192-168-114-48.td.local)
    Hostname: host-192-168-114-48.td.local
    Decommission Status : Normal
    Configured Capacity: 7504658432 (6.99 GB)
    DFS Used: 490221568 (467.51 MB)
    Non DFS Used: 6977515520 (6.50 GB)
    DFS Remaining: 36921344 (35.21 MB)
    DFS Used%: 6.53%
    DFS Remaining%: 0.49%
    Configured Cache Capacity: 0 (0 B)
    Cache Used: 0 (0 B)
    Cache Remaining: 0 (0 B)
    Cache Used%: 100.00%
    Cache Remaining%: 0.00%
    Xceivers: 2
    Last contact: Thu Feb 04 13:35:04 EST 2016
    
In the above example, the HDFS HDD space has been 100% utilized.

#### **fs -df**
That same system with the `-df` subcommand from the `fs` module:

    $ hadoop fs -df -h
    Filesystem                                 Size     Used  Available  Use%
    hdfs://host-192-168-114-48.td.local:8020  7.0 G  467.5 M     18.3 M    7%

## Hadoop version 1:

    hadoop fs -df -h

OR

    hadoop dfsadmin -report


---

## Hadoop version 2:

    hdfs dfs -df -h

OR

    hadoop dfsadmin -report



Try this command:

    hdfs dfsadmin -report

I have just upgraded to Eclipse Juno 4.2. I have a completely clean new workspace, but have imported projects that have previously been used in Eclipse 3.7 and therefore have some Eclipse metadata in them.

When moving to 4.2 I converted a project to use &quot;Project Facets&quot;. The only Facet enabled is &quot;Java&quot;.

However, I regularly get &quot;JPA Java Change Event Handler (Waiting)&quot; appearing in my progress view. I do have JPA annotated classes within the project, but I do not have the JPA facet enabled.

So...why am I getting these tasks being run by Eclipse?

![Screenshot of eclipse progress window][1]

  [1]: http://i.stack.imgur.com/Qh9Fm.png

*Update:* Have submitted bug to Eclipse and it is being looked at by the looks of it: https://bugs.eclipse.org/bugs/show_bug.cgi?id=386171

Why is Eclipse Juno 4.2 running &quot;JPA Java Change Event Handler&quot; processes?

I have got a `a` element for invoking modal:


    &lt;a class=&quot;btn&quot; data-toggle=&quot;modal&quot; data-target=&quot;#myModal&quot; href=&quot;http://some-url&quot; &gt;Launch Modal&lt;/a&gt;

And, say this is my modal:

    &lt;div class=&quot;modal hide&quot; id=&quot;myModal&quot;&gt;
      &lt;div class=&quot;modal-header&quot;&gt;
        &lt;button type=&quot;button&quot; class=&quot;close&quot; data-dismiss=&quot;modal&quot;&gt;&#215;&lt;/button&gt;
        &lt;h3&gt;Modal header&lt;/h3&gt;
      &lt;/div&gt;
      &lt;div class=&quot;modal-body&quot;&gt;
        &lt;p&gt;One fine body…&lt;/p&gt;
      &lt;/div&gt;
      &lt;div class=&quot;modal-footer&quot;&gt;
        &lt;a href=&quot;#&quot; class=&quot;btn&quot; data-dismiss=&quot;modal&quot;&gt;Close&lt;/a&gt;
        &lt;a href=&quot;#&quot; class=&quot;btn btn-primary&quot;&gt;Save changes&lt;/a&gt;
      &lt;/div&gt;
    &lt;/div&gt;

I can bind functions to events fired by modal:

    $(&#39;#myModal&#39;).on(&#39;hidden&#39;, function () {
      // do something…
    })

My question is: How can i access the `a` element -which invoked the modal- from my event subscriber function?

How to get Twitter Bootstrap Modal&#39;s invoker element?

Is there a hdfs command to see available free space in hdfs. We can see that through browser at master:hdfsport in browser , but for some reason I can&#39;t access this and I need some command.
I can see my disk usage through command ./bin/hadoop fs -du -h but cannot see free space available.

Thanks for answer in advance. 

HDFS free space available command

<p>Is there a hdfs command to see available free space in hdfs. We can see that through browser at master:hdfsport in browser , but for some reason I can't access this and I need some command.
I can see my disk usage through command ./bin/hadoop fs -du -h but cannot see free space available.</p>
<p>Thanks for answer in advance.</p>


I am new to hadoop distributed file system, I have done complete installation of hadoop single node on my machine.but after that when i am going to upload data to hdfs it give an error message `Permission Denied`.

Message from terminal with command:

    hduser@ubuntu:/usr/local/hadoop$ hadoop fs -put /usr/local/input-data/ /input
    put: /usr/local/input-data (Permission denied)

    hduser@ubuntu:/usr/local/hadoop$ 


After using sudo and adding hduser to sudouser:

    hduser@ubuntu:/usr/local/hadoop$ sudo bin/hadoop fs -put /usr/local/input-data/ /inwe
    put: org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode=&quot;&quot;:hduser:supergroup:rwxr-xr-x

    hduser@ubuntu:/usr/local/hadoop$ 

Permission denied at hdfs

In Hadoop when do reduce tasks start? Do they start after a certain percentage (threshold) of mappers complete? If so, is this threshold fixed? What kind of threshold is typically used?

When do reduce tasks start in Hadoop?

I have uploaded a Directory to hadoop cluster that is having &quot;,&quot; in its name
like &quot;MyDir, Name&quot; when I am trying to delete this Directory by using rmr hadoop shell command
as following

    hadoop dfs -rmr hdfs://host:port/Navi/MyDir, Name

I&#39;m getting the following messages
rmr: cannot remove hdfs://host:port/Navi/MyDir,: No such file or directory.
rmr: cannot remove Name: No such file or directory.

 
However I have successfully deleted other Directories from the same location, using the same command
i.e. 

    hadoop dfs -rmr hdfs://host:port/dir_path

any solutions to delete such kind of Directories.



How to Delete a directory from Hadoop cluster which is having comma(,) in its name?

I am trying to load a CSV file into a Hive table like so:

    CREATE TABLE mytable
    (
    num1 INT,
    text1 STRING,
    num2 INT,
    text2 STRING
    )
    ROW FORMAT DELIMITED FIELDS TERMINATED BY &quot;,&quot;;

    LOAD DATA LOCAL INPATH &#39;/data.csv&#39;
    OVERWRITE INTO TABLE mytable;    
&lt;br /&gt;
The csv is delimited by an comma (,) and looks like this:

    1, &quot;some text, with comma in it&quot;, 123, &quot;more text&quot;

This will return corrupt data since there is a &#39;,&#39; in the first string.&lt;br/&gt;
Is there a way to set an text delimiter or make Hive ignore the &#39;,&#39; in strings?

I can&#39;t change the delimiter of the csv since it gets pulled from an external source.

Hive load CSV with commas in quoted fields

As far as I understand;

- sort by only sorts with in the reducer

- order by orders things globally but shoves everything into one reducers

- cluster by intelligently distributes stuff into reducers by the key hash and make a sort by

So my question is does cluster by guarantee a global order? distribute by puts the same keys into same reducers but what about the adjacent keys? 

The only document I can find on this is [here][1] and from the example it seems like it orders them globally. But from the definition I feel like it doesn&#39;t always do that.


 [1]:https://cwiki.apache.org/confluence/display/Hive/LanguageManual+SortBy

Hive cluster by vs order by vs sort by

According to the `Hadoop - The Definitive Guide`

&gt; The logical records that FileInputFormats define do not usually fit neatly into HDFS blocks. For example, a TextInputFormat’s logical records are lines, which will cross HDFS boundaries more often than not. This has no bearing on the functioning of your program—lines are not missed or broken, for example—but it’s worth knowing about, as it does mean that data-local maps (that is, maps that are running on the same host as their input data) will perform some remote reads. The slight overhead this causes is not normally significant.

Suppose a record line is split across two blocks (b1 and b2). The mapper processing the first block (b1) will notice that the last line doesn&#39;t have a EOL separator and fetches the remaining of the line from the next block of data (b2).

How does the mapper processing the second block (b2) determine that the first record is incomplete and should process starting from the second record in the block (b2)?

How does Hadoop process records split across block boundaries?

    root# bin/hadoop fs -mkdir t
    mkdir: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /user/root/t. Name node is in safe mode.

not able to create anything in hdfs

I did 

    root# bin/hadoop fs -safemode leave

But showing 

    safemode: Unknown command

what is the problem?

Solution: http://unmeshasreeveni.blogspot.com/2014/04/name-node-is-in-safe-mode-how-to-leave.html?m=1



Name node is in safe mode. Not able to leave

I want to create a file in HDFS and write data in that. I used this code:
    
    Configuration config = new Configuration();     
    FileSystem fs = FileSystem.get(config);	
    Path filenamePath = new Path(&quot;input.txt&quot;);	
	try {
        if (fs.exists(filenamePath)) {
            fs.delete(filenamePath, true);
		}
	 
        FSDataOutputStream fin = fs.create(filenamePath);
        fin.writeUTF(&quot;hello&quot;);
        fin.close();
    }

It creates the file, but it does&#39;t write anything in it. I searched a lot but 
didn&#39;t find anything. What is my problem? Do I need any permission to write in HDFS?

Thanks.	

Content Type	Original Author	Original Content on Stackoverflow
Question	Animesh Raj Jha	View Question on Stackoverflow
Solution 1 - Hadoop	Razvan	View Answer on Stackoverflow
Solution 2 - Hadoop	slm	View Answer on Stackoverflow
Solution 3 - Hadoop	Ani Menon	View Answer on Stackoverflow
Solution 4 - Hadoop	nixxo_raa	View Answer on Stackoverflow

HDFS free space available command

Hadoop Problem Overview

Hadoop Solutions

Solution 1 - Hadoop

Solution 2 - Hadoop

Methods

1. dfsadmin

2. fs -df

Example output

dfsadmin

fs -df

Solution 3 - Hadoop

Hadoop version 1:

Hadoop version 2:

Solution 4 - Hadoop

How to get Twitter Bootstrap Modal's invoker element?

Why is Eclipse Juno 4.2 running "JPA Java Change Event Handler" processes?

Attributions