Sample Image

Description

It is well documented that Hadoop is best suited for large multi MB, GB, or even TB sized files. Physical limitations on the NameNode memory limit the maximum number of files. Over the course of a day this graph may not be changing, but managing the total files over months and years is critical to hadoop. In our above example we see very large growth in the number of files. This could pose a problem in a few months.

Sample Output

            sh FSNamesystemStatus.sh \
            service:jmx:rmi:///jndi/rmi://10.0.1.2:10001/jmxrmi \
            controlRole yourpassword

            CapacityTotal:2113748992 CapacityUsed:40960 CapacityRemaining:812830720 \
            BlocksTotal:1 FilesTotal:9 numDeadDataNodes:0 numLiveDataNodes:1
          

Code Specific

Unlike some Hadoop variables that are based on a sample period these values when extracted from JMX represent the current state.

Continue to NameNode Blocks