Hadoop JMX 配置的完整文档

一、JMX 基础概念与 Hadoop 支持

1、JMX 作用。

Java Management Extensions（JMX）提供标准 API 监控 JVM 应用运行时状态（内存、线程、GC）及 Hadoop 组件指标（HDFS 容量、RPC 性能、节点状态）

2、Hadoop 组件 JMX 支持

NameNode ：FSNamesystemState（文件系统状态）、NameNodeActivity（操作统计）
DataNode ：DataNodeActivity（数据传输）、FSDatasetState（存储状态）
ResourceManager ：ClusterMetrics（集群资源）、QueueMetrics（队列负载）
NodeManager ：NodeManagerMetrics（容器状态）、ShuffleMetrics（Shuffle 性能）

二、配置

1、namenode

java 复制代码

http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=NameNodeInfo
http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState
http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=NameNodeActivity
http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=JvmMetrics
http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=RpcDetailedActivityForPort8020
http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem
http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=RpcActivityForPort8020
http://hadoop24:9870/jmx?qry=Hadoop:service=NameNode,name=RpcDetailedActivityForPort8022

2、resourceManager

java 复制代码

http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=ClusterMetrics
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=JvmMetrics
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=QueueMetrics,q0=root
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=RpcDetailedActivityForPort8030
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=RpcDetailedActivityForPort8031
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=RpcDetailedActivityForPort8032
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=RpcDetailedActivityForPort8033
http://hadoop24:8088/jmx?qry=java.lang:type=GarbageCollector,name=ConcurrentMarkSweep
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=FSOpDurations
http://hadoop24:8088/jmx?qry=Hadoop:service=ResourceManager,name=EventMetrics

3、datanode

java 复制代码

http://hadoop1:50076/jmx?qry=Hadoop:service=DataNode,name=DataNodeActivity-%s-%s 
http://hadoop1:50076/jmx?qry=Hadoop:service=DataNode,name=JvmMetrics
http://hadoop1:50076/jmx?qry=Hadoop:service=DataNode,name=RpcActivityForPort%s
http://hadoop1:50076/jmx?qry=Hadoop:service=DataNode,name=FSDatasetState-%s

4、nodemanager

java 复制代码

http://hadoop11:8042/jmx?qry=Hadoop:service=NodeManager,name=JvmMetrics
http://hadoop11:8042/jmx?qry=Hadoop:service=NodeManager,name=NodeManagerMetrics
http://hadoop11:8042/jmx?qry=Hadoop:service=NodeManager,name=RpcActivityForPort8040
http://hadoop11:8042/jmx?qry=Hadoop:service=NodeManager,name=RpcActivityForPort8041
http://hadoop11:8042/jmx?qry=Hadoop:service=NodeManager,name=ShuffleMetrics