chore: import upstream snapshot with attribution
This commit is contained in:
@@ -0,0 +1,92 @@
|
||||
---
|
||||
id: hdfs_namenode
|
||||
title: Monitoring HDFS NameNode
|
||||
sidebar_label: Apache HDFS NameNode
|
||||
keywords: [big data monitoring system, distributed file system monitoring, HDFS NameNode monitoring]
|
||||
---
|
||||
|
||||
> HertzBeat monitors metrics for HDFS NameNode nodes.
|
||||
|
||||
**Protocol Used: HTTP**
|
||||
|
||||
## Pre-Monitoring Actions
|
||||
|
||||
Ensure that you have obtained the JMX monitoring port for the HDFS NameNode.
|
||||
|
||||
## Configuration Parameters
|
||||
|
||||
| Parameter Name | Parameter Description |
|
||||
|-----------------------------|-------------------------------------------------------------------------------------------|
|
||||
| Target Host | The IPv4, IPv6, or domain name of the target being monitored. Exclude protocol headers. |
|
||||
| Port | The monitoring port number of the HDFS NameNode, default is 50070. |
|
||||
| Query Timeout | Timeout for querying the HDFS NameNode, in milliseconds, default is 6000 milliseconds. |
|
||||
| Metrics Collection Interval | Time interval for collecting monitoring data, in seconds, minimum interval is 30 seconds. |
|
||||
| Probe Before Monitoring | Whether to probe and check the availability of monitoring before adding it. |
|
||||
| Description/Remarks | Additional description and remarks for this monitoring. |
|
||||
|
||||
### Collected Metrics
|
||||
|
||||
#### Metric Set: FSNamesystem
|
||||
|
||||
| Metric Name | Metric Unit | Metric Description |
|
||||
|---------------------------------|-------------|------------------------------------------------------------|
|
||||
| CapacityTotal | | Total cluster storage capacity |
|
||||
| CapacityTotalGB | GB | Total cluster storage capacity |
|
||||
| CapacityUsed | | Used cluster storage capacity |
|
||||
| CapacityUsedGB | GB | Used cluster storage capacity |
|
||||
| CapacityRemaining | | Remaining cluster storage capacity |
|
||||
| CapacityRemainingGB | GB | Remaining cluster storage capacity |
|
||||
| CapacityUsedNonDFS | | Non-HDFS usage of cluster capacity |
|
||||
| TotalLoad | | Total client connections in the cluster |
|
||||
| FilesTotal | | Total number of files in the cluster |
|
||||
| BlocksTotal | | Total number of BLOCKs |
|
||||
| PendingReplicationBlocks | | Number of blocks awaiting replication |
|
||||
| UnderReplicatedBlocks | | Number of blocks with insufficient replicas |
|
||||
| CorruptBlocks | | Number of corrupt blocks |
|
||||
| ScheduledReplicationBlocks | | Number of blocks scheduled for replication |
|
||||
| PendingDeletionBlocks | | Number of blocks awaiting deletion |
|
||||
| ExcessBlocks | | Number of excess blocks |
|
||||
| PostponedMisreplicatedBlocks | | Number of misreplicated blocks postponed for processing |
|
||||
| NumLiveDataNodes | | Number of live data nodes in the cluster |
|
||||
| NumDeadDataNodes | | Number of data nodes marked as dead |
|
||||
| NumDecomLiveDataNodes | | Number of decommissioned live nodes |
|
||||
| NumDecomDeadDataNodes | | Number of decommissioned dead nodes |
|
||||
| NumDecommissioningDataNodes | | Number of nodes currently being decommissioned |
|
||||
| TransactionsSinceLastCheckpoint | | Number of transactions since the last checkpoint |
|
||||
| LastCheckpointTime | | Time of the last checkpoint |
|
||||
| PendingDataNodeMessageCount | | Number of DATANODE requests queued in the standby namenode |
|
||||
|
||||
#### Metric Set: RPC
|
||||
|
||||
| Metric Name | Metric Unit | Metric Description |
|
||||
|--------------------|-------------|---------------------|
|
||||
| ReceivedBytes | | Data receiving rate |
|
||||
| SentBytes | | Data sending rate |
|
||||
| RpcQueueTimeNumOps | | RPC call rate |
|
||||
|
||||
#### Metric Set: runtime
|
||||
|
||||
| Metric Name | Metric Unit | Metric Description |
|
||||
|-------------|-------------|--------------------|
|
||||
| StartTime | | Start time |
|
||||
|
||||
#### Metric Set: JvmMetrics
|
||||
|
||||
| Metric Name | Metric Unit | Metric Description |
|
||||
|---------------------------------|--------------|------------------------------------------|
|
||||
| MemNonHeapUsedM | MB | Current usage of NonHeapMemory by JVM |
|
||||
| MemNonHeapCommittedM | MB | Committed NonHeapMemory by JVM |
|
||||
| MemHeapUsedM | MB | Current usage of HeapMemory by JVM |
|
||||
| MemHeapCommittedM | MB | Committed HeapMemory by JVM |
|
||||
| MemHeapMaxM | MB | Maximum HeapMemory configured for JVM |
|
||||
| MemMaxM | MB | Maximum memory that can be used by JVM |
|
||||
| GcCountParNew | Count | Number of ParNew GC events |
|
||||
| GcTimeMillisParNew | Milliseconds | Time spent in ParNew GC |
|
||||
| GcCountConcurrentMarkSweep | Count | Number of ConcurrentMarkSweep GC events |
|
||||
| GcTimeMillisConcurrentMarkSweep | Milliseconds | Time spent in ConcurrentMarkSweep GC |
|
||||
| GcCount | Count | Total number of GC events |
|
||||
| GcTimeMillis | Milliseconds | Total time spent in GC events |
|
||||
| ThreadsRunnable | Count | Number of threads in RUNNABLE state |
|
||||
| ThreadsBlocked | Count | Number of threads in BLOCKED state |
|
||||
| ThreadsWaiting | Count | Number of threads in WAITING state |
|
||||
| ThreadsTimedWaiting | Count | Number of threads in TIMED WAITING state |
|
||||
Reference in New Issue
Block a user