网站空间建站,wordpress 默认首页,惠州网络推广费用,厦门建设网站首页通过JMX采集yarn相关指标的Flink任务核心逻辑 文章目录 通过JMX采集yarn相关指标的Flink任务核心逻辑通过jmx接口查询Yarn队列指标请求JMX配置项核心处理流程输出到kafka格式通过jmx接口查询ResourceManager核心指标请求JMX读取配置yaml配置文件核心处理逻辑输出Kafka格式彩蛋 …通过JMX采集yarn相关指标的Flink任务核心逻辑 文章目录 通过JMX采集yarn相关指标的Flink任务核心逻辑通过jmx接口查询Yarn队列指标请求JMX配置项核心处理流程输出到kafka格式 通过jmx接口查询ResourceManager核心指标请求JMX读取配置yaml配置文件核心处理逻辑输出Kafka格式 彩蛋 Flink 1.19中模拟调度每分钟调度 查询Active RM节点，然后将数据写入Kafka
通过jmx接口查询Yarn队列指标
请求JMX
队列相关指标：http://XXXXX:XXXX/jmx?qry=Hadoop:service=ResourceManager,name=QueueMetrics,*
配置项
# 指标值采用瞬间值的指标名称字符串，以英文逗号分隔
jmx.filter.queue.metric.momentary=AllocatedVCores,MaxShareVCores,MinShareVCores,AllocatedMB,MaxShareMB,MinShareMB,PendingMB,PendingVCores,MaxApps,AppsRunning,AppsPending,AllocatedContainers,PendingContainers
# 指标值采用两次差值的指标名称字符串，以英文逗号分隔
jmx.filter.queue.metric.difference=AppsSubmitted,AppsCompleted,AppsKilled,AppsFailed核心处理流程 #mermaid-svg-1XwABZRDKmq9tyvG {font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}#mermaid-svg-1XwABZRDKmq9tyvG .error-icon{fill:#552222;}#mermaid-svg-1XwABZRDKmq9tyvG .error-text{fill:#552222;stroke:#552222;}#mermaid-svg-1XwABZRDKmq9tyvG .edge-thickness-normal{stroke-width:2px;}#mermaid-svg-1XwABZRDKmq9tyvG .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-1XwABZRDKmq9tyvG .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-1XwABZRDKmq9tyvG .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-1XwABZRDKmq9tyvG .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-1XwABZRDKmq9tyvG .marker{fill:#333333;stroke:#333333;}#mermaid-svg-1XwABZRDKmq9tyvG .marker.cross{stroke:#333333;}#mermaid-svg-1XwABZRDKmq9tyvG svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-svg-1XwABZRDKmq9tyvG .label{font-family:"trebuchet ms",verdana,arial,sans-serif;color:#333;}#mermaid-svg-1XwABZRDKmq9tyvG .cluster-label text{fill:#333;}#mermaid-svg-1XwABZRDKmq9tyvG .cluster-label span{color:#333;}#mermaid-svg-1XwABZRDKmq9tyvG .label text,#mermaid-svg-1XwABZRDKmq9tyvG span{fill:#333;color:#333;}#mermaid-svg-1XwABZRDKmq9tyvG .node rect,#mermaid-svg-1XwABZRDKmq9tyvG .node circle,#mermaid-svg-1XwABZRDKmq9tyvG .node ellipse,#mermaid-svg-1XwABZRDKmq9tyvG .node polygon,#mermaid-svg-1XwABZRDKmq9tyvG .node path{fill:#ECECFF;stroke:#9370DB;stroke-width:1px;}#mermaid-svg-1XwABZRDKmq9tyvG .node .label{text-align:center;}#mermaid-svg-1XwABZRDKmq9tyvG .node.clickable{cursor:pointer;}#mermaid-svg-1XwABZRDKmq9tyvG .arrowheadPath{fill:#333333;}#mermaid-svg-1XwABZRDKmq9tyvG .edgePath .path{stroke:#333333;stroke-width:2.0px;}#mermaid-svg-1XwABZRDKmq9tyvG .flowchart-link{stroke:#333333;fill:none;}#mermaid-svg-1XwABZRDKmq9tyvG .edgeLabel{background-color:#e8e8e8;text-align:center;}#mermaid-svg-1XwABZRDKmq9tyvG .edgeLabel rect{opacity:0.5;background-color:#e8e8e8;fill:#e8e8e8;}#mermaid-svg-1XwABZRDKmq9tyvG .cluster rect{fill:#ffffde;stroke:#aaaa33;stroke-width:1px;}#mermaid-svg-1XwABZRDKmq9tyvG .cluster text{fill:#333;}#mermaid-svg-1XwABZRDKmq9tyvG .cluster span{color:#333;}#mermaid-svg-1XwABZRDKmq9tyvG div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:12px;background:hsl(80, 100%, 96.2745098039%);border:1px solid #aaaa33;border-radius:2px;pointer-events:none;z-index:100;}#mermaid-svg-1XwABZRDKmq9tyvG :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;} 遍历队列结果
