当前位置:网站首页>[flick]flick on yarn's flick conf simplest configuration

[flick]flick on yarn's flick conf simplest configuration

2022-07-23 11:40:00 Bigdata Wang Yi

notes :
jobmanager.memory.heap.size and jobmanager.memory.process.size A choice , And the latter is bigger than the former .

classloader.check-leaked-classloader: false and taskmanager.memory.process.size: 5120m It's the problem encountered when the program starts , So in terms of configuration

env.hadoop.conf.dir: /opt/hadoop/etc/hadoop,
env.java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.181-7.b13.el7.x86_64/jre and
env.yarn.conf.dir: /opt/hadoop/etc/hadoop Is the environment variable . If your /etc/profile Can find the corresponding path , Then only three configurations are needed

## jobmanager.memory.heap.size: 1024m
jobmanager.memory.process.size: 2048m


classloader.check-leaked-classloader: false
taskmanager.memory.process.size: 5120m
env.hadoop.conf.dir: /opt/hadoop/etc/hadoop
env.java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.181-7.b13.el7.x86_64/jre
env.yarn.conf.dir: /opt/hadoop/etc/hadoop

test :
Remember in active State of rm On the implementation !

 /opt/flink-1.13.6/bin/flink run  -t yarn-per-job /opt/flink/examples/batch/WordCount.jar

 Insert picture description here

原网站

版权声明
本文为[Bigdata Wang Yi]所创,转载请带上原文链接,感谢
https://yzsam.com/2022/204/202207230537303741.html