Tez

Update the Tez Java 17 flags as shown below.

Advanced tez-env -> tez-env

File location: Log into the Ambari UI → TezConfigsAdvanced tez-site -> tez-env

# Tez specific configuration export TEZ_CONF_DIR={{config_dir}} {% if java_version == 8 %} # Java 8 JVM options export tez.am.launch.cmd-opts="-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}" export tez.task.launch.cmd-opts="-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}" {% elif java_version == 11 %} export tez.am.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_am_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}" export tez.task.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_task_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}" {% else %} # For Java 11+ export tez.am.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_am_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}} {{jvm_flags}}" export tez.task.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_task_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}} {{jvm_flags}}" {% endif %} # Set HADOOP_HOME to point to a specific hadoop install directory export HADOOP_HOME=${HADOOP_HOME:-{{hadoop_home}}} # The java implementation to use. export JAVA_HOME={{java64_home}}

Advanced tez-env -> tez.am.launch.cluster-default.cmd-opts & tez.task.launch.cluster-default.cmd-opts

File location: Log into the Ambari UI → TezConfigsAdvanced tez-site -> tez.am.launch.cluster-default.cmd-opts & tez.task.launch.cluster-default.cmd-opts

-server -Djava.net.preferIPv4Stack=true -Dodp.version=${odp.version}{% if java_version|int > 11 %} {{jvm_flags}}{% endif %}

Custom tez-site -> jvm_flags

File location: Log into the Ambari UI → TezConfigsCustom tez-site -> jvm_flags

--add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED


  Last updated