Hadoop 之 ENV

zhixingheyi_tian2025-12-19 8:04

参考链接

https://github.com/apache/hadoop/blob/rel/release-3.3.3/hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

HADOOP_CLIENT_OPTS

This environment variable is used for all end-user, non-daemon operations. It can be used to set any Java options as well as any Apache Hadoop options via a system property definition. For example:

bash 复制代码

HADOOP_CLIENT_OPTS="-Xmx1g -Dhadoop.socks.server=localhost:4000" hadoop fs -ls /tmp

在以下场景 HADOOP_CLIENT_OPTS 的效果和 HADOOP_OPTS 是一样的。

bash 复制代码

export HADOOP_CLIENT_OPTS="-agentpath:/home/test/jars/async-profiler-2.8.3-linux-x64/build/libasyncProfiler.so=start,event=cpu,file=test.html"
time hadoop  jar HadoopScience-1.0.0-SNAPSHOT.jar    /benchmarks/5GUNIT/TestDFSIO/io_data/test_io_1