乌兹 >Java 动作 >为什么属性 oozie.launcher.mapred.child.java.opts 不起作用

2022-01-13 00:00:00 hadoop mapreduce java oozie

我正在使用 Java 操作开发 Oozie.Java 操作应使用 Java 选项 -Xmx15g.因此，我将属性 oozie.mapreduce.map.memory.mb 设置为 25600 (25G)，以防需要一些额外的内存.

I am working on Oozie with a Java action. The Java action should use Java option -Xmx15g. Accordingly I set the property oozie.mapreduce.map.memory.mb to 25600 (25G) in case some extra memory is needed.

在这个简单的设置之后，我运行了 Oozie 作业，然后在 Java 运行时当然会出现 OutofMemory(堆空间不足)错误.

After this simple setting, I ran the Oozie job, then there was of course OutofMemory (heap out of space) error during Java runtime.

所以我在基于链接的 Java 操作的属性节点中将 oozie.launcher.mapred.child.java.opts 设置为 -Xmx15g:http://downright-amazed.blogspot.fi/2012/02/configure-oozies-launcher-job.html.但我仍然遇到同样的 OutofMemory 错误.然后我尝试将 -Xmx15g 添加到 Java 操作节点内的节点 java-opts 中.这工作得很好，但如果是这样的话，还有属性 oozie.launcher.mapred.child.java.opts 是什么鬼?

So I set oozie.launcher.mapred.child.java.opts as -Xmx15g accordingly in the property node of the Java action based on the link: http://downright-amazed.blogspot.fi/2012/02/configure-oozies-launcher-job.html. But I still got the same OutofMemory error. Then I tried to add -Xmx15g to the node java-opts inside the Java action node. This worked fine, but if so whats the hell there is still the property oozie.launcher.mapred.child.java.opts?

有人知道为什么会这样吗?请就为什么会这样发表一些评论.提前致谢.

Anyone has any idea why it is like that? Please given some comments on why it is like that. Thanks in advance.

我真的觉得 Oozie 不是一个好用的工具.

I really feel that Oozie is not a handy tool.

推荐答案

我不确定 mapred.child.java.opts 中的任务"是什么意思

尝试 mapreduce.map.java.opts，如下例所示:

<configuration>
    <property>
      <name>oozie.launcher.mapreduce.map.memory.mb</name>
      <value>16384</value>
    </property>
    <property>
      <name>oozie.launcher.mapreduce.map.java.opts</name>
      <value>-Xmx15g</value>
    </property>
    <property>
      <name>oozie.launcher.yarn.app.mapreduce.am.resource.mb</name>
      <value>768</value>
    </property>
    <property>
      <name>oozie.launcher.yarn.app.mapreduce.am.command-opts</name>
      <value>-Xmx512m</value>
    </property>
    <property>
      <name>oozie.launcher.mapred.job.queue.name</name>
      <value>default</value>
    </property>
</configuration>

相关文章