reduce内存和个数 · JAVA

NIUCLOUD是一款SaaS管理后台框架多应用插件+云编译。上千名开发者、服务商正在积极拥抱开发者生态。欢迎开发者们免费入驻。一起助力发展！广告

[TOC] # reduce内存调大reduce内存，限制每个reduce处理的数据量 ~~~ set mapreduce.reduce.memory.mb=16384; set mapreduce.reduce.java.opts=-Xmx16384m; set hive.exec.reducers.bytes.per.reducer = 100000000; ~~~ # reduce个数 ~~~ set mapred.reduce.tasks = 2000; set mapreduce.reduce.memory.mb=16384; set mapreduce.reduce.java.opts=-Xmx16384m; ~~~