Powered By Blogger

Wednesday, April 24, 2019

MapReduce materials


This has good explanation for java MR

This has good info on MR related to combiner,partitioner


 Mapper

Keyin, valuein, keyoutm , valueoutm

Reducer

Keyinm, valueinm, keyout , valueout


keyoutm  will be passed to reducer as Keyinm
Valueoutm will be passed to reducer as valueinm


MRUnit can be used for doing MR testing.







mapreduce-job-execution-flow-1-1024x492-1.jpg (1200×628)






No comments:

Post a Comment