Using Counters in MapReduce to Track Bad Records

By Ravi Karamsetty | September 3, 2014 |

The MapReduce framework provides Counters as an efficient mechanism for tracking the occurrences of global events within the map and reduces the phases of jobs. For example, a typical MapReduce job will kick off several mapper instances, one for each block of the input data, all running the same code. These instances are part of … Continue reading “Using Counters in MapReduce to Track Bad Records”

Read More