Mercurial > lbo > hg > localmr

view README.md @ 37:bda56504a12c

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Add ShardMergeIterator type. This type is used to merge the shards that are the input to the reduce phase. See https://drive.google.com/open?id=1grB87a0w9fQ2k7i04N3VJvYlw2BldxWNcHublW_ygJs
author Lewin Bormann <lbo@spheniscida.de>
date Mon, 01 Feb 2016 20:35:45 +0000
parents 30ab78379fff
children 02ee73a6152f
line wrap: on
line source

# LocalMR

LocalMR is a MapReduce implementation that is designed to be run on a single machine.
It is best suited for calculation-heavy tasks: While it can run code concurrently,
the Hard Disk obviously remains the bottleneck. So sometimes, a local `grep` may be
faster :)