MapReduce: A Flexible Data Processing Tool.

The authors discuss the MapReduce (MR) programming model for processing and generating large amounts of data. They mention their design of an MR system for search engine company Google Inc. for a simplified inverted index. Google has since used MR for other programs including machine learning and ma...

Full description

Bibliographic Details
Published in:	Communications of the ACM Vol. 53; no. 1; pp. 72 - 78
Main Authors:	DEAN, JEFFREY, GHEMAWAT, SANJAY
Format:	Article
Published:	Association for Computing Machinery Jan2010
Subjects:	Electronic data processing software Inverted indexes Database management software Search engine programming Google Inc. Data analysis
Online Access:	View this record in EBSCOhost

Description
Summary:	The authors discuss the MapReduce (MR) programming model for processing and generating large amounts of data. They mention their design of an MR system for search engine company Google Inc. for a simplified inverted index. Google has since used MR for other programs including machine learning and machine translation. The Hadoop open source version of MR has been used by a number of organizations. The authors compare MR to a model in which a parallel database management system (DBMS) performs all data analysis.