MAPREDUCE: SIMPLIFIED DATA PROCESSING ON LARGE CLUSTERS.
MapReduce is a programming model and an associated implementation for processing and generating large datasets that is amenable to a broad variety of real-world tasks. Users specify the computation in terms of a map and a reduce function, and the underlying runtime system automatically parallelizes...
| Published in: | Communications of the ACM Vol. 51; no. 1; pp. 107 - 114 |
|---|---|
| Main Authors: | , |
| Format: | Article |
| Published: |
Association for Computing Machinery
Jan2008
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=28106662&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 28106662 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 00010782 ACM jtl: Communications of the ACM issn: 00010782 maglogo: N pubinfo: dt: Jan2008 vid: 51 iid: 1 pid: 68 pub: Association for Computing Machinery artinfo: ui: 28106662 10.1145/1327452.1327492 ppf: 107 ppct: 7 formats: tig: atl: MAPREDUCE: SIMPLIFIED DATA PROCESSING ON LARGE CLUSTERS. aug: au: Dean, Jeffrey Ghemawat, Sanjay su: Parallel processing Data Electronic data processing Parallel algorithms Google Inc. Computer programmers sug: subj: Parallel processing Data Electronic data processing Parallel algorithms Google Inc. Computer programmers ab: MapReduce is a programming model and an associated implementation for processing and generating large datasets that is amenable to a broad variety of real-world tasks. Users specify the computation in terms of a map and a reduce function, and the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks. Programmers find the system easy to use: more than ten thousand distinct MapReduce programs have been implemented internally at Google over the past four years, and an average of one hundred thousand MapReduce jobs are executed on Google's clusters every day, processing a total of more than twenty petabytes of data per day. pubtype: Periodical doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y dt: @attributes: year: 2008 holdings: @attributes: islocal: N |
|---|