Design patterns for the MapReduce framework, until now, have been scattered among various research papers, blogs, and books. This handy guide brings together a unique collection of valuable MapReduce patterns that will save you time and effort regardless of the domain, language, or development framework you're using. Each pattern is explained in context, with pitfalls and caveats clearly identified - so you can avoid some of the common design mistakes when modeling your Big Data architecture. This book also provides a complete overview of MapReduce that explains its origins and implementations, and why design patterns are so important. Hadoop MapReduce code is provided to help you learn how to apply the design patterns by example. Topics include: Basic patterns, including map-only filter, group by, aggregation, distinct, and limit Joins: traditional reduce-side join, reduce-side join with Bloom filter, replicated join with distributed cache, merge join, Cartesian products, and intersections Binning, sharding for other systems, sorting, sampling, unions, and other patterns for organizing data Job optimization patterns, including multi-job map-only job folding, and overloading the key grouping to perform two jobs at once
评分
评分
评分
评分
如何编写一个真正的不依赖于in-memory sort的find median算法?单机版本的max-N都已经是O(N)的了,Hadoop版本的(作者这里描述的)就有点弱了
评分入门了,略拖沓。
评分如何编写一个真正的不依赖于in-memory sort的find median算法?单机版本的max-N都已经是O(N)的了,Hadoop版本的(作者这里描述的)就有点弱了
评分相当一部分“pattern”被总结出来,只说明了Hadoop太笨。
评分大概13年的时候读过这本书,当时觉得觉得收获非常大,基本覆盖了用mr处理数据的常用方法,不过现在看开用hive就够了。
本站所有内容均为互联网搜索引擎提供的公开搜索信息,本站不存储任何数据与内容,任何内容与数据均与本站无关,如有需要请联系相关搜索引擎包括但不限于百度,google,bing,sogou 等
© 2025 book.quotespace.org All Rights Reserved. 小美书屋 版权所有