Hadoop加速比性能模型研究
發(fā)布時間:2018-07-15 20:07
【摘要】:MapReduce編程模型被看作是Hadoop的核心組件,一直以來都受到廣泛的應用和研究,但針對Hadoop云平臺的性能研究主要集中在配置調優(yōu)和分布式算法等方面,缺乏對Hadoop加速比性能模型的理論研究.針對此問題提出了Hadoop云平臺加速比性能模型,并分別在同構機群和異構機群架構上對該模型進行了分析.針對同構機群提出了3種I/O負載模型,并指出了其對加速比的影響;指出了異構機群不適合做Hadoop云平臺的原因及異構性對Hadoop云平臺造成的影響.這些研究對Hadoop云計算平臺的搭建及如何提高Hadoop云平臺加速比性能有很好的指導作用,提供了理論依據(jù).
[Abstract]:MapReduce programming model is regarded as the core component of Hadoop and has been widely used and studied. However, the performance of Hadoop cloud platform is mainly focused on configuration tuning and distributed algorithms. There is a lack of theoretical research on Hadoop speedup performance model. To solve this problem, a speedup performance model of Hadoop cloud platform is proposed, and the model is analyzed on isomorphic cluster and heterogeneous cluster architecture, respectively. Three kinds of I / O load models for isomorphic clusters are proposed, and their effects on acceleration ratio are pointed out, and the reasons why heterogeneous clusters are not suitable for Hadoop cloud platforms and the effects of heterogeneity on Hadoop cloud platforms are pointed out. These studies have a good guidance on how to build Hadoop cloud computing platform and how to improve the speedup performance of Hadoop cloud platform.
【作者單位】: 河南師范大學網(wǎng)絡中心;河南師范大學計算機與信息工程學院;
【基金】:河南省基礎與前沿技術研究項目(132300410389)
【分類號】:TP302.7
[Abstract]:MapReduce programming model is regarded as the core component of Hadoop and has been widely used and studied. However, the performance of Hadoop cloud platform is mainly focused on configuration tuning and distributed algorithms. There is a lack of theoretical research on Hadoop speedup performance model. To solve this problem, a speedup performance model of Hadoop cloud platform is proposed, and the model is analyzed on isomorphic cluster and heterogeneous cluster architecture, respectively. Three kinds of I / O load models for isomorphic clusters are proposed, and their effects on acceleration ratio are pointed out, and the reasons why heterogeneous clusters are not suitable for Hadoop cloud platforms and the effects of heterogeneity on Hadoop cloud platforms are pointed out. These studies have a good guidance on how to build Hadoop cloud computing platform and how to improve the speedup performance of Hadoop cloud platform.
【作者單位】: 河南師范大學網(wǎng)絡中心;河南師范大學計算機與信息工程學院;
【基金】:河南省基礎與前沿技術研究項目(132300410389)
【分類號】:TP302.7
【參考文獻】
相關期刊論文 前6條
1 孫健;賈曉菁;;Google云計算平臺的技術架構及對其成本的影響研究[J];電信科學;2010年01期
2 欒亞建;黃爛,
本文編號:2125235
本文鏈接:http://www.wukwdryxk.cn/kejilunwen/jisuanjikexuelunwen/2125235.html
最近更新
教材專著