Back to Current Issues

Clustering and Parallel Empowering Techniques for Hadoop File System

K.Naga Maha Lakshmi , A.Shiva Kumar , , ,

Affiliations

:0

Abstract

In the Big Data group, Apache Hadoop and Spark are gaining prominence in handling Big Data and analytics. Similarly MapReduce has been seen as one of the key empowering methodologies for taking care of large-scale query processing. These middleware are traditionally written with sockets and do not deliver best performance on datacenters with modern high performance networks. In this paper we investigate the characterizes of two file systems that support in-memory and heterogeneous storage, and discusses the impacts of these two architectures on the performance and fault tolerance of Hadoop MapReduce and Spark applications. We present a complete methodology for evaluating MapReduce and Spark workloads on top of in-memory file systems and provide insights about the interactions of different system components while running these workloads

Citation

K.Naga Maha Lakshmi et al., International Journal of Computer Engineering In Research Trends Volume 3, Issue 3, March-2016, pp. 134-142

Keywords :

References

DOI Link :

Download :

V3I308.pdf

Refbacks :

Support Us

We have kept IJCERT is a free peer-reviewed scientific journal to endorse conservation. We have not put up a paywall to readers, and we do not charge for publishing. But running a monthly journal costs is a lot. While we do have some associates, we still need support to keep the journal flourishing. If our readers help fund it, our future will be more secure.