ICIEMS 2015

International Conference on Information Engineering, Management and Security 2015

 


ICIEMS 2015 Kokula Krishna Hari K
Publication Meta Value
Short Title ICIEMS 2015
Publisher ASDF, India
ISBN 13 978-81-929742-7-9
ISBN 10 81-929742-7-8
Language English
Type Hard Bound - Printed Book
Copyrights ICIEMS Organizers / DCRC, London, UK
Editor-in-Chief Kokula Krishna Hari K
Conference Dates 13 - 14, August 2015
Venue Country IITM-RP, Chennai, India
Submitted Papers 410
Acceptance Rate 4.11%
Website www.iciems.in

Paper 021


Bigdata Analytics With Spark

Bigdata Analytics With Spark

SUBHASH KUMAR1

1IT Department, St Xavier’s College, Mahapalika Marg, New Marine Lines, Mumbai, PIN-400001, Maharashtra, India

Abstract

Current generation is witnessing data explosion most of it is unstructured and is called Big Data. This data has characteristics of high volume, velocity, variety and veracity. HDFS, GFS, Ceph, Lustre, PVFS etc are used as file system for storing Big Data. MapReduce processes program in parallel across clusters and generates output. Spark framework improves performance by 10x when datasets are stored in hard disk and performance improves by 100x when data is stored in memory. This paper proposes optimization of Big Data processing using Spark framework.

Author's Profile

SUBHASH KUMAR : Profile

Cite this Article as Follows

SUBHASH KUMAR. "Bigdata Analytics With Spark." International Conference on Information Engineering, Management and Security (2015): 129-133. Print.