The File System Recommendations to Reduce the Space and Time Parameters in Hadoop File Storage and Map Reduce Processing of Big Data Applications
Rama Naga Kiran Kumar. K1, Ramesh Babu. I2
1Rama Naga Kiran Kumar. K, Research Scholar, Dept of Computer Science & Engineering, Acharya Nagarjuna University, Guntur, (A.P), India.
2Prof. Ramesh Babu. I, Professor, Dept of Computer Science & Engineering, Acharya Nagarjuna University, Guntur, (A.P), India.
Manuscript received on July 11, 2020. | Revised Manuscript received on July 25, 2020. | Manuscript published on August 10, 2020. | PP: 353-356 | Volume-9 Issue-10, August 2020 | Retrieval Number: 100.1/ijitee.J75790891020 | DOI: 10.35940/ijitee.J7579.0891020
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: The study of Hadoop Distributed File System (HDFS) and Map Reduce (MR) are the key aspects of the Hadoop framework. The big data scenarios like Face Book (FB) data processing or the twitter analytics such as storing the tweets and processing the tweets is other scenario of big data which can depends on Hadoop framework to perform the storage and processing through which further analytics can be done. The point here is the usage of space and time in the processing of the above-mentioned huge amounts of the data definitely leads to higher amounts of space and time consumption of the Hadoop framework. The problem here is usage of huge amounts of the space and at the same time the processing time is also high which need to be reduced so as to get the fastest response from the framework. The attempt is important as all the other eco system tools also depends on HDFS and MR so as to perform the data storage and processing of the data and alternative architecture so as to improve the usage of the space and effective utilization of the resources so as to reduce the time requirements of the framework. The outcome of the work is faster data processing and less space utilization of the framework in the processing of MR along with other eco system tools like Hive, Flume, Sqoop and Pig Latin. The work is proposing an alternative framework of the HDFS and MR and the name we are assigning is Unified Space Allocation and Data Processing with Metadata based Distributed File System (USAMDFS).
Keywords: Analytics, Hadoop Framework, Meta Data based File system, Eco System, Unified Space Allocation.
Scope of the Article: Big Data Analytics Application Systems