Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS
SCIE
SCOPUS
KCI
Cited 2 time in
WEB OF SCIENCE
Cited 2 time in
Scopus
-
Title
- Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS
-
Author(s)
- Park, Jung Kyu; Kim, Jaeho; Koo, Sungmin; Baek, Seungjae
- KIOST Author(s)
- Baek, Seung Jae(백승재)
-
Alternative Author(s)
- 백승재
-
Publication Year
- 2016-12
-
Abstract
- In this paper, we propose a new HDFS-AIO framework to enhance HDFS with Adaptive I/O System (ADIOS), which supports many different I/O methods and enables applications to select optimal I/O routines for a particular platform without source-code modification and re-compilation. First, we customize ADIOS into a chunk-based storage system so its API semantics can fit the requirement of HDFS easily; then, we utilize Java Native Interface (JNI) to bridge HDFS and the tailored ADIOS. We use different I/O patterns to compare HDFS-AIO and the original HDFS, and the experimental results show the design feasibility and benefits. We also examine the performance of HDFS-AIO using various I/O techniques. There have been many studies that use ADIOS, however our research is expected to help in expanding the function of HDFS.
-
ISSN
- 1598-1657
-
URI
- https://sciwatch.kiost.ac.kr/handle/2020.kiost/1396
-
DOI
- 10.5573/JSTS.2016.16.6.880
-
Bibliographic Citation
- JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, v.16, no.6, pp.880 - 888, 2016
-
Publisher
- IEEK PUBLICATION CENTER
-
Keywords
- HDFS; ADIOS; JNI; HADOOP; GFS
-
Type
- Article
-
Language
- English
-
Document Type
- Article
- Files in This Item:
-
There are no files associated with this item.
Items in ScienceWatch@KIOST are protected by copyright, with all rights reserved, unless otherwise indicated.