Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS SCIE SCOPUS KCI

Cited 1 time in WEB OF SCIENCE Cited 1 time in Scopus
Title
Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS
Author(s)
Park, Jung Kyu; Kim, Jaeho; Koo, Sungmin; Baek, Seungjae
KIOST Author(s)
Baek, Seung Jae(백승재)
Publication Year
2016-12
Abstract
In this paper, we propose a new HDFS-AIO framework to enhance HDFS with Adaptive I/O System (ADIOS), which supports many different I/O methods and enables applications to select optimal I/O routines for a particular platform without source-code modification and re-compilation. First, we customize ADIOS into a chunk-based storage system so its API semantics can fit the requirement of HDFS easily; then, we utilize Java Native Interface (JNI) to bridge HDFS and the tailored ADIOS. We use different I/O patterns to compare HDFS-AIO and the original HDFS, and the experimental results show the design feasibility and benefits. We also examine the performance of HDFS-AIO using various I/O techniques. There have been many studies that use ADIOS, however our research is expected to help in expanding the function of HDFS.
ISSN
1598-1657
URI
https://sciwatch.kiost.ac.kr/handle/2020.kiost/1396
DOI
10.5573/JSTS.2016.16.6.880
Bibliographic Citation
JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, v.16, no.6, pp.880 - 888, 2016
Publisher
IEEK PUBLICATION CENTER
Keywords
HDFS; ADIOS; JNI; HADOOP; GFS
Type
Article
Language
English
Document Type
Article
Publisher
IEEK PUBLICATION CENTER
Related Researcher
Research Interests

Computer System,System Software,Storage System,컴퓨터 시스템,시스템 소프트웨어,스토리지 시스템

Files in This Item:
There are no files associated with this item.

qrcode

Items in ScienceWatch@KIOST are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse