Autonomic storage system based on automatic learning

被引:0
作者
Hidrobo, F [1 ]
Cortes, T
机构
[1] Univ Los Andes, Merida 5101, Venezuela
[2] Univ Politecn Cataluna, ES-08034 Barcelona, Spain
来源
HIGH PERFORMANCE COMPUTING - HIPC 2004 | 2004年 / 3296卷
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present a system capable of improving the I/O performance in an automatic way. This system is able to learn the behavior of the applications running on top and find the best data placement in the disk in order to improve the I/O performance. This system is built by three independent modules. The first one is able to learn the behavior of a workload in order to be able to reproduce its behavior later on, without a new execution. The second module is a drive modeler that is able to learn how a storage drive works taking it as a "black box". Finally, the third module generates a set of placement alternatives and uses the afore mentioned models to predict the performance each alternative will achieve. We tested the system with five benchmarks and the system was able to find better alternatives in most cases and improve the performance significantly (up to 225%). Most important, the performance predicted where always very accurate (less that 10% error).
引用
收藏
页码:399 / 409
页数:11
相关论文
共 21 条
[1]   ADAPTIVE BLOCK REARRANGEMENT [J].
AKYUREK, S ;
SALEM, K .
ACM TRANSACTIONS ON COMPUTER SYSTEMS, 1995, 13 (02) :89-121
[2]   MINERVA: An automated resource provisioning tool for large-scale storage systems [J].
Alvarez, GA ;
Borowsky, E ;
Go, S ;
Romer, TH ;
Becker-Szendy, R ;
Golding, R ;
Merchant, A ;
Spasojevic, M ;
Veitch, A ;
Wilkes, J .
ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2001, 19 (04) :483-518
[3]  
Anderson E, 2002, USENIX ASSOCIATION PROCEEDINGS OF THE FAST'02 CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, P175
[4]  
ANDERSON E., 2001, HPLSSP200104
[5]  
[Anonymous], 1995, P COMP MEAS GROUP C
[6]  
GANGER G, 2004, DISKSIM SIMULATION E
[7]  
GOMEZ ME, 2000, P ISPASS AUST TEX
[8]  
HIDROBO F, 2003, P AMS SEATTL WA US I
[9]  
Kotz D., 1994, Proceedings Supercomputing '94 (Cat. No.94CH34819), P640, DOI 10.1109/SUPERC.1994.344328
[10]  
Kroeger T. M., 1999, Proceedings of the Seventh Workshop on Hot Topics in Operating Systems, P14, DOI 10.1109/HOTOS.1999.798371