Using eager strategies to improve NFS I/O performance

被引:1
作者
Rago, Stephen [1 ]
Bohra, Aniruddha [2 ]
Ungureanu, Cristian [1 ]
机构
[1] NEC Labs Amer, 4 Independence Way, Princeton, NJ 08540 USA
[2] 8 Cambridge Ctr, Cambridge, MA 02142 USA
关键词
file systems; networking; performance;
D O I
10.1080/17445760.2012.658801
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Typical network file system (NFS) clients write lazily: they leave dirty pages in the page cache and defer writing to the server. This reduces network traffic when applications repeatedly modify the same set of pages. However, this approach can lead to memory pressure, when the number of available pages on the client system is so low that the system must work harder to reclaim dirty pages. We show that NFS performance is poor under memory pressure and present two mechanisms to solve it: eager writeback and eager page laundering. These mechanisms change the client's data management policy from lazy to eager, in which dirty pages are written back proactively, resulting in higher throughput for sequential writes. In addition, we show that NFS servers suffer from out-of-order file operations, which further reduce performance. We introduce request ordering, a server mechanism to process operations, as much as possible, in the order they were sent by the client, which improves read performance substantially. We have implemented these techniques in the Linux operating system. I/O performance is improved, with the most pronounced improvement visible for sequential access to large files. We see 33% improvement in the performance of streaming write workloads and more than triple the performance of streaming read workloads. We evaluate several non-sequential workloads and show that these techniques do not degrade performance, and can sometimes improve performance.
引用
收藏
页码:134 / 158
页数:25
相关论文
共 50 条
  • [41] Improving the I/O of large geophysical models using PnetCDF and BeeGFS
    Brzenski, Jared
    Paolini, Christopher
    Castillo, Jose E.
    PARALLEL COMPUTING, 2021, 104
  • [42] PIPULS: Predicting I/O Patterns Using LSTM in Storage Systems
    Li, Dongyang
    Wang, Yan
    Xu, Bin
    Li, Wenjiang
    Li, Weijun
    Yu, Lina
    Yang, Qing
    2019 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE BIG DATA AND INTELLIGENT SYSTEMS (HPBD&IS), 2019, : 14 - 21
  • [43] An Efficient Hybrid I/O Caching Architecture Using Heterogeneous SSDs
    Salkhordeh, Reza
    Hadizadeh, Mostafa
    Asadi, Hossein
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (06) : 1238 - 1250
  • [44] An approach to assess logistics and ecological supply chain performance using postponement strategies
    Simao, Luiz Eduardo
    Goncalves, Mirian Buss
    Taboada Rodriguez, Carlos Manuel
    ECOLOGICAL INDICATORS, 2016, 63 : 398 - 408
  • [45] Low-protein diets for broilers: Current knowledge and potential strategies to improve performance and health, and to reduce environmental impact
    Woyengo, T. A.
    Knudsen, K. E. Bach
    Borsting, C. F.
    ANIMAL FEED SCIENCE AND TECHNOLOGY, 2023, 297
  • [46] YouChoose: Choosing your Storage Device as a Performance Interface to Consolidated I/O Service
    Zhang, Xuechen
    Xu, Yuehai
    Jiang, Song
    ACM TRANSACTIONS ON STORAGE, 2011, 7 (03)
  • [47] Cloud Computing I/O Thread Performance Optimization with VirtIO and Queue Size Tuning
    Dhanakshirur, Girish
    Shivam, Piyush
    Pritko, Steve
    Reitz, Brian
    Nallasivam, Subramaniyan
    Norton, Stanley S. A.
    Kallannavar, Manjunath
    Siddaraju, G. C.
    10TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTING AND COMMUNICATION TECHNOLOGIES, CONECCT 2024, 2024,
  • [48] Using accurate AIC-based performance models to improve the scheduling of parallel applications
    Martinez, Diego R.
    Albin, Julio L.
    Pena, Tomas F.
    Cabaleiro, Jose C.
    Rivera, Francisco F.
    Blanco, Vicente
    JOURNAL OF SUPERCOMPUTING, 2011, 58 (03) : 332 - 340
  • [49] Using accurate AIC-based performance models to improve the scheduling of parallel applications
    Diego R. Martínez
    Julio L. Albín
    Tomás F. Pena
    José C. Cabaleiro
    Francisco F. Rivera
    Vicente Blanco
    The Journal of Supercomputing, 2011, 58 : 332 - 340
  • [50] Didactic physical education strategies to improve the academic performance of college students based on Paul Dennison's brain gym
    Ramirez Ramirez, Wildoro
    Vasquez Ruiz, Ledmy
    Palacios Paredes, Wendy Lilly
    RETOS-NUEVAS TENDENCIAS EN EDUCACION FISICA DEPORTE Y RECREACION, 2021, (41): : 380 - 386