Persistent Data Layout in File Systems

doi:10.19729/j.cnki.1673-5188.2018.03.010

ZTE Communications ›› 2018, Vol. 16 ›› Issue (3): 59-66.DOI: 10.19729/j.cnki.1673-5188.2018.03.010

• Review • Previous Articles

Persistent Data Layout in File Systems

LUO Shengmei¹, LU Youyou², YANG Hongzhang¹, SHU Jiwu², ZHANG Jiacheng²

1.ZTE Corporation, Shenzhen 518057, China
2.Tsinghua University, Beijing 100084, China

Online:2018-08-25 Published:2020-03-18
About author:LUO Shengmei (luo.shengmei@zte.com.cn) received his master’s degree from Harbin Institute of Technology, China. He has been working with ZTE Corporation for over 20 years. His research interests include cloud computing and big data. He is a member of CIE and CCF.|LU Youyou (luyouyou@tsinghua.edu.cn) received the B.S. degree from Nanjing University, China in 2009 and the Ph.D. degree from Tsinghua University, China in 2015, both in computer science. He is currently an assistant researcher in the Department of Computer Science and Technology, Tsinghua University. His current research interests include nonvolatile memories and file systems. He received the best paper award at IEEE NVMSA’14 and the best paper runner-up at MSST’15. He is a member of the IEEE, ACM and CCF.|YANG Hongzhang (yang.hongzhang@zte.com.cn) received his master’s degree in computer science and technology from University of Chinese Academy of Sciences, China in 2015. He has been working with ZTE Corporation for 3 years. His research interests include distributed file system and cloud computing. His paper on pNFS was received by HPCA’15. He is a member of the IEEE, ACM and CCF.|SHU Jiwu (shujw@tsinghua.edu.cn) received the Ph.D. degree from the Department of Computer Science and Technology, Nanjing University, China. He is currently a professor in the Department of Computer Science and Technology, Tsinghua University, China. His current research interests include nonvolatile memories and file systems. He is IEEE Fellow and CCF Fellow.|ZHANG Jiacheng (zhang-jc13@mails.tsinghua.edu.cn) received the B.S. degree from Harbin Institute of Technology, China, in software engineering in 2013 and is now a Ph.D. candidate student in Tsinghua University, China, majoring in computer science. His current research interests include nonvolatile memories and storage system. His paper on flash-based file system was received by USENIX ATC’16.
Supported by:
This work was supported by ZTE Industry-Academia-Research Cooperation Funds.

Abstract

Abstract:

Data layout in a file system is the organization of data stored in external storages. The data layout has a huge impact on performance of storage systems. We survey three main kinds of data layout in traditional file systems: in-place update file system, log-structured file system, and copy-on-write file system. Each file system has its own strengths and weaknesses under different circumstances. We also include a recent usage of persistent layout in a file system that combines both flash memory and byte-addressable non-volatile memory. With this survey, we conclude that persistent data layout in file systems may evolve dramatically in the era of emerging non-volatile memory.

Key words: data layout, file system, persistent storage, solid state drive (SSD)

LUO Shengmei, LU Youyou, YANG Hongzhang, SHU Jiwu, ZHANG Jiacheng. Persistent Data Layout in File Systems[J]. ZTE Communications, 2018, 16(3): 59-66.

Figures/Tables 8

Figure 1. Data layout of the ext4 file system.

Figure 2. Data layout of a typical log-structured file system.

Figure 3. Data layout of the flash friendly file system.

Figure 4. Node blocks in the flash friendly file system.

Figure 5. In-place update of traditional file system data.

Figure 6. Copy-on-write update.

Figure 7. Basic structure of journaling file system.

Figure 8. Basic structure of file system with virtual memory.

References 34

[1]	M.K. McKusick , W. N. Joy, S. J. Leffler, and R. S. Fabry, . “A fast file system for unix,” ACM Transactions on Computer Systems (TOCS), vol. 2, no. 3, pp. 181-197, 1984.
[2]	D. Hitz, J. Lau, M. A. Malcolm, “File system design for an NFS file server appliance,” in Proc. USENIX Winter,San Francisco, 1994,vol. 94, pp. 19-19.
[3]	S. Tweedie , “Ext3, journaling filesystem,” in Ottawa Linux Symposium, Ottawa, Canada, 2000, pp. 24-29.
[4]	M. Cao, S. Bhattacharya, T. Ts’o , “Ext4: the next generation of ext2/3 filesystem,” in Linux Storage & Filesystem Workshop (LSF), San Jose, USA, 2007.
[5]	F. Chen, D. A. Koufaty, X. Zhang , “Understanding intrinsic characteristics and system implications of flash memory based solid state drives,” in ACM SIGMETRICS/Performance, Seattle, USA, 2009.
[6]	G. Soundararajan, V. Prabhakaran, M. Balakrishnan, T. Wobber , “Extending SSD lifetimes with disk-based write caches,” in USENIX Conference on File and Storage Technologies, San Jose, USA, 2010, pp. 101-114.
[7]	N. Agrawal, V. Prabhakaran, T. Wobber , et al., “Design tradeoffs for SSD performance,” in USENIX Annual Technical Conference, Boston, USA, 2008, pp. 57-70.
[8]	R. Card, T. Ts’o, S. Tweedie , “Design and implementation of the second extended filesystem,” in Proc. First Dutch International Symposium on Linux, Groningen, Netherlands, 1994.
[9]	O. Rodeh, J. Bacik, C. Mason , “Btrfs: the linux b-tree filesystem,” ACM Transactions on Storage (TOS), vol. 9, no. 3, article no. 9, 2013. doi: 10.1145/2501620.2501623.
[10]	R. Y . Wang and T. E. Anderson, “XFS: a wide area mass storage file system,” in IEEE Fourth Workshop on Workstation Operating Systems, Napa, USA, 1993, pp. 71-78. doi: 10.1109/WWOS.1993.348169.
[11]	M . Rosenblum and J. K. Ousterhout, “The design and implementation of a log-structured file system,” ACM Transactions on Computer Systems (TOCS), vol. 10, no.1,pp. 26-52, Feb. 1992. doi: 10.1145/146941.146943.
[12]	C. Lee, D. Sim, J. Hwang, S. Cho , “F2FS: A new file system for flash storage,” in Proc. 13th USENIX Conference on File and Storage Technologies (FAST), Santa Clara, USA, 2015, pp. 273-286.
[13]	Z. N. J . Peterson, “Data placement for copy-on-write using virtual contiguity,” Ph.D. dissertation, University of California Santa Cruz, USA, 2002.
[14]	D. Hitz, M. Malcolm, J. Lau, B. Rakitzis , “Copy on write file system consistency and block usage,” U.S. Patent 6 892 211, May 10, 2005.
[15]	W.A .Sawdon and F. B. Schmuck, “Deferred copy-on-write of a snapshot,” U.S. Patent 6 748 504, Jun. 8, 2004.
[16]	B. J. Fuller , “Single transaction technique for a journaling file system of a computer operating system,” U.S.Patent 6 021 414, Feb. 1, 2000.
[17]	J. Piernas, T. Cortes, J. M. Garcia , “Dualfs: a new journaling file system without meta-data duplication,” in ACM 16th International Conference on Supercomputing , New York,USA, 2002, pp. 137-146. doi: 10.1145/514191.514213.
[18]	V. Prabhakaran, A.C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau, “Analysis and evolution of journaling file systems,” in USENIX Annual Technical Conference, Anaheim, USA, 2005, pp. 105-120.
[19]	Z . Zhang and K. Ghose, “yFS: a journaling file system design for handling large data sets with reduced seeking,” in 2nd USENIX Conference on File and Storage Technologies (FAST), San Francisco, USA, 2003, pp. 59-72.
[20]	M. T. Jones , “Anatomy of linux journaling file systems,” IBM DeveloperWorks, USA, 2008.
[21]	M. I. Seltzer, G. R. Ganger, M.K. McKusick , et al., “Journaling versus soft updates: asynchronous meta-data protection in file systems,” in USENIX Annual Technical Conference, San Diego, USA, 2000, pp. 71-84.
[22]	V. Chidambaram, T. Sharma, A.C. Arpaci-Dusseau , and R. H. Arpaci-Dusseau, “Consistency without ordering,” in 10th USENIX Conference on File and Storage Technologies (FAST), San Jose, USA, 2012, pp. 9-9.
[23]	K. Li and P. Hudak, “Memory coherence in shared virtual memory systems,” ACM Transactions on Computer Systems (TOCS), vol. 7, no. 4, pp. 321-359, 1989.
[24]	K. Li , “Shared virtual memory on loosely coupled multiprocessors,” Yale University, New Haven, USA, Tech. Rep., 1986.
[25]	P. J. Denning , “Virtual memory,” ACM Computing Surveys (CSUR), vol. 2, no. 3, pp. 153-189, 1970.
[26]	A. W. Appel and K. Li, “Virtual memory primitives for user programs,” in 4th International Conference on Architectural Support for Programming Languages and Operating Systems, Santa Clara, USA, 1991,vol. 26, no. 4.
[27]	A . Badam and V. S. Pai, “SSDAlloc: hybrid SSD/RAM memory management made easy,” in Proc. 8th USENIX Conference on Networked Systems Design and Implementation, Boston, USA, 2011, pp. 211-224.
[28]	S. Kannan, A. Gavrilovska, K. Schwan, D. Milojicic , “Optimizing checkpoints using NVM as virtual memory,” in IEEE 27th International Symposium on Parallel & Distributed Processing (IPDPS), Boston, USA, 2013, pp. 29-40. doi: 10.1109/IPDPS.2013.69.
[29]	M. Hadwiger, J. Beyer , W.-K. Jeong, and H. Pfister, “Interactive volume exploration of petascale microscopy data streams using a visualization-driven virtual memory approach,” IEEE Transactions on Visualization and Computer Graphics, vol. 18, no.12,pp. 2285-2294, Dec. 2012. doi: 10.1109/TVCG.2012.240.
[30]	C. Wang, S. S. Vazhkudai, X. Ma , et al., “Nvmalloc: Exposing an aggregate ssd store as a memory partition in extreme-scale machines,” in IEEE 26th International Parallel & Distributed Processing Symposium (IPDPS), Shanghai, China, 2012, pp. 957-968. doi: 10.1109/IPDPS.2012.90.
[31]	M. Saxena and M. M. Swift , “Flashvm: Virtual memory management on flash,” in USENIX Annual Technical Conference, Boston, USA, 2010.
[32]	Y. Lu, J. Shu, W. Zheng , “Extending the lifetime of flash-based storage through reducing write amplification from file systems,” in Proc. 11th USENIX Conference on File and Storage Technologies (FAST), San Jose, USA, 2013.
[33]	Y. Lu, J. Shu, W. Wang , “ReconFS: a reconstructable file system on flash storage,” in Proc. 12th USENIX Conference on File and Storage Technologies (FAST), Santa Clara, USA, 2014, pp. 75-88.
[34]	J. Zhang, J. Shu, Y. Lu , “ParaFS: a log-structured file system to exploit the internal parallelism of flash devices,” in USENIX Annual Technical Conference, Denver, USA, 2016.

Persistent Data Layout in File Systems

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 8

References 34

Related Articles 3

Recommended Articles

Metrics

[1]	TU Yaofeng, ZHU Bohong, YANG Hongzhang, HAN Yinjun, SHU Jiwu. RCache: A Read-Intensive Workload-Aware Page Cache for NVM Filesystem [J]. ZTE Communications, 2023, 21(1): 89-94.
[2]	BAI Tongxin, DONG Zhenjiang, CAI Manyi, FAN Xiaopeng, XU Chengzhong, LIU Lixia. A Survey of System Software Techniques for Emerging NVMs [J]. ZTE Communications, 2017, 15(1): 35-42.
[3]	Hancong Duan, Xiaoqin Wang, Ping Lu, Shengmei Luo, and Zhiyong Wang. A New Virtual Disk Mapping Method for the Cloud Desktop Storage Client [J]. ZTE Communications, 2014, 12(4): 3-7.