---

Resources

NOTE: Neither the IOTTA TWG nor SNIA vouch for the accuracy or reliability of any of the traces or other information provided below. Please contact us regarding any broken or inaccurate links.

Jump To:

• Tools and Documentation
• Storage Conferences
• Storage Research Centers
• Papers and Publications
  • Papers Relating to Traces
  • Publications That Cite iotta.snia.org

---

Tools and Documentation

Microsoft Event Tracing (1) (2)

Stonybrook University Dataseries Documentation Wiki

Storage Research List (Computer Storage Systems Research Discussion Forum)

Traces and Snapshots Public Archive

Re-Animator tracing and replay tool

---

Storage Conferences

This is a non-exhaustive list of conferences relating to storage and data management. Note that some of these websites do not have stable domains, so please contact us if a link is broken.

ATC
The USENIX Annual Technical Conference (ATC). Hosted every summer.

EuroSys
EuroSys is organized by EuroSys, the European Chapter of SIGOPS, sponsored by ACM SIGOPS. Hosted annually in mid-spring. This conference does not have a stable URL, so we have linked to a Google search.

FAST
The USENIX File and Storage Technologies (FAST) conference. Hosted annually in February.

HotStorage
The USENIX Workshop on Hot Topics in Storage and File Systems. Hosted every summer directly before ATC.

ICDCS
The IEEE International Conference on Distributed Computing Systems (ICDCS). This conference does not have a stable URL so we have linked to a Google search.

ICS
The ACM International Conference on Supercomputing (ICS). Hosted every summer.

MSST
The International Conference on Massive Storage Systems and Technology (MSST). Hosted every summer at the Santa Clara University School of Engineering in Santa Clara, CA.

NAS
The IEEE International Conference on Networking, Architecture, and Storage. Hosted annually.

NVMSA
The IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA). Hosted annually in the late summer. This conference does not have a stable URL, so we have linked to a Google search.

OSDI
The USENIX Symposium on Operating Systems Design and Implementation (OSDI). Hosted annually.

SIGMETRICS
The ACM Special Interest Group for the computer systems performance evaluation community. Hosted annually in June.

SIGOPS
The ACM Special Interest Group in Operating Systems. Hosts a number of conferences annually.

SoCC
The ACM Symposium on Cloud Computing (SoCC). Hosted annually. This conference does not have a stable URL, so we have linked to a Google search.

SOSP
The ACM Symposium on Operating Systems Principles (SOSP). Hosted annually.

Supercomputing
The International Conference for High Performance Computing, Networking, Storage, and Analysis. Hosted annually in late fall.

SYSTOR
The ACM International Systems and Storage Conference (SYSTOR). Hosted annually in Haifa, Israel.

VLDB
The Very Large Data Bases (VLDB) Conference. Hosted annually in late August.

---

Storage Research Centers

Carnegie Mellon University
Parallel Data Lab (PDL)

San Diego Supercomputer Center (SDSC)

University of Minnesota
Digital Technology Center (DTC)
Intelligent Storage Consortium (DISC)

Storage Performance Council (SPC)

---

Papers and Publications

Papers Relating to Traces

[Harter11] Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau.
A File is Not a File: Understanding the I/O Behavior of Apple Desktop Applications.
Department of Computer Sciences, University of Wisconsin, Madison. 2011.

[Ellard03b] Daniel Ellard, Margo Seltzer.
NFS Tricks and Benchmarking Traps.
Proceedings of the FREENIX Technical Conference, San Antonio, Texas. June, 2003.

[Ellard03a] Daniel Ellard, Jonathan Ledlie, Pia Malkani, Margo Seltzer.
Passive NFS Tracing of Email and Research Workloads.
Proceedings of the Second Annual USENIX File and Storage Technologies Conference, pp. 203-216, San Francisco, CA. March, 2003.

[Roselli00] Drew Roselli, Jacob R. Lorch, Thomas E. Anderson.
A Comparison of File System Workloads.
Proceedings of the 2000 USENIX Technical Conference, pp. 44 - 54. San Diego, CA. June, 2000.

[Vogels99] Werner Vogels.
File system usage in Windows NT 4.0.
Proceedings of the 17th Symposium on Operating System Principles, pp. 93 - 109. Kiawah Island Resort, SC. December, 1999.

[Douceur99] John R. Douceur, William J. Bolosky.
A Large-Scale Study of File-System Contents.
Proceedings of SIGMETRICS '99, pp. 59 - 70. Atlanta, GA. May, 1999.

[Kuenning97] Geoffrey H. Kuenning and Gerald J. Popek.
Automated Hoarding for Mobile Computers.
Proceedings of the 16th ACM Symposium on Operating Systems Principles, St. Malo, France, October 5-8, 1997.

[Uysal97] Mustafa Uysal, Anurag Acharya, Joel Saltz.
Requirements of I/O Systems for Parallel Machines: An Application-driven Study.
Technical Report, CS-TR-3802, University of Maryland, College Park. May 1997.

[Mummert96] L. Mummert, M. Satyanarayanan.
Long Term Distributed File Reference Tracing: Implementation and Experience.
Software - Practice and Experience, Vol. 26, No. 6, pp. 705 - 736. June, 1996.

[Blackwell95] Trevor Blackwell, Jeffrey Harris, Margo Seltzer.
Heuristic Cleaning Algorithms in Log-Structured File Systems.
Proceedings of the 1995 USENIX Technical Conference, pp. 277 - 288. New Orleans, LA. January, 1995.

[Griffioen94] Jim Griffioen, Randy Appleton.
Reducing File System Latency using a Predictive Approach.
Proceedings of the Summer 1994 USENIX Technical Conference, pp. 197 - 207. Boston, MA. June, 1994.

[Chiang93] Chi-ming Chiang, Matt W. Mutka.
Characteristics of User File Usage Patterns.
Systems and Software, Vol. 23, No. 3, pp. 257 - 268. December, 1993.

[Ruemmler93] Chris Ruemmler, John Wilkes.
UNIX Disk Access Patterns.
Proceedings of the Winter 1993 USENIX Technical Conference, pp. 405 - 420. San Diego, CA. January, 1993.

[Ramakrishnan92] K.K. Ramakrishnan, Prabuddha Biswas, Ramakrishna Karedla.
Analysis of File I/O Traces in Commercial Computing Environments.
Proceedings of SIGMETRICS '92, pp. 78 - 90. Newport, RI. June, 1992.

[Roselli98] Drew Roselli, Thomas E. Anderson.
Characteristics of File System Workloads.
University of California Berkeley Computer Science Division Technical Report UCB//CSD-98-1029. 1992.

[Shirriff92] Ken Shirriff, John K. Ousterhout.
A Trace-Driven Analysis of Name and Attribute Caching in a Distributed System.
Proceedings of the Winter 1992 USENIX Technical Conference, pp. 315 - 332. San Francisco, CA. January, 1992.

[Miller91] Ethan L. Miller, Randy H. Katz.
Input/Output Behavior of Supercomputing Applications.
Proceedings of the 1991 Conference on Supercomputing, pp. 567 - 576. Albuquerque, NM. November, 1991.

[Baker91] M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout.
Measurements of a Distributed File System.
Proceedings of the 13th ACM Symposium of Operating Systems Principles, pp. 198 - 212. October 1991.

[Bozman91] G.P. Bozman, H.H. Ghannad, E.D. Weinberger.
A trace-driven study of CMS file references.
IBM Journal of Research and Development, Vol. 35, No. 5/6, pp. 815 - 828. September/November, 1991.

[Bennet91] J. Michael Bennet, Michael A. Bauer, David Kinchlea.
Characteristics of Files in NFS Environments.
Proceedings of the 1991 ACM Symposium on Small Systems, pp. 33 - 40. 1991.

[Biswas90] P. Biswas, K.K. Ramakrishnan.
File Access Characterization of VAX/VMS Environments.
Proceedings of the 10th International Conference on Distributed Computing Systems, pp. 227 - 234. Paris, France. May, 1990.

[Floyd86] Rick Floyd.
Short-Term File Reference Patterns in a UNIX Environment.
University of Rochester Computer Science Technical Report #177. March, 1986.

[Ousterhout85] J. Ousterhout, H. Costa, D. Harrison, J. Kunze, M. Kupfer, J. Thompson.
A Trace-Driven Analysis of the UNIX 4.2BSD File System.
Proceedings of the 10th Symposium on Operating System Principles, pp. 15 - 24. Orcas Island, WA. December, 1985.

[Satyanarayanan81] M. Satyanarayanan.
A Study of File Sizes and Functional Lifetimes.
Proceedings of the 8th Symposium on Operating System Principles, pp. 96 - 108. Pacific Grove, CA. December, 1981.

[Smith81] A. J. Smith.
Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms.
IEEE Transactions on Software Engineering, Vol SE-7, No. 4, pp. 403 - 417. July, 1981.

Publications That Cite iotta.snia.org

The following publications cite iotta.snia.org as a source of trace data used in their research. They are organized in reverse chronological order. This list attempts to be comprehensive but is not complete; feel free to contact us to suggest additional entries.

[Prada et al., 2013]

Laura Prada, Alejandro Calderón, Javier Garcia, J. Daniel, and Jesús Carretero. A novel black-box simulation model methodology for predicting performance and energy consumption in commodity storage devices. Simulation Modelling Practice and Theory, 34:48–63, May 2013. (doi:10.1016/j.simpat.2013.01.006)

[Qin et al., 2013]

Yi Qin, Dan Feng, Wei Tong, Jingning Liu, Yang Hu, and Zhiming Zhu. Per-file secure deletion combining with enhanced reliability for SSDs. In Proceedings of the 8th International Conference on Grid and Pervasive Computing (GPC), volume 7861 of Lecture Notes in Computer Science, pages 509–516, Seoul, South Korea, May 2013. Springer-Verlag. (doi:10.1007/978-3-642-38027-3_54)

[Talwadker and Voruganti, 2013]

Rukma Talwadker and Kaladhar Voruganti. Paragone: What's next in block I/O trace modeling. In Proceedings of the 29th IEEE Symposium on Mass Storage Systems and Technologies, Long Beach, CA, May 2013. (doi:10.1109/MSST.2013.6558436)

[Zhang et al., 2013]

Yupu Zhang, Daniel S. Myers, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. Zettabyte reliability with flexible end-to-end data integrity. In Proceedings of the 29th IEEE Symposium on Mass Storage Systems and Technologies, Long Beach, CA, May 2013. (doi:10.1109/MSST.2013.6558423)

[Budilovsky, 2013]

Evgeny Budilovsky. Kernel based mechanisms for high performance I/O. Master's thesis, Tel Aviv University, April 2013.

[Khanafer et al., 2013]

Ali Khanafer, Murali Kodialam, and Krishna P. N. Puttaswamy. The constrained ski-rental problem and its application to online cloud cost optimization. In Proceedings of the IEEE International Conference on Computer Communications, Turin, Italy, April 2013. IEEE. (doi:10.1109/INFCOM.2013.6566944)

[Park et al., 2013]

Dongchul Park, Young Jin Nam, Biplob Debnath, David H. C. Du, Youngkyun Kim, and Youngchul Kim. An on-line hot data identification for flash-based storage using sampling mechanism. ACM SIGAPP Applied Computing Review, 13(1):51–64, March 2013. (doi:10.1145/2460136.2460141)

[Thereska et al., 2013]

Eno Thereska, Austin Donnelly, and Dushyanth Naraynanan. Reducing power consumption of distributed storage systems. United States Patent 8,370,672, February 5 2013.

[Lu et al., 2013]

Youyou Lu, Jiwu Shu, and Weimin Zheng. Extending the lifetime of flash-based storage through reducing write amplification from file systems. In Proceedings of the 11th USENIX Conference on File and Storage Technologies, pages 257–270, San Jose, CA, February 2013. USENIX Association.

[Shin et al., 2013]

Ji-Yong Shin, Mahesh Balakrishnan, Tudor Marian, and Hakim Weatherspoon. Gecko: Contention-oblivious disk arrays for cloud storage. In Proceedings of the 11th USENIX Conference on File and Storage Technologies, San Jose, CA, February 2013.

[Chen et al., 2013]

Zhi-Guang Chen, Nong Xiao, Fang Liu, and Yi-Mo Du. Reorder write sequence by hetero-buffer to extend SSD's lifespan. Journal of Computer Science and Technoogy, 28(1):14–27, January 2013.

[Brook et al., 2012]

Tony Brook, Mason Cabot, Frank Hady, and Matthew Shopsin. Measuring and improving single-user NAS performance. Dongseo University Fall 2012 Course, 2012.

[Chao and Fang, 2012]

Liu Chao and Hu Fang. Research on reliability design of data storage for embedded system. Physics Procedia, 25:1405–1408, 2012. (doi:10.1016/j.phpro.2012.03.253)

[Dai et al., 2012]

Chengjun Dai, Guiquan Liu, Lei Zhang, and Enhong Chen. Storage device performance prediction with hybrid regression models. In Proceedings of the 13th International Conference on Parallel and Distributed Computing, Applications and Technologies, Beijing, China, December 2012.

[Fu et al., 2012]

Yinjin Fu, Hong Jiang, and Nong Xiao. A scalable inline cluster deduplication framework for big data protection. In Proceedings of the 13th ACM/IFIP/Usenix International Middleware Conference, Montreal, Quebec, Canada, December 2012. USENIX Association.

[Jung et al., 2012]

Myoungsoo Jung, Ramya Prabhakar, and Mahmut Taylan Kandemir. Taking garbage collection overheads off the critical path in SSDs. In Proceedings of the 13th ACM/IFIP/Usenix International Middleware Conference, volume 7662 of Lecture Notes in Computer Science, pages 164–186, Montreal, Quebec, Canada, December 2012. Springer-Verlag. (doi:10.1007/978-3-642-35170-9_9)

[Xu et al., 2012]

Zhiyong Xu, Ruixuan Li, and Cheng-Zhong Xu. CAST: A page-level FTL with compact address mapping and parallel data blocks. In Proceedings of the 29th IEEE International Performance, Computing, and Communications Conference, Austin, TX, December 2012. (doi:10.1109/PCCC.2012.6407747)

[Wang et al., 2012]

Mingbang Wang, Youguang Zhang, and Wang Kang. ZFTL: A zone-based flash translation layer with a two-tier selective caching mechanism. In Proceedings of the 14th IEEE International Conference on Communication Technology, Chengdu, China, November 2012. (doi:10.1109/ICCT.2012.6511426)

[Arumugam et al., 2012]

Rajesh Vellore Arumugam, Chuan Heng Foh, Haixiang Shi, and Kyawt Kyawt Khaing. HCache: A hybrid cache management scheme with flash and next generation NVRAM. In Proceedings of the Asia-Pacific Magnetic Recording Conference (APMRC), Singapore, October 2012.

[yu Liu, 2012]

Shih yu Liu. An efficient data management method for SSD-based storage systems. Master's thesis, National Taiwan University of Science and Technology, Taipei, Taiwan, October 2012.

[Cai et al., 2012]

Yu Cai, Gulay Yalcin, Onur Mutlu, Erich F. Haratsch, Adrian Cristal, Osman S. Unsal, and Ken Mai. Flash correct-and-refresh: Retention-aware error management for increased flash memory lifetime. In Proceedings of the 30th IEEE International Conference on Computer Design, pages 94–101, Montreal, Canada, September 2012. (doi:10.1109/ICCD.2012.6378623)

[Wan et al., 2012]

Jiguang Wan, Nannan Zhao, Yifeng Zhu, Jibin Wang, Yu Mao, Peng Chen, and Changsheng Xie. High performance and high capacity hybrid shingled-recording disk system. In Proceedings of the IEEE International Conference on Cluster Computing (CLUSTER), Beijing, China, September 2012. IEEE. (doi:10.1109/CLUSTER.2012.21)

[Yan et al., 2012]

Feng Yan, Alma Riska, and Evgenia Smirni. Toward fast eventual consistency with performance guarantees. In Proceedings of the 9th ACM International Conference on Autonomic Computing, pages 167–172, San Jose, CA, September 2012. ACM.

[Al Assaf et al., 2012]

Maen M. Al Assaf, Mohammed I. Alghamdi, Xunfei Jiang, Ji Zhang, and Xiao Qin. A pipelining approach to informed prefetching in distributed multi-level storage systems. In Proceedings of the 11th IEEE International Symposium on Network Computing and Applications, Cambridge, MA, August 2012. IEEE. (doi:10.1109/NCA.2012.26)

[Lin et al., 2012]

Chung-I Lin, Dongchul Park, Weiping He, and David H.C. Du. H-SWD: Incorporating hot data identification into shingled write disks. In Proceedings of the 20th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Washington, DC, August 2012. IEEE.

[Liu et al., 2012]

Zhuo Liu, Bin Wang, Patrick Carpenter, Dong Li, Jeffrey S. Vetter, and Weikuan Yu. PCM-based durable write cache for fast disk I/O. In Proceedings of the IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pages 451–458, Washington, DC, August 2012. IEEE.

[Suh et al., 2012]

Young-Kyoon Suh, Bongki Moon, A. Efrat, Jin-Soo Kim, and Sang-Won Lee. Extent mapping scheme for flash memory devices. In Proceedings of the 20th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Washington, DC, August 2012. IEEE.

[Prada et al., 2012]

Laura Prada, Alejandro Calderón, Javier Garcia, J. Daniel Garcia, and Jesús Carretero. A black box model for storage devices based on probability distributions. In Proceedings of the 10th IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA), pages 355–362. IEEE, July 2012.

[Amvrosiadis et al., 2012]

George Amvrosiadis, Alina Oprea, and Bianca Schroeder. Practical scrubbing: Getting to the bad sector at the right time. In Proceedings of the 42nd IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Boston, MA, June 2012.

[Chen et al., 2012]

Zhiguang Chen, Nong Xiao, and Fang Liu. SAC: Rethinking the cache replacement policy for SSD-based storage systems. In Proceedings of the 5th ACM International Systems and Storage Conference (SYSTOR), Haifa, Israel, June 2012. (doi:10.1145/2367589.2367598)

[Huang et al., 2012]

Po-Chun Huang, Yuan-Hao Chang, and Tei-Wei Kuo. Joint management of RAM and flash memory with access pattern considerations. In Proceedings of the 49th ACM/EDAC/IEEE Design Automation Conference, San Francisco, CA, June 2012.

[Qin et al., 2012]

Yi Qin, Dan Feng, Jingning Liu, Wei Tong, Yang Hu, and Zhiming Zhu. A parity scheme to enhance reliability for SSDs. In Proceedings of the 7th IEEE International Conference on Networking, Architecture, and Storage, pages 293–297, Xiamen, China, June 2012. IEEE.

[Tjioe et al., 2012]

Jonathan Tjioe, Alberto Blanco, Tao Xie, and Yiming Ouyang. Making garbage collection wear conscious for flash SSD. In Proceedings of the 7th IEEE International Conference on Networking, Architecture, and Storage, pages 114–123, Xiamen, Fujian, China, June 2012. IEEE.

[Yan et al., 2012]

Feng Yan, Alma Riska, and Evgenia Smirni. Fast eventual consistency with performance guarantees for distributed storage. In Proceedings of the 32nd International Conference on Distributed Computing Systems Workshops, Macau, China, June 2012. IEEE.

[Zhao and Bai, 2012]

Peng Zhao and Shi Bai. A random-walk based wear-leveling algorithm for large-capacity SSDs. Chinese Journal of Computers, 35(5), May 2012.

[Puttaswamy et al., 2012]

Krishna P.N. Puttaswamy, Thyaga Nandagopal, and Murali Kodialam. Frugal storage for cloud file systems. In Proceedings of the 7th ACM European Conference on Computer Systems, pages 71–84, Bern, Switzerland, April 2012. (doi:10.1145/2168836.2168845)

[Qiu et al., 2012]

Jian-Ping Qiu, Guang-Yan Zhang, and Ji-Wu Shu. DMStone: A tool for evaluating hierarchical storage management systems. Journal of Software, 23:987–995, April 2012. (doi:10.3724/SP.J.1001.2012.04046)

[Reiss et al., 2012]

Charles Reiss, John Wilkes, and Joseph L. Hellerstein. Obfuscatory obscanturism: Making workload traces of commercially-sensitive systems safe to release. In Proceedings of the IEEE Network Operations and Management Symposium (NOMS), Maui, HI, April 2012. (doi:10.1109/NOMS.2012.6212064)

[Abad et al., 2012]

Cristina L. Abad, Huong Luu, Yi Lu, and Roy H. Campbell. Metadata workloads for testing big storage systems. Technical report, University of Illinois at Urbana-Champaign, March 2012.

[Park et al., 2012]

Dongchul Park, Biplob Debnath, Youngjin Nam, David H. C. Du Du, Youngkyun Kim, and Youngchul Kim. HotDataTrap: A sampling-based hot data identification scheme for flash memory. In Proceedings of the 27th ACM Symposium on Applied Computing, pages 1610–1617, Riva del Garda, Italy, March 2012. ACM. (doi:10.1145/2245276.2232034)