---

Resources

NOTE: Neither the IOTTA TWG nor SNIA vouch for the accuracy or reliability of any of the traces or other information provided below. Please contact us regarding any broken or inaccurate links.

Jump To:

• Tools and Documentation
• Storage Conferences
• Storage Research Centers
• Papers and Publications
  • Papers Relating to Traces
  • Publications That Cite iotta.snia.org

---

Tools and Documentation

Microsoft Event Tracing (1) (2)

Stonybrook University Dataseries Documentation Wiki

Storage Research List (Computer Storage Systems Research Discussion Forum)

Traces and Snapshots Public Archive

Re-Animator tracing and replay tool

---

Storage Conferences

This is a non-exhaustive list of conferences relating to storage and data management. Note that some of these websites do not have stable domains, so please contact us if a link is broken.

ATC
The USENIX Annual Technical Conference (ATC). Hosted every summer.

EuroSys
EuroSys is organized by EuroSys, the European Chapter of SIGOPS, sponsored by ACM SIGOPS. Hosted annually in mid-spring. This conference does not have a stable URL, so we have linked to a Google search.

FAST
The USENIX File and Storage Technologies (FAST) conference. Hosted annually in February.

HotStorage
The USENIX Workshop on Hot Topics in Storage and File Systems. Hosted every summer directly before ATC.

ICDCS
The IEEE International Conference on Distributed Computing Systems (ICDCS). This conference does not have a stable URL so we have linked to a Google search.

ICS
The ACM International Conference on Supercomputing (ICS). Hosted every summer.

MSST
The International Conference on Massive Storage Systems and Technology (MSST). Hosted every summer at the Santa Clara University School of Engineering in Santa Clara, CA.

NAS
The IEEE International Conference on Networking, Architecture, and Storage. Hosted annually.

NVMSA
The IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA). Hosted annually in the late summer. This conference does not have a stable URL, so we have linked to a Google search.

OSDI
The USENIX Symposium on Operating Systems Design and Implementation (OSDI). Hosted annually.

SIGMETRICS
The ACM Special Interest Group for the computer systems performance evaluation community. Hosted annually in June.

SIGOPS
The ACM Special Interest Group in Operating Systems. Hosts a number of conferences annually.

SoCC
The ACM Symposium on Cloud Computing (SoCC). Hosted annually. This conference does not have a stable URL, so we have linked to a Google search.

SOSP
The ACM Symposium on Operating Systems Principles (SOSP). Hosted annually.

Supercomputing
The International Conference for High Performance Computing, Networking, Storage, and Analysis. Hosted annually in late fall.

SYSTOR
The ACM International Systems and Storage Conference (SYSTOR). Hosted annually in Haifa, Israel.

VLDB
The Very Large Data Bases (VLDB) Conference. Hosted annually in late August.

---

Storage Research Centers

Carnegie Mellon University
Parallel Data Lab (PDL)

San Diego Supercomputer Center (SDSC)

University of Minnesota
Digital Technology Center (DTC)
Intelligent Storage Consortium (DISC)

Storage Performance Council (SPC)

---

Papers and Publications

Papers Relating to Traces

[Harter11] Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau.
A File is Not a File: Understanding the I/O Behavior of Apple Desktop Applications.
Department of Computer Sciences, University of Wisconsin, Madison. 2011.

[Ellard03b] Daniel Ellard, Margo Seltzer.
NFS Tricks and Benchmarking Traps.
Proceedings of the FREENIX Technical Conference, San Antonio, Texas. June, 2003.

[Ellard03a] Daniel Ellard, Jonathan Ledlie, Pia Malkani, Margo Seltzer.
Passive NFS Tracing of Email and Research Workloads.
Proceedings of the Second Annual USENIX File and Storage Technologies Conference, pp. 203-216, San Francisco, CA. March, 2003.

[Roselli00] Drew Roselli, Jacob R. Lorch, Thomas E. Anderson.
A Comparison of File System Workloads.
Proceedings of the 2000 USENIX Technical Conference, pp. 44 - 54. San Diego, CA. June, 2000.

[Vogels99] Werner Vogels.
File system usage in Windows NT 4.0.
Proceedings of the 17th Symposium on Operating System Principles, pp. 93 - 109. Kiawah Island Resort, SC. December, 1999.

[Douceur99] John R. Douceur, William J. Bolosky.
A Large-Scale Study of File-System Contents.
Proceedings of SIGMETRICS '99, pp. 59 - 70. Atlanta, GA. May, 1999.

[Kuenning97] Geoffrey H. Kuenning and Gerald J. Popek.
Automated Hoarding for Mobile Computers.
Proceedings of the 16th ACM Symposium on Operating Systems Principles, St. Malo, France, October 5-8, 1997.

[Uysal97] Mustafa Uysal, Anurag Acharya, Joel Saltz.
Requirements of I/O Systems for Parallel Machines: An Application-driven Study.
Technical Report, CS-TR-3802, University of Maryland, College Park. May 1997.

[Mummert96] L. Mummert, M. Satyanarayanan.
Long Term Distributed File Reference Tracing: Implementation and Experience.
Software - Practice and Experience, Vol. 26, No. 6, pp. 705 - 736. June, 1996.

[Blackwell95] Trevor Blackwell, Jeffrey Harris, Margo Seltzer.
Heuristic Cleaning Algorithms in Log-Structured File Systems.
Proceedings of the 1995 USENIX Technical Conference, pp. 277 - 288. New Orleans, LA. January, 1995.

[Griffioen94] Jim Griffioen, Randy Appleton.
Reducing File System Latency using a Predictive Approach.
Proceedings of the Summer 1994 USENIX Technical Conference, pp. 197 - 207. Boston, MA. June, 1994.

[Chiang93] Chi-ming Chiang, Matt W. Mutka.
Characteristics of User File Usage Patterns.
Systems and Software, Vol. 23, No. 3, pp. 257 - 268. December, 1993.

[Ruemmler93] Chris Ruemmler, John Wilkes.
UNIX Disk Access Patterns.
Proceedings of the Winter 1993 USENIX Technical Conference, pp. 405 - 420. San Diego, CA. January, 1993.

[Ramakrishnan92] K.K. Ramakrishnan, Prabuddha Biswas, Ramakrishna Karedla.
Analysis of File I/O Traces in Commercial Computing Environments.
Proceedings of SIGMETRICS '92, pp. 78 - 90. Newport, RI. June, 1992.

[Roselli98] Drew Roselli, Thomas E. Anderson.
Characteristics of File System Workloads.
University of California Berkeley Computer Science Division Technical Report UCB//CSD-98-1029. 1992.

[Shirriff92] Ken Shirriff, John K. Ousterhout.
A Trace-Driven Analysis of Name and Attribute Caching in a Distributed System.
Proceedings of the Winter 1992 USENIX Technical Conference, pp. 315 - 332. San Francisco, CA. January, 1992.

[Miller91] Ethan L. Miller, Randy H. Katz.
Input/Output Behavior of Supercomputing Applications.
Proceedings of the 1991 Conference on Supercomputing, pp. 567 - 576. Albuquerque, NM. November, 1991.

[Baker91] M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout.
Measurements of a Distributed File System.
Proceedings of the 13th ACM Symposium of Operating Systems Principles, pp. 198 - 212. October 1991.

[Bozman91] G.P. Bozman, H.H. Ghannad, E.D. Weinberger.
A trace-driven study of CMS file references.
IBM Journal of Research and Development, Vol. 35, No. 5/6, pp. 815 - 828. September/November, 1991.

[Bennet91] J. Michael Bennet, Michael A. Bauer, David Kinchlea.
Characteristics of Files in NFS Environments.
Proceedings of the 1991 ACM Symposium on Small Systems, pp. 33 - 40. 1991.

[Biswas90] P. Biswas, K.K. Ramakrishnan.
File Access Characterization of VAX/VMS Environments.
Proceedings of the 10th International Conference on Distributed Computing Systems, pp. 227 - 234. Paris, France. May, 1990.

[Floyd86] Rick Floyd.
Short-Term File Reference Patterns in a UNIX Environment.
University of Rochester Computer Science Technical Report #177. March, 1986.

[Ousterhout85] J. Ousterhout, H. Costa, D. Harrison, J. Kunze, M. Kupfer, J. Thompson.
A Trace-Driven Analysis of the UNIX 4.2BSD File System.
Proceedings of the 10th Symposium on Operating System Principles, pp. 15 - 24. Orcas Island, WA. December, 1985.

[Satyanarayanan81] M. Satyanarayanan.
A Study of File Sizes and Functional Lifetimes.
Proceedings of the 8th Symposium on Operating System Principles, pp. 96 - 108. Pacific Grove, CA. December, 1981.

[Smith81] A. J. Smith.
Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms.
IEEE Transactions on Software Engineering, Vol SE-7, No. 4, pp. 403 - 417. July, 1981.

Publications That Cite iotta.snia.org

The following publications cite iotta.snia.org as a source of trace data used in their research. They are organized in reverse chronological order. This list attempts to be comprehensive but is not complete; feel free to contact us to suggest additional entries.

[Wu et al., 2015]

Yunxiang Wu, Fang Wang, Yu Hua, Dan Feng, Yuchong Hu, Jingning Liu, and Wei Tong. FastFCoE: An efficient and scale-up multi-core framework for FCoE-based SAN storage systems. In Proceedings of the 44th International Conference on Parallel Processing, Beijing, China, September 2015.

[Cui et al., 2015]

Yan Cui, Quan Chen, and Junfeng Yang. EOS: Automatic in-vivo evolution of kernel policies for better performance. ArXiv, August 2015.

[Hu et al., 2015]

Yang Hu, Hong Jiang, Dan Feng, Hao Luo, and Lei Tian. PASS: A proactive and adaptive SSD buffer scheme for data-intensive workloads. In Proceedings of the 2015 IEEE International Conference on Networking, Architecture, and Storage, Boston, MA, August 2015. (doi:10.1109/NAS.2015.7255206)

[Khanafer et al., 2015]

Ali Khanafer, Murali Kodialam, and Krishna P. N. Puttaswamy. To rent or to buy in the presence of statistical information: The constrained ski-rental problem. IEEE/ACM Transactions on Networking, 23(4):1067–1077, August 2015. (doi:10.1109/TNET.2014.2326988)

[Li et al., 2015]

Zheng Li, Shuangwu Zhang, Jingning Liu, Wei Tong, Yu Hua, Dan Feng, and Chenye Yu. A software-defined fusion storage system for PCM and NAND flash. In Proceedings of the 2015 IEEE Non-Volatile Memory Systems and Applications Symposium, Hong Kong, China, August 2015. (doi:10.1109/NVMSA.2015.7304361)

[Liu et al., 2015]

Shengzhuo Liu, Jinlei Jiang, and Guangwen Yang. Fast cross-datacenter virtual machine migration algorithm based on duplication. Journal of Tsinghua University, 55:579–584, August 2015.

[Meyer, 2015]

Dutch T. Meyer. Storage System Tracing and Analysis. PhD thesis, University of British Columbia, August 2015. (doi:10.14288/1.0166682)

[Tan et al., 2015]

Shishi Tan, Ruirong Yu, Shenggang Wan, and Qiang Cao. Cost-effectively improving life endurance of MLC NAND flash SSDs via hierarchical data redundancy and heterogeneous flash memory. In Proceedings of the 2015 IEEE International Conference on Networking, Architecture, and Storage, pages 336–344, Boston, MA, August 2015. (doi:10.1109/NAS.2015.7255200)

[Li et al., 2015]

Zhichao Li, Ming Chen, Amanpreet Mukker, and Erez Zadok. On the trade-offs among performance, energy, and endurance in a versatile hybrid drive. ACM Transactions on Storage, 11(3), July 2015. (doi:10.1145/2700312)

[Santana et al., 2015]

Ricardo Santana, Steven Lyons, Ricardo Koller, Raju Rangaswami, and Jason Liu. To ARC or not to ARC. In Proceedings of the 7th USENIX Workshop on Hot Topics in Storage and File Systems, Santa Clara, CA, July 2015. USENIX Association.

[Wu et al., 2015]

Chin-Hsien Wu, Po-Han Wu, Kuo-Long Chen, Wen-Yen Chang, and Kun-Cheng Lai. A hotness filter of files for reliable non-volatile memory systems. IEEE Transactions on Dependable and Secure Computing, 12(4):375–386, July 2015. (doi:10.1109/TDSC.2015.2399313)

[Cai et al., 2015]

Yu Cai, Yixin Luo, Saugata Ghose, and Onur Mutlu. Read disturb errors in MLC NAND flash memory: Characterization, mitigation, and recovery. In Proceedings of the 45th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Rio de Janeiro, Brazil, June 2015. (doi:10.1109/DSN.2015.49)

[Chang et al., 2015]

Yu-Ming Chang, Yuan-Hao Chang, Tei-Wei Kuo, Yung-Chun Li, and Hsiang-Pang Li. Achieving SLC performance with MLC flash memory. In Proceedings of the 52nd ACM/EDAC/IEEE Design Automation Conference, San Francisco, CA, June 2015. (doi:10.1145/2744769.2744790)

[Owen, 2015]

Jonathan D. Owen. Data Management in Engineering Design. PhD thesis, University of Southampton, June 2015.

[Yang et al., 2015]

Ming-Chang Yang, Yuan-Hao Chang, and Tei-Wei Kuo. Virtual flash chips: Rethinking the layer design of flash devices to improve data recoverability. In Proceedings of the 52nd ACM/EDAC/IEEE Design Automation Conference, San Francisco, CA, June 2015. (doi:10.1145/2744769.2744929)

[Al Assaf, 2015]

Maen M. Al Assaf. Predictive prefetching for parallel hybrid storage systems. International Journal of Communications, Network and System Sciences, 8(5):161–180, May 2015. (doi:10.4236/ijcns.2015.85018)

[Al Assaf et al., 2015]

Maen M. Al Assaf, Ali Rodan, Mohammad Qatawneh, and Mohamed Riduan Abid. A comparison study between informed and predictive prefetching mechanisms for I/O storage systems. International Journal of Communications, Network and System Sciences, 8(5):181–186, May 2015. (doi:10.4236/ijcns.2015.85019)

[Anglano et al., 2015]

Cosimo Anglano, Rossano Gaeta, and Marco Grangetto. Exploiting rateless codes in cloud storage systems. IEEE Transactions on Parallel and Distributed Systems, 26(5):1313–1322, May 2015. (doi:10.1109/TPDS.2014.2321745)

[Liu, 2015]

Zhuo Liu. Efficient Storage Design and Query Scheduling for Improving Big Data Retrieval and Analytics. PhD thesis, Auburn University, May 2015.

[Liu et al., 2015]

Chun-Yi Liu, Yu-Ming Chang, and Yuan-Hao Chang. Read leveling for flash storage systems. In Proceedings of the 8th ACM International Systems and Storage Conference (SYSTOR), Haifa, Israel, May 2015. (doi:10.1145/2757667.2757679)

[MacFadden et al., 2015]

Michael S. MacFadden, Richard Shelby, and Tao Xie. SIRF-1: Enhancing reliability of single flash SSD through internal mirroring for mission-critical mobile applications. In Proceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), Shenzhen, China, May 2015. IEEE.

[Matsui et al., 2015]

Chihiro Matsui, Asuka Arakaw, Chao Sun, Tomoko Ogura Iwasaki, and Ken Takeuchi. 3X faster speed solid-state drive with a write order based garbage collection scheme. In Proceedings of the 7th IEEE International Memory Workshop, Monterey, CA, May 2015. IEEE. (doi:10.1109/IMW.2015.7150265)

[Okamoto et al., 2015]

Shun Okamoto, Chao Sun, Shogo Hachiya, Tomoaki Yamada, Yusuke Saito, Tomoko Ogura Iwasaki, and Ken Takeuchi. Application driven SCM & NAND flash hybrid SSD design for data-centric computing system. In Proceedings of the 7th IEEE International Memory Workshop, Monterey, CA, May 2015. (doi:10.1109/IMW.2015.7150277)

[Wang and Baskiyar, 2015]

Chengjun Wang and Sanjeev Baskiyar. Extending flash lifetime in secondary storage. Microprocessors & Microsystems, 39(3):167–180, May 2015. (doi:10.1016/j.micpro.2015.03.002)

[Yang and Zhu, 2015]

Yue Yang and Jianwen Zhu. Algebraic modeling of write amplification in hotness-aware SSD. In Proceedings of the 8th ACM International Systems and Storage Conference (SYSTOR), Haifa, Israel, May 2015. (doi:10.1145/2757667.2757671)

[Zhao et al., 2015]

Nannan Zhao, Jiguang Wan, Jun Wang, and Changsheng Xie. GreenCHT: A power-proportional replication scheme for consistent hashing based key value storage systems. In Proceedings of the 31st IEEE Symposium on Mass Storage Systems and Technologies, Santa Clara, CA, May 2015. (doi:10.1109/MSST.2015.7208289)

[Warfield et al., 2015]

Andrew Warfield, Jacob Wires, and Stephen Ingram. Systems, methods and devices for implementing data management in a distributed data storage system. United States Patent 2015/O106578, April 16 2015.

[Zhou et al., 2015]

You Zhou, Fei Wu, Ping Huang, Xubin He, Changsheng Xie, and Jian Zhou. An efficient page-level FTL to optimize address translation in flash memory. In Proceedings of the 10th ACM European Conference on Computer Systems, Bordeaux, France, April 2015. (doi:10.1145/2741948.2741949)

[Chang et al., 2015]

Li-Pin Chang, Yo-Chuan Su, and I-Chen Wu. Plugging versus logging: Adaptive buffer management for hybrid-mapping SSDs. ACM Transactions on Embedded Computing Systems, 14(2), March 2015. (doi:10.1145/2629455)

[Jain, 2015]

Nitisha Jain. Performance specific I/O scheduling framework for cloud storage. Master's thesis, Indian Institute of Science, March 2015.

[Jain and Lakshmi, 2015]

Nitisha Jain and J. Lakshmi. PriDyn: Enabling differentiated I/O services in cloud using dynamic priorities. IEEE Transactions on Services Computing, 8(2):212–224, March 2015. (doi:10.1109/TSC.2014.2381251)

[Li et al., 2015]

Pingguo Li, Fei Wu, You Zhou, Changsheng Xie, and Jiang Yu. AOS: Adaptive out-of-order scheduling for write-caused interference reduction in solid state disks. In Proceedings of the International Multiconference of Engineers and Computer Scientists, pages 172–177, Hong Kong, China, March 2015.

[Onagi et al., 2015]

Takahiro Onagi, Chao Sun, and Ken Takeuchi. Design guidelines of storage class memory based solid-state drives to balance performance, power, endurance, and cost. Japanese Journal of Applied Physics, 54(4S), March 2015. (doi:10.7567/JJAP.54.04DE04)

[Zhang et al., 2015]

Quan Zhang, Dan Feng, Fang Wang, and Sen Wu. Mlock: Building delegable metadata service for the parallel file systems. Science China Information Systems, 58(3):1–14, March 2015. (doi:10.1007/s11432-014-5194-5)

[Waldspurger et al., 2015]

Carl A. Waldspurger, Nohhyun Park, Alexander Garthwaite, and Irfan Ahmad. Efficient MRC construction with SHARDS. In Proceedings of the 13th USENIX Conference on File and Storage Technologies, pages 95–110, Santa Clara, CA, February 2015. USENIX Association.

[Wang et al., 2015]

Ronghui Wang, Zhiguang Chen, Nong Xiao, Minxuan Zhang, and Weihua Dong. CAWR: Buffer replacement with channel-aware write reordering mechanism for SSDs. ETRI Journal, 37(1):147–156, February 2015. (doi:10.4218/etrij.15.0114.0055)

[Wei et al., 2015]

Qingsong Wei, Cheng Chen, Mingdi Xue, and Jun Yang. Z-MAP: A zone-based flash translation layer with workload classification for solid-state drive. ACM Transactions on Storage, 11(1), February 2015. (doi:10.1145/2629663)

[Liao et al., 2015]

Jianwei Liao, Fengxiang Zhang, Li Li, and Guoqiang Xiao. Adaptive wear-leveling in flash-based memory. IEEE Computer Architecture Letters, 14(1):1–4, January 2015. (doi:10.1109/LCA.2014.2329871)

[Xia et al., 2015]

Shiying Xia, Yu Mao, Minsheng Tan, and Weipeng Jing. HCS: Expanding H-code RAID 6 without recalculating parity blocks in big data circumstance. In Proceedings of the International Conference of Young Computer Scientists, Engineers and Educators (ICYCSEE), Harbin, China, January 2015. Springer-Verlag. (doi:10.1007/978-3-662-46248-5_9)

[Altiparmak and Tosun, 2014]

Nihat Altiparmak and Ali Saman Tosun. Continuous retrieval of replicated data from heterogeneous storage arrays. In Proceedings of the 22nd IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pages 285–294, Paris, France, 2014. IEEE.