Resources

NOTE: Neither the IOTTA TWG nor SNIA vouch for the accuracy or reliability of any of the traces or other information provided below. Please contact us regarding any broken or inaccurate links.

Jump To:


Tools and Documentation

Microsoft Event Tracing (1) (2)

Stonybrook University Dataseries Documentation Wiki

Storage Research List (Computer Storage Systems Research Discussion Forum)

Traces and Snapshots Public Archive

Re-Animator tracing and replay tool


Storage Conferences

This is a non-exhaustive list of conferences relating to storage and data management. Note that some of these websites do not have stable domains, so please contact us if a link is broken.

ATC
The USENIX Annual Technical Conference (ATC). Hosted every summer.

EuroSys
EuroSys is organized by EuroSys, the European Chapter of SIGOPS, sponsored by ACM SIGOPS. Hosted annually in mid-spring. This conference does not have a stable URL, so we have linked to a Google search.

FAST
The USENIX File and Storage Technologies (FAST) conference. Hosted annually in February.

HotStorage
The USENIX Workshop on Hot Topics in Storage and File Systems. Hosted every summer directly before ATC.

ICDCS
The IEEE International Conference on Distributed Computing Systems (ICDCS). This conference does not have a stable URL so we have linked to a Google search.

ICS
The ACM International Conference on Supercomputing (ICS). Hosted every summer.

MSST
The International Conference on Massive Storage Systems and Technology (MSST). Hosted every summer at the Santa Clara University School of Engineering in Santa Clara, CA.

NAS
The IEEE International Conference on Networking, Architecture, and Storage. Hosted annually.

NVMSA
The IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA). Hosted annually in the late summer. This conference does not have a stable URL, so we have linked to a Google search.

OSDI
The USENIX Symposium on Operating Systems Design and Implementation (OSDI). Hosted annually.

SIGMETRICS
The ACM Special Interest Group for the computer systems performance evaluation community. Hosted annually in June.

SIGOPS
The ACM Special Interest Group in Operating Systems. Hosts a number of conferences annually.

SoCC
The ACM Symposium on Cloud Computing (SoCC). Hosted annually. This conference does not have a stable URL, so we have linked to a Google search.

SOSP
The ACM Symposium on Operating Systems Principles (SOSP). Hosted annually.

Supercomputing
The International Conference for High Performance Computing, Networking, Storage, and Analysis. Hosted annually in late fall.

SYSTOR
The ACM International Systems and Storage Conference (SYSTOR). Hosted annually in Haifa, Israel.

VLDB
The Very Large Data Bases (VLDB) Conference. Hosted annually in late August.


Storage Research Centers

Carnegie Mellon University
Parallel Data Lab (PDL)

San Diego Supercomputer Center (SDSC)

University of Minnesota
Digital Technology Center (DTC)
Intelligent Storage Consortium (DISC)

Storage Performance Council (SPC)


Papers and Publications

Papers Relating to Traces

[Harter11] Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau.
A File is Not a File: Understanding the I/O Behavior of Apple Desktop Applications.
Department of Computer Sciences, University of Wisconsin, Madison. 2011.

[Ellard03b] Daniel Ellard, Margo Seltzer.
NFS Tricks and Benchmarking Traps.
Proceedings of the FREENIX Technical Conference, San Antonio, Texas. June, 2003.

[Ellard03a] Daniel Ellard, Jonathan Ledlie, Pia Malkani, Margo Seltzer.
Passive NFS Tracing of Email and Research Workloads.
Proceedings of the Second Annual USENIX File and Storage Technologies Conference, pp. 203-216, San Francisco, CA. March, 2003.

[Roselli00] Drew Roselli, Jacob R. Lorch, Thomas E. Anderson.
A Comparison of File System Workloads.
Proceedings of the 2000 USENIX Technical Conference, pp. 44 - 54. San Diego, CA. June, 2000.

[Vogels99] Werner Vogels.
File system usage in Windows NT 4.0.
Proceedings of the 17th Symposium on Operating System Principles, pp. 93 - 109. Kiawah Island Resort, SC. December, 1999.

[Douceur99] John R. Douceur, William J. Bolosky.
A Large-Scale Study of File-System Contents.
Proceedings of SIGMETRICS '99, pp. 59 - 70. Atlanta, GA. May, 1999.

[Kuenning97] Geoffrey H. Kuenning and Gerald J. Popek.
Automated Hoarding for Mobile Computers.
Proceedings of the 16th ACM Symposium on Operating Systems Principles, St. Malo, France, October 5-8, 1997.

[Uysal97] Mustafa Uysal, Anurag Acharya, Joel Saltz.
Requirements of I/O Systems for Parallel Machines: An Application-driven Study.
Technical Report, CS-TR-3802, University of Maryland, College Park. May 1997.

[Mummert96] L. Mummert, M. Satyanarayanan.
Long Term Distributed File Reference Tracing: Implementation and Experience.
Software - Practice and Experience, Vol. 26, No. 6, pp. 705 - 736. June, 1996.

[Blackwell95] Trevor Blackwell, Jeffrey Harris, Margo Seltzer.
Heuristic Cleaning Algorithms in Log-Structured File Systems.
Proceedings of the 1995 USENIX Technical Conference, pp. 277 - 288. New Orleans, LA. January, 1995.

[Griffioen94] Jim Griffioen, Randy Appleton.
Reducing File System Latency using a Predictive Approach.
Proceedings of the Summer 1994 USENIX Technical Conference, pp. 197 - 207. Boston, MA. June, 1994.

[Chiang93] Chi-ming Chiang, Matt W. Mutka.
Characteristics of User File Usage Patterns.
Systems and Software, Vol. 23, No. 3, pp. 257 - 268. December, 1993.

[Ruemmler93] Chris Ruemmler, John Wilkes.
UNIX Disk Access Patterns.
Proceedings of the Winter 1993 USENIX Technical Conference, pp. 405 - 420. San Diego, CA. January, 1993.

[Ramakrishnan92] K.K. Ramakrishnan, Prabuddha Biswas, Ramakrishna Karedla.
Analysis of File I/O Traces in Commercial Computing Environments.
Proceedings of SIGMETRICS '92, pp. 78 - 90. Newport, RI. June, 1992.

[Roselli98] Drew Roselli, Thomas E. Anderson.
Characteristics of File System Workloads.
University of California Berkeley Computer Science Division Technical Report UCB//CSD-98-1029. 1992.

[Shirriff92] Ken Shirriff, John K. Ousterhout.
A Trace-Driven Analysis of Name and Attribute Caching in a Distributed System.
Proceedings of the Winter 1992 USENIX Technical Conference, pp. 315 - 332. San Francisco, CA. January, 1992.

[Miller91] Ethan L. Miller, Randy H. Katz.
Input/Output Behavior of Supercomputing Applications.
Proceedings of the 1991 Conference on Supercomputing, pp. 567 - 576. Albuquerque, NM. November, 1991.

[Baker91] M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout.
Measurements of a Distributed File System.
Proceedings of the 13th ACM Symposium of Operating Systems Principles, pp. 198 - 212. October 1991.

[Bozman91] G.P. Bozman, H.H. Ghannad, E.D. Weinberger.
A trace-driven study of CMS file references.
IBM Journal of Research and Development, Vol. 35, No. 5/6, pp. 815 - 828. September/November, 1991.

[Bennet91] J. Michael Bennet, Michael A. Bauer, David Kinchlea.
Characteristics of Files in NFS Environments.
Proceedings of the 1991 ACM Symposium on Small Systems, pp. 33 - 40. 1991.

[Biswas90] P. Biswas, K.K. Ramakrishnan.
File Access Characterization of VAX/VMS Environments.
Proceedings of the 10th International Conference on Distributed Computing Systems, pp. 227 - 234. Paris, France. May, 1990.

[Floyd86] Rick Floyd.
Short-Term File Reference Patterns in a UNIX Environment.
University of Rochester Computer Science Technical Report #177. March, 1986.

[Ousterhout85] J. Ousterhout, H. Costa, D. Harrison, J. Kunze, M. Kupfer, J. Thompson.
A Trace-Driven Analysis of the UNIX 4.2BSD File System.
Proceedings of the 10th Symposium on Operating System Principles, pp. 15 - 24. Orcas Island, WA. December, 1985.

[Satyanarayanan81] M. Satyanarayanan.
A Study of File Sizes and Functional Lifetimes.
Proceedings of the 8th Symposium on Operating System Principles, pp. 96 - 108. Pacific Grove, CA. December, 1981.

[Smith81] A. J. Smith.
Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms.
IEEE Transactions on Software Engineering, Vol SE-7, No. 4, pp. 403 - 417. July, 1981.

Publications That Cite iotta.snia.org

The following publications cite iotta.snia.org as a source of trace data used in their research. They are organized in reverse chronological order. This list attempts to be comprehensive but is not complete; feel free to contact us to suggest additional entries.


[Xu et al., 2017]
Liang Xu, Qianbin Xia, and Weijun Xiao. Locality-driven dynamic flash cache allocation. In Proceedings of the 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress, pages 185–193, Orlando, FL, November 2017. (doi:10.1109/DASC-PICom-DataCom-CyberSciTec.2017.43)
[Yadgar and Shor, 2017]
Gala Yadgar and Roman Shor. Experience from two years of visualizing flash with SSDPlayer. ACM Transactions on Storage, 13(4):31:1–31:24, November 2017. (doi:10.1145/3149356)
[Yang et al., 2017]
M. C. Yang, Y. H. Chang, F. Wu, T. W. Kuo, and D. H. C. Du. Virtual persistent cache: Remedy the long latency behavior of host-aware shingled magnetic recording drives. In Proceedings of the IEEE/ACM International Conference on Computer-Aided Design, pages 17–24, Irvine, CA, November 2017. IEEE. (doi:10.1109/ICCAD.2017.8203755)
[Fan et al., 2017]
Jin Fan, Shoubiao Tan, and Junning Chen. A variable granularity-based mapping scheme. Journal of University of Science and Technology of China, 47(10):869–877, October 2017. (doi:10.3969/j.issn.0253-2778.2017.10.010)
[Hao et al., 2017]
Mingzhe Hao, Huaicheng Lio, Michael Hao Tong, Chrisma Pakha, Riza Suminto, Cesar Stuardo, Andrew Chien, and Haryadi Gunawi. MittOS: Supporting millisecond tail tolerance with fast rejecting SLO-aware OS interface. In Proceedings of the 26th ACM Symposium on Operating Systems Principles, pages 168–183, New York, NY, October 2017. ACM. (doi:10.1145/3132747.3132774)
[Kang et al., 2017]
Wonkyung Kang, Dongkun Shin, and Sungjoo Yoo. Reinforcement learning-assisted garbage collection to mitigate long-tail latency in SSD. ACM Transactions on Embedded Computing Systems, 16(5s), October 2017. (doi:10.1145/3126537)
[Wu et al., 2017]
Suzhen Wu, Bo Mao, Yanping Lin, and Hong Jiang. Improving performance for flash-based storage systems through GC-aware cache management. IEEE Transactions on Parallel and Distributed Systems, 28(10):2852–2865, October 2017. (doi:10.1109/TPDS.2017.2692757)
[Yan et al., 2017]
Shiqin Yan, Huaicheng Li, Mingzhe Hao, Michael Hao Tong, Swaminathan Sundararaman, Andrew A. Chien, and Haryadi S. Gunawi. Tiny-tail flash: Near-perfect elimination of garbage collection tail latencies in NAND SSDs. ACM Transactions on Storage, 13(22):22:1–22:26, October 2017. (doi:10.1145/3121133)
[Matsui and Takeuchi, 2017]
Chihiro Matsui and Ken Takeuchi. 22% higher performance, 2x SCM write endurance heterogeneous storage with dual storage class memory and NAND flash. In Proceedings of the 47rd European Solid-State Device Research Conference, Leuven, Belgium, September 2017. IEEE. (doi:10.1109/ESSDERC.2017.8066578)
[Matsui et al., 2017]
Chihiro Matsui, Chao Sun, and Ken Takeuchi. Design of hybrid SSDs with storage class memory and NAND flash memory. Proceedings of the IEEE, 105(9):1812–1821, September 2017. (doi:10.1109/JPROC.2017.2716958)
[Wu et al., 2017]
Yunxiang Wu, Fang Wang, Yu Hua, Dan Feng, Yuchong Hu, Wei Tong, Jingning Liu, and Dan He. I/O stack optimization for efficient and scalable access in FCoE-based SAN storage. IEEE Transactions on Parallel and Distributed Systems, 28(9):2514–2526, September 2017. (doi:10.1109/TPDS.2017.2685139)
[Chang et al., 2017]
C. W. Chang, G. Y. Chen, Y. J. Chen, C. W. Yeh, P. Y. Eng, A. Cheung, and C. L. Yang. Exploiting write heterogeneity of morphable MLC/SLC SSDs in datacenters with service-level objectives. IEEE Transactions on Computers, 66(8):1457–1463, August 2017. (doi:10.1109/TC.2017.2677425)
[Liu et al., 2017]
Zhuo Liu, Bin Wang, and Weikuan Yu. HALO: A fast and durable disk write cache using phase change memory. Cluster Computing, 21:1275–1287, August 2017.
[Matsui et al., 2017]
Chihiro Matsui, Yusuke Sugiyama, and Ken Takeuchi. Application dependency of hybrid storage with storage class memory and NAND flash. In 2017 Design Automation Symposium, pages 109–110, August 2017.
[Qu et al., 2017]
X. Qu, J. Wan, F. Song, X. Zhuang, F. Wu, and C. Xie. OptiMatch: Enabling an optimal match between green power and various workloads for renewable-energy powered storage systems. In Proceedings of the 46th International Conference on Parallel Processing, pages 211–220, Bristol, UK, August 2017. IEEE. (doi:10.1109/ICPP.2017.30)
[Aesa and Naik, 2017]
Nahidah Raheeem Aesa and T. Ramdas Naik. Performance-oriented data deduplication to extend the performance of storage systems in cloud environment. International Journal of Scientific Engineering and Technology Research, 6(23):4490–4495, July 2017.
[Choi et al., 2017]
Wonil Choi, Mohammad Arjomand, Myoungsoo Jung, and Mahmut Kandemir. Exploiting data longevity for enhancing the lifetime of flash-based storage class memory. In Proceedings of the 2017 ACM Conference on Measurement and Analysis of Computing Systems, Urbana-Champaign, IL, June 2017. (doi:10.1145/3084458)
[Du et al., 2017]
Yajuan Du, Qiao Li, Liang Shi, Deqing Zou, Hai Jin, and Chun Jason Xue. Reducing LDPC soft sensing latency by lightweight data refresh for flash read performance improvement. In Proceedings of the 54th ACM/EDAC/IEEE Design Automation Conference, Austin, TX, June 2017. IEEE. (doi:10.1145/3061639.3062309)
[Iqbal, 2017]
Muhammad Safdar Iqbal. The multi-tiered future of storage: Understanding cost and performance trade-offs in modern storage systems. Master's thesis, Virginia Polytechnic Institute and State University, June 2017.
[Jang et al., 2017]
Yonghun Jang, Sungho Kim, Sang-Ho Hwang, Myungsub Lee, and Chang-Hyeon Park. Tracking cold blocks for static wear leveling in FTL-based NAND flash memory. IEMEK Journal of Embedded Systems and Applications, 12:185–192, June 2017. (doi:10.14372/IEMEK.2017.12.3.185)
[Kim et al., 2017]
Sungho Kim, Sang-Ho Hwang, Myungsub Lee, Kwak Jong Wook, and Chang-Hyeon Park. Monitoring methodology based on block erase count for classifying target blocks between garbage collection and wear leveling. IEMEK Journal of Embedded Systems and Applications, 12:149–157, June 2017. (doi:10.14372/IEMEK.2017.12.3.149)
[Mounika et al., 2017]
Akula Mounika, M. Sunitha Reddy, and A. Pratapa Reddy. Leveraging data deduplication to increase the accomplishment of basic storage schemes in the cloud. International Journal of Innovative Technologies, 5:1158–1161, June 2017.
[Wu et al., 2017]
C. H. Wu, D. Y. Wu, H. M. Chou, and C. A. Cheng. Rethink the design of flash translation layers in a component-based view. IEEE Access, June 2017. (doi:10.1109/ACCESS.2017.2718559)
[Zhou et al., 2017]
You Zhou, Fei Wu, Ping Huang, Xubin He, Changsheng Xie, and Jian Zhou. Understanding and alleviating the impact of the flash address translation on solid state devices. ACM Transactions on Storage, 13(2), June 2017. (doi:10.1145/3051123)
[Waldspurger et al., 2017]
Carl Waldspurger, Irfan Ahmad, Alexander Garthwaite, and Nohhyun Park. Dynamic cache allocation adjustment using multiple cache simulations for efficient cache utility curve construction. United States Patent 9,639,480, May 2 2017.
[Anglano et al., 2017]
C. Anglano, R. Gaeta, and M. Grangetto. Securing coding-based cloud storage against pollution attacks. IEEE Transactions on Parallel and Distributed Systems, 28(5):1457–1469, May 2017. (doi:10.1109/TPDS.2016.2619686)
[Chang et al., 2017]
Li-Pin Chang, Sheng-Min Huang, and Kun-Lin Chou. Relieving self-healing SSDs of heal storms. In Proceedings of the 10th ACM International Systems and Storage Conference (SYSTOR), pages 5:1–5:7, New York, NY, May 2017. ACM. (doi:10.1145/3078468.3078476)
[Chen et al., 2017]
Min-Chun Chen, Yun-Shan Hsieh, Hsin-Hsin Chen, Yi-Hua Chen, Yun-Fei Liu, Po-Chun Huang, and Yu-Tsai Lin. R2D: Combining replication and redundancy to enhance the performance and reliability of storage systems. In Proceedings of the IEEE International Conference on Applied System Innovation, pages 1423–1426, Sapporo, Japan, May 2017. IEEE. (doi:10.1109/ICASI.2017.7988175)
[Du et al., 2017]
Yajuan Du, Deqing Zou, Qiao Li, Liang Shi, Hai Jin, and Chun Jason Xue. LaLDPC: Latency-aware LDPC for read performance improvement of solid state drives. In Proceedings of the 33rd IEEE Symposium on Mass Storage Systems and Technologies, Santa Clara, CA, May 2017.
[Fang et al., 2017]
Caihua Fang, Jingning Liu, Wei Tong, Yang Gao, Xia Lei, and Yu Jiang. Whole process optimized garbage collection for solid-state drives. Journal of Computer Applications, 37(5):1257–1262, May 2017. (doi:10.11772/j.issn.1001-9081.2017.05.1257)
[Kim et al., 2017]
Jin-Young Kim, Tae-Hee You, Hyeokjun Seo, Sungroh Yoon, Jean-Luc Gaudiot, and Eui-Young Chung. An effective pre-store/pre-load method exploiting intra-request idle time of NAND flash-based storage devices. Microprocessors and Microsystems, 50:222–236, May 2017. (doi:10.1016/j.micpro.2017.03.007)
[Mao et al., 2017]
Bo Mao, Hong Jiang, Suzhen Wu, Yaodong Yang, and Zaifa Xi. Elastic data compression with improved performance and space efficiency for flash-based storage systems. In Proceedings of the IEEE International Symposium on Parallel & Distributed Processing, pages 1109–1118, Orlando, FL, May 2017. IEEE. (doi:10.1109/IPDPS.2017.64)
[Sugiyama et al., 2017]
Yusuke Sugiyama, Tomoaki Yamada, Chihiro Matsui, and Ken Takeuchi. Reconfigurable SCM capacity identification method for SCM/NAND flash hybrid disaggregated storage. In 9th IEEE International Memory Workshop, Monterey, CA, May 2017. IEEE. (doi:10.1109/IMW.2017.7939098)
[Wang et al., 2017]
Chunling Wang, Dandan Wang, Yupeng Chai, Chuanwen Wang, and Diansen Sun. Larger, cheaper, but faster: SSD-SMR hybrid storage boosted by a new SMR-oriented cache framework. In Proceedings of the 33rd IEEE Symposium on Mass Storage Systems and Technologies, Santa Clara, CA, May 2017.
[Xu et al., 2017]
Cong Xu, Shane Snyder, Omkar Kulkarni, Vishwanath Venkatesan, Philip Carns, Suren Byna, Robert Sisneros, and Kalyana Chadalavada. DXT: Darshan eXtended tracing. In Proceedings of the 2017 Cray Users Group Meeting, Redmond, WA, May 2017.
[Zhang et al., 2017]
Wei Zhang, Tao Sun, and Xiaoyun Wan. Simplification method for testing behavior of parallel software. Journal of Computer Applications, 37(5), May 2017. (doi:10.11772/j.issn.1001-9081.2017.05.1276)
[Chamazcoti et al., 2017]
Saeideh Alinezhad Chamazcoti, Bardia Safaei, and Seyed Ghassem Miremadi. Can erasure codes damage relilability in SSD-based storage systems?. IEEE Transactions on Emerging Topics in Computing, April 2017. (doi:10.1109/TETC.2017.2693424)
[Chen et al., 2017]
Tseng-Yi Chen, Yuan-Hao Chang, Shuo-Han Chen, Nien-I Hsu, Hsin-Wen Wei, and Wei-Kuan Shih. On space utilization enhancement of file systems for embedded storage systems. ACM Transactions on Embedded Computing Systems, 16(3):83:1–83:28, April 2017. (doi:10.1145/2820488)
[Elyasi et al., 2017]
Nima Elyasi, Mohammad Arjomand, Anand Sivasubramaniam, Mahmut T. Kandemir, Chita R. Das, and Myoungsoo Jung. Exploiting intra-request slack to improve SSD performance. In Proceedings of the 22nd International Conference on Architectural Support for Programming Languages and Operating Systems, pages 375–388, Xi'an, China, April 2017. (doi:10.1145/3037697.3037728)
[Paik et al., 2017]
J. Y. Paik, T. S. Chung, and E. S. Cho. Dynamic allocation mechanism to reduce read latency in collaboration with a device queue in multichannel solid-state devices. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 36(4):600–613, April 2017. (doi:10.1109/TCAD.2016.2589901)

Displaying items 401–440 of 770 in total
Showing citations per page


Member Links