Resources

NOTE: Neither the IOTTA TWG nor SNIA vouch for the accuracy or reliability of any of the traces or other information provided below. Please contact us regarding any broken or inaccurate links.

Jump To:


Tools and Documentation

Microsoft Event Tracing (1) (2)

Stonybrook University Dataseries Documentation Wiki

Storage Research List (Computer Storage Systems Research Discussion Forum)

Traces and Snapshots Public Archive

Re-Animator tracing and replay tool


Storage Conferences

This is a non-exhaustive list of conferences relating to storage and data management. Note that some of these websites do not have stable domains, so please contact us if a link is broken.

ATC
The USENIX Annual Technical Conference (ATC). Hosted every summer.

EuroSys
EuroSys is organized by EuroSys, the European Chapter of SIGOPS, sponsored by ACM SIGOPS. Hosted annually in mid-spring. This conference does not have a stable URL, so we have linked to a Google search.

FAST
The USENIX File and Storage Technologies (FAST) conference. Hosted annually in February.

HotStorage
The USENIX Workshop on Hot Topics in Storage and File Systems. Hosted every summer directly before ATC.

ICDCS
The IEEE International Conference on Distributed Computing Systems (ICDCS). This conference does not have a stable URL so we have linked to a Google search.

ICS
The ACM International Conference on Supercomputing (ICS). Hosted every summer.

MSST
The International Conference on Massive Storage Systems and Technology (MSST). Hosted every summer at the Santa Clara University School of Engineering in Santa Clara, CA.

NAS
The IEEE International Conference on Networking, Architecture, and Storage. Hosted annually.

NVMSA
The IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA). Hosted annually in the late summer. This conference does not have a stable URL, so we have linked to a Google search.

OSDI
The USENIX Symposium on Operating Systems Design and Implementation (OSDI). Hosted annually.

SIGMETRICS
The ACM Special Interest Group for the computer systems performance evaluation community. Hosted annually in June.

SIGOPS
The ACM Special Interest Group in Operating Systems. Hosts a number of conferences annually.

SoCC
The ACM Symposium on Cloud Computing (SoCC). Hosted annually. This conference does not have a stable URL, so we have linked to a Google search.

SOSP
The ACM Symposium on Operating Systems Principles (SOSP). Hosted annually.

Supercomputing
The International Conference for High Performance Computing, Networking, Storage, and Analysis. Hosted annually in late fall.

SYSTOR
The ACM International Systems and Storage Conference (SYSTOR). Hosted annually in Haifa, Israel.

VLDB
The Very Large Data Bases (VLDB) Conference. Hosted annually in late August.


Storage Research Centers

Carnegie Mellon University
Parallel Data Lab (PDL)

San Diego Supercomputer Center (SDSC)

University of Minnesota
Digital Technology Center (DTC)
Intelligent Storage Consortium (DISC)

Storage Performance Council (SPC)


Papers and Publications

Papers Relating to Traces

[Harter11] Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau.
A File is Not a File: Understanding the I/O Behavior of Apple Desktop Applications.
Department of Computer Sciences, University of Wisconsin, Madison. 2011.

[Ellard03b] Daniel Ellard, Margo Seltzer.
NFS Tricks and Benchmarking Traps.
Proceedings of the FREENIX Technical Conference, San Antonio, Texas. June, 2003.

[Ellard03a] Daniel Ellard, Jonathan Ledlie, Pia Malkani, Margo Seltzer.
Passive NFS Tracing of Email and Research Workloads.
Proceedings of the Second Annual USENIX File and Storage Technologies Conference, pp. 203-216, San Francisco, CA. March, 2003.

[Roselli00] Drew Roselli, Jacob R. Lorch, Thomas E. Anderson.
A Comparison of File System Workloads.
Proceedings of the 2000 USENIX Technical Conference, pp. 44 - 54. San Diego, CA. June, 2000.

[Vogels99] Werner Vogels.
File system usage in Windows NT 4.0.
Proceedings of the 17th Symposium on Operating System Principles, pp. 93 - 109. Kiawah Island Resort, SC. December, 1999.

[Douceur99] John R. Douceur, William J. Bolosky.
A Large-Scale Study of File-System Contents.
Proceedings of SIGMETRICS '99, pp. 59 - 70. Atlanta, GA. May, 1999.

[Kuenning97] Geoffrey H. Kuenning and Gerald J. Popek.
Automated Hoarding for Mobile Computers.
Proceedings of the 16th ACM Symposium on Operating Systems Principles, St. Malo, France, October 5-8, 1997.

[Uysal97] Mustafa Uysal, Anurag Acharya, Joel Saltz.
Requirements of I/O Systems for Parallel Machines: An Application-driven Study.
Technical Report, CS-TR-3802, University of Maryland, College Park. May 1997.

[Mummert96] L. Mummert, M. Satyanarayanan.
Long Term Distributed File Reference Tracing: Implementation and Experience.
Software - Practice and Experience, Vol. 26, No. 6, pp. 705 - 736. June, 1996.

[Blackwell95] Trevor Blackwell, Jeffrey Harris, Margo Seltzer.
Heuristic Cleaning Algorithms in Log-Structured File Systems.
Proceedings of the 1995 USENIX Technical Conference, pp. 277 - 288. New Orleans, LA. January, 1995.

[Griffioen94] Jim Griffioen, Randy Appleton.
Reducing File System Latency using a Predictive Approach.
Proceedings of the Summer 1994 USENIX Technical Conference, pp. 197 - 207. Boston, MA. June, 1994.

[Chiang93] Chi-ming Chiang, Matt W. Mutka.
Characteristics of User File Usage Patterns.
Systems and Software, Vol. 23, No. 3, pp. 257 - 268. December, 1993.

[Ruemmler93] Chris Ruemmler, John Wilkes.
UNIX Disk Access Patterns.
Proceedings of the Winter 1993 USENIX Technical Conference, pp. 405 - 420. San Diego, CA. January, 1993.

[Ramakrishnan92] K.K. Ramakrishnan, Prabuddha Biswas, Ramakrishna Karedla.
Analysis of File I/O Traces in Commercial Computing Environments.
Proceedings of SIGMETRICS '92, pp. 78 - 90. Newport, RI. June, 1992.

[Roselli98] Drew Roselli, Thomas E. Anderson.
Characteristics of File System Workloads.
University of California Berkeley Computer Science Division Technical Report UCB//CSD-98-1029. 1992.

[Shirriff92] Ken Shirriff, John K. Ousterhout.
A Trace-Driven Analysis of Name and Attribute Caching in a Distributed System.
Proceedings of the Winter 1992 USENIX Technical Conference, pp. 315 - 332. San Francisco, CA. January, 1992.

[Miller91] Ethan L. Miller, Randy H. Katz.
Input/Output Behavior of Supercomputing Applications.
Proceedings of the 1991 Conference on Supercomputing, pp. 567 - 576. Albuquerque, NM. November, 1991.

[Baker91] M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout.
Measurements of a Distributed File System.
Proceedings of the 13th ACM Symposium of Operating Systems Principles, pp. 198 - 212. October 1991.

[Bozman91] G.P. Bozman, H.H. Ghannad, E.D. Weinberger.
A trace-driven study of CMS file references.
IBM Journal of Research and Development, Vol. 35, No. 5/6, pp. 815 - 828. September/November, 1991.

[Bennet91] J. Michael Bennet, Michael A. Bauer, David Kinchlea.
Characteristics of Files in NFS Environments.
Proceedings of the 1991 ACM Symposium on Small Systems, pp. 33 - 40. 1991.

[Biswas90] P. Biswas, K.K. Ramakrishnan.
File Access Characterization of VAX/VMS Environments.
Proceedings of the 10th International Conference on Distributed Computing Systems, pp. 227 - 234. Paris, France. May, 1990.

[Floyd86] Rick Floyd.
Short-Term File Reference Patterns in a UNIX Environment.
University of Rochester Computer Science Technical Report #177. March, 1986.

[Ousterhout85] J. Ousterhout, H. Costa, D. Harrison, J. Kunze, M. Kupfer, J. Thompson.
A Trace-Driven Analysis of the UNIX 4.2BSD File System.
Proceedings of the 10th Symposium on Operating System Principles, pp. 15 - 24. Orcas Island, WA. December, 1985.

[Satyanarayanan81] M. Satyanarayanan.
A Study of File Sizes and Functional Lifetimes.
Proceedings of the 8th Symposium on Operating System Principles, pp. 96 - 108. Pacific Grove, CA. December, 1981.

[Smith81] A. J. Smith.
Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms.
IEEE Transactions on Software Engineering, Vol SE-7, No. 4, pp. 403 - 417. July, 1981.

Publications That Cite iotta.snia.org

The following publications cite iotta.snia.org as a source of trace data used in their research. They are organized in reverse chronological order. This list attempts to be comprehensive but is not complete; feel free to contact us to suggest additional entries.


[Yamada et al., 2017a]
Tomoaki Yamada, Chihiro Matsui, and Ken Takeuchi. Workload-based co-design of non-volatile cache algorithm and storage class memory specifications for storage class memory/NAND flash hybrid SSDs. IEICE Transactions on Electronics, E100.C(4):373–381, April 2017. (doi:10.1587/transele.E100.C.373)
[Yamada et al., 2017b]
Tomoaki Yamada, Atsuya Suzuki, Yusuke Sugiyama, Chihiro Matsui, and Ken Takeuchi. Comprehensive analysis on SCM specifications for high-performance SCM/NAND flash hybrid SSD with through-silicon via. In 2017 International Conference on Electronics Packaging, Yamagata, Japan, April 2017. IEEE. (doi:10.23919/ICEP.2017.7939373)
[Yamaga et al., 2017]
Yusuke Yamaga, Chihiro Matsui, Yukiya Sakaki, Atsuro Kobayashi, and Ken Takeuchi. Real usage-based precise reliability test by extracting read/write/retention-mixed real-life access of NAND. In Proceedings of the 2017 International Reliability Physics Symposium, Monterey, CA, April 2017. IEEE. (doi:10.1109/IRPS.2017.7936394)
[Guan et al., 2017]
Yong Guan, Guohui Wang, Chenlin Ma, Renhai Chen, Yi Wang, and Zili Shao. A block-level log-block management scheme for MLC NAND flash memory storage systems. IEEE Transactions on Computers, 66(9):1464–14777, March 2017. (doi:10.1109/TC.2017.2679180)
[Jung, 2017]
Myoungsoo Jung. Exploring parallel data access methods in emerging non-volatile memory systems. IEEE Transactions on Parallel and Distributed Systems, 28(3):746–759, March 2017. (doi:10.1109/TPDS.2016.2588491)
[Liu et al., 2017]
Jiaxi Liu, Renxuan Wang, Xiaofeng Gao, Xiaochun Yang, and Guihai Chen. AngleCut: A ring-based hashing scheme for distributed metadata management. In 2017 International Conference on Database Systems for Advanced Applications, pages 71–86, Suzhou, China, March 2017. Springer International Publishing. (doi:10.1007/978-3-319-55753-3_5)
[Wang et al., 2017]
Shunzhuo Wang, Fei Wu anad Zhonghai Lu, You Zhou, Qin Xiong, Meng Zhang, and Changsheng Xie. Lifetime adaptive ECC in NAND flash page management. In 2017 Design, Automation and Test in Europe Conference (DATE), pages 1253–1556, Lausanne, Switzerland, March 2017. (doi:10.23919/DATE.2017.7927182)
[He and Du, 2017]
Weiping He and David H.C. Du. SMaRT: An approach to shingled magnetic recording translation. In Proceedings of the 15th USENIX Conference on File and Storage Technologies, pages 121–134, Santa Clara, CA, February 2017.
[Kim et al., 2017]
Hyukjoong Kim, Dongkun Shin, Yun Ho Jeong, and Kyung Ho Kim. SHRD: Improving spatial locality in flash storage accesses by sequentializing in host and randomizing in device. In Proceedings of the 15th USENIX Conference on File and Storage Technologies, pages 271–284, Santa Clara, CA, February 2017. USENIX Association.
[Matsui et al., 2017]
Chihiro Matsui, Asuka Arakawa, Chao Sun, and Ken Takeuchi. Write order-based garbage collection scheme for an LBA scrambler integrated SSD. IEEE Transactions on Very Large Scale Integration Systems, 25(2):510–519, February 2017. (doi:10.1109/TVLSI.2016.2594200)
[Xie et al., 2017]
Wei Xie, Yong Chen, and Philip C. Roth. ASA-FTL: An adaptive separation aware flash translation layer for solid state drives. Parallel Computing, 61:3–17, January 2017. (doi:10.1016/j.parco.2016.10.006)
[Kang et al., 2016]
Mincheol Kang, Wonyoung Lee, and Soontae Kim. Subpage-based flash translation layer for solid state drivers. Master's thesis, Korea Advanced Institute of Science and Technology, 2016.
[Liang et al., 2016]
Jie Liang, Yinlong Xu, Dongdong Sun, and Si Wu. Improving read performance of SSDs via balanced redirected read. In 2016 IEEE International Conference on Networking, Architecture, and Storage, Long Beach, CA, 2016. IEEE. (doi:10.1109/NAS.2016.7549406)
[Liao and Chen, 2016]
Jianwei Liao and Shanxiong Chen. Optimization of reading data via classified block access patterns in file systems. IEEE Access, 4:9421–9427, 2016. (doi:10.1109/ACCESS.2016.2642918)
[Singh et al., 2016]
Bhupendra Singh, Ravi Sharan, Gaurav Somani, and Gaurav Gupta. Secure file deletion for solid state drives. In Proceedings of the 12th IFIP International Conference on Digital Forensics, Cham, Switzerland, 2016. IFIP. (doi:10.1007/978-3-319-46279-0_18)
[Yen, 2016]
Amy Yen. Intelligent storage system with machine learning. Technical report, Stanford University, 2016.
[Chang et al., 2016]
Hsung-Pin Chang, Jhih-Cheng Luo, and Da-Wei Chang. A load-balancing data caching scheme in multi-tiered storage systems. In Proceedings of the 18th IEEE International Conference on High Performance Computing and Communications, pages 124–127, Sydney, NSW, Australia, December 2016. (doi:10.1109/HPCC-SmartCity-DSS.2016.0028)
[Rush et al., 2016]
Everett Neil Rush, Bryan Harris, Nihat Altiparmak, and Ali Şaman Tosun. Dynamic data layout optimization for high performance parallel I/O. In Proceedings of the 23rd International Conference on High Performance Computing (HiPC), pages 132–141, Hyderabad, India, December 2016. (doi:10.1109/HiPC.2016.024)
[Xia and Xiao, 2016a]
Qianbin Xia and Weijun Xiao. High-performance and endurable cache management for flash-based read caching. IEEE Transactions on Parallel and Distributed Systems, 27(12):3518–3531, December 2016. (doi:10.1109/TPDS.2016.2537822)
[Xia and Xiao, 2016b]
Qianbin Xia and Weijun Xiao. Improving MLC flash performance with workload-aware differentiated ECC. In Proceedings of the 22nd IEEE International Conference on Parallel and Distributed Systems, Wuhan, China, December 2016. IEEE. (doi:10.1109/ICPADS.2016.0078)
[Yang et al., 2016]
Z. Yang, M. Awasthi, M. Ghosh, and N. Mi. A fresh perspective on total cost of ownership models for flash storage in datacenters. In Proceedings of the IEEE International Conference on Cloud Computing Technology and Science, pages 245–252, Luxembourg City, Luxembourg, December 2016. IEEE. (doi:10.1109/CloudCom.2016.0049)
[Banerjee and Mukhopadhyay, 2016]
Samiran Banerjee and Sumitra Mukhopadhyay. A low cost and fast controller architecture for multimedia data storage and retrieval to flash-based storage device. EURASIP Journal on Embedded Systems, page 24, November 2016.
[Chamazcoti et al., 2016]
Saeideh Alinezhad Chamazcoti, Bardia Safaei, and Seyed Ghassem Miremadi. SOYA: SSD based RAID systems reliability simulator. In Proceedings of the International Conference on System Reliability and Science, pages 167–173, Paris, France, November 2016. IEEE. (doi:10.1109/ICSRS.2016.7815858)
[Li et al., 2016]
Zheng Li, Fang Wang, Jingning Liu, Dan Feng, Yu Hua, Wei Tong, and Shuangwu Zhang. A user-visible solid-state storage system with software-defined fusion methods for PCM and NAND flash. Journal of Systems Architecture, 71:44–61, November 2016. (doi:10.1016/j.sysarc.2016.08.00)
[Ogawa and Kise, 2016]
Eri Ogawa and Kenji Kise. An effective page padding method for RAM buffer algorithms to enhance the SSD endurance. In Proceedings of the 4th IEEE International Symposium on Computing and Networking (CANDAR), pages 133–139, Hiroshima, Japan, November 2016. (doi:10.1109/CANDAR.2016.0034)
[Shahidi et al., 2016]
Narges Shahidi, Mahmut T. Kandemir, Mohammad Arjomand, Chita R. Das, Myoungsoo Jung, and Anand Sivasubramaniam. Exploring the potentials of parallel garbage collection in SSDs for enterprise storage systems. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, pages 561–572, Salt Lake City, UT, November 2016. (doi:10.1109/SC.2016.47)
[Chang et al., 2016a]
H. S. Chang, Y. H. Chang, T. W. Kuo, Y. M. Chang, and H. P. Li. A disturbance-aware sub-block design to improve reliability of 3D MLC flash memory. In Proceedings of the International Conference on Hardware/Software Codesign and System Synthesis, pages 1–10, Pittsburgh, PA, October 2016. IEEE.
[Chang et al., 2016b]
Yu-Ming Chang, Yung-Chun Li, Ping-Hsien Lin, Hsiang-Pang Li, and Yuan-Hao Chang. Realizing erase-free SLC flash memory with rewritable programming design. In Proceedings of the 11th International Conference on Hardware/Software Codesign and System Synthesis, pages 7:1–7:10, New York, NY, October 2016. ACM. (doi:10.1145/2968456.2968462)
[Ji et al., 2016]
Cheng Ji, C. Wu, L. P. Chang, L. Shi, and C. J. Xue. I/O scheduling with mapping cache awareness for flash based storage systems. In Proceedings of the International Conference on Embedded Software, pages 1–10, Pittsburgh, PA, October 2016. IEEE. (doi:10.1145/2968478.2968503)
[Lee and Song, 2016]
Daeyong Lee and Yong Ho Song. Performance relationship analysis in map block number of NAND flash storage device using map cache techniques. In Proceedings of the Korea Information Processing Society Conference, pages 22–25, October 2016.
[Li and Hwang, 2016]
Hai-Long Li and Sun-Young Hwang. An efficient page-level mapping algorithm for handling write requests in the flash translation layer by exploiting temporal locality. The Journal of Korean Institute of Communications and Information Sciences, 41(10):1167–1175, October 2016.
[Liu et al., 2016]
Jinzhao Liu, Yuezhi Zhou, and Di Zhang. TranSim: A simulation framework for cache-enabled transparent computing systems. IEEE Transactions on Computers, 65(10):3171–3183, October 2016. (doi:10.1109/TC.2016.2519901)
[Ritzdorf et al., 2016]
Hubert Ritzdorf, Ghassan Karame, Claudio Soriente, and Srdjan Capkun. On information leakage in deduplicated storage systems. In Proceedings of the ACM Cloud Computing Security Workshop, pages 61–72, New York, NY, October 2016. ACM. (doi:10.1145/2996429.2996432)
[San-Lucas and Abad, 2016]
César San-Lucas and Cristina L. Abad. Towards a fast multi-tier storage system simulator. In 2016 IEEE Ecuador Technical Chapters Meeting, Guayaquil, Ecuador, October 2016. (doi:10.1109/ETCM.2016.7750836)
[Wu et al., 2016]
Guojin Wu, Yuhui Deng, and Xiao Qin. Using provenance to boost the metadata prefetching in distributed storage systems. In Proceedings of the 34th IEEE International Conference on Computer Design, pages 80–87, Scottsdale, AZ, October 2016. (doi:10.1109/ICCD.2016.7753264)
[Xiao et al., 2016]
Wenjian Xiao, Huanqing Dong, Liuying Ma, Zhenjun Liu, and Qiang Zhang. HS-BAS: A hybrid storage system based on band awareness of shingled write disk. In Proceedings of the 34th IEEE International Conference on Computer Design, pages 64–71, Scottsdale, AZ, October 2016. (doi:10.1109/ICCD.2016.7753262)
[Yang et al., 2016]
Ming-Chang Yang, Yuan-Hao Chang, Chei-Wei Tsao, and Chung-Yu Liu. Utilization-aware self-tuning design for TLC flash storage devices. IEEE Transactions on Very Large Scale Integration Systems, 24(10):3132–3144, October 2016. (doi:10.1109/TVLSI.2016.2538182)
[Zhou et al., 2016a]
Jian Zhou, Jun Wang, Fei Wu, and Changsheng Xie. TEES: A novel multiple criteria optimization scheme for temperature-constrained energy efficient storage. Journal of Parallel and Distributed Computing, 96:152–162, October 2016. (doi:10.1016/j.jpdc.2016.05.010)
[Zhou et al., 2016b]
Wen Zhou, Dan Feng, Yu Hua, Jingning Liu, Fangting Huang, Yu Chen, and Shuangwu Zhuang. Prober: Exploiting sequential characteristics in buffer for improving SSDs write performance. Frontiers of Computer Science, 10(5):951–964, October 2016. (doi:10.1007/s11704-016-5286-z)
[Chang et al., 2016]
Da-Wei Chang, Wei-Cheng Lin, and Hsin-Hung Chen. FastRead: Improving read performance for multilevel-cell flash memory. IEEE Transactions on Very Large Scale Integration Systems, 24(9):2998–3002, September 2016. (doi:10.1109/TVLSI.2016.2542215)

Displaying items 441–480 of 770 in total
Showing citations per page


Member Links