Resources

NOTE: Neither the IOTTA TWG nor SNIA vouch for the accuracy or reliability of any of the traces or other information provided below. Please contact us regarding any broken or inaccurate links.

Jump To:


Tools and Documentation

Microsoft Event Tracing (1) (2)

Stonybrook University Dataseries Documentation Wiki

Storage Research List (Computer Storage Systems Research Discussion Forum)

Traces and Snapshots Public Archive

Re-Animator tracing and replay tool


Storage Conferences

This is a non-exhaustive list of conferences relating to storage and data management. Note that some of these websites do not have stable domains, so please contact us if a link is broken.

ATC
The USENIX Annual Technical Conference (ATC). Hosted every summer.

EuroSys
EuroSys is organized by EuroSys, the European Chapter of SIGOPS, sponsored by ACM SIGOPS. Hosted annually in mid-spring. This conference does not have a stable URL, so we have linked to a Google search.

FAST
The USENIX File and Storage Technologies (FAST) conference. Hosted annually in February.

HotStorage
The USENIX Workshop on Hot Topics in Storage and File Systems. Hosted every summer directly before ATC.

ICDCS
The IEEE International Conference on Distributed Computing Systems (ICDCS). This conference does not have a stable URL so we have linked to a Google search.

ICS
The ACM International Conference on Supercomputing (ICS). Hosted every summer.

MSST
The International Conference on Massive Storage Systems and Technology (MSST). Hosted every summer at the Santa Clara University School of Engineering in Santa Clara, CA.

NAS
The IEEE International Conference on Networking, Architecture, and Storage. Hosted annually.

NVMSA
The IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA). Hosted annually in the late summer. This conference does not have a stable URL, so we have linked to a Google search.

OSDI
The USENIX Symposium on Operating Systems Design and Implementation (OSDI). Hosted annually.

SIGMETRICS
The ACM Special Interest Group for the computer systems performance evaluation community. Hosted annually in June.

SIGOPS
The ACM Special Interest Group in Operating Systems. Hosts a number of conferences annually.

SoCC
The ACM Symposium on Cloud Computing (SoCC). Hosted annually. This conference does not have a stable URL, so we have linked to a Google search.

SOSP
The ACM Symposium on Operating Systems Principles (SOSP). Hosted annually.

Supercomputing
The International Conference for High Performance Computing, Networking, Storage, and Analysis. Hosted annually in late fall.

SYSTOR
The ACM International Systems and Storage Conference (SYSTOR). Hosted annually in Haifa, Israel.

VLDB
The Very Large Data Bases (VLDB) Conference. Hosted annually in late August.


Storage Research Centers

Carnegie Mellon University
Parallel Data Lab (PDL)

San Diego Supercomputer Center (SDSC)

University of Minnesota
Digital Technology Center (DTC)
Intelligent Storage Consortium (DISC)

Storage Performance Council (SPC)


Papers and Publications

Papers Relating to Traces

[Harter11] Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau.
A File is Not a File: Understanding the I/O Behavior of Apple Desktop Applications.
Department of Computer Sciences, University of Wisconsin, Madison. 2011.

[Ellard03b] Daniel Ellard, Margo Seltzer.
NFS Tricks and Benchmarking Traps.
Proceedings of the FREENIX Technical Conference, San Antonio, Texas. June, 2003.

[Ellard03a] Daniel Ellard, Jonathan Ledlie, Pia Malkani, Margo Seltzer.
Passive NFS Tracing of Email and Research Workloads.
Proceedings of the Second Annual USENIX File and Storage Technologies Conference, pp. 203-216, San Francisco, CA. March, 2003.

[Roselli00] Drew Roselli, Jacob R. Lorch, Thomas E. Anderson.
A Comparison of File System Workloads.
Proceedings of the 2000 USENIX Technical Conference, pp. 44 - 54. San Diego, CA. June, 2000.

[Vogels99] Werner Vogels.
File system usage in Windows NT 4.0.
Proceedings of the 17th Symposium on Operating System Principles, pp. 93 - 109. Kiawah Island Resort, SC. December, 1999.

[Douceur99] John R. Douceur, William J. Bolosky.
A Large-Scale Study of File-System Contents.
Proceedings of SIGMETRICS '99, pp. 59 - 70. Atlanta, GA. May, 1999.

[Kuenning97] Geoffrey H. Kuenning and Gerald J. Popek.
Automated Hoarding for Mobile Computers.
Proceedings of the 16th ACM Symposium on Operating Systems Principles, St. Malo, France, October 5-8, 1997.

[Uysal97] Mustafa Uysal, Anurag Acharya, Joel Saltz.
Requirements of I/O Systems for Parallel Machines: An Application-driven Study.
Technical Report, CS-TR-3802, University of Maryland, College Park. May 1997.

[Mummert96] L. Mummert, M. Satyanarayanan.
Long Term Distributed File Reference Tracing: Implementation and Experience.
Software - Practice and Experience, Vol. 26, No. 6, pp. 705 - 736. June, 1996.

[Blackwell95] Trevor Blackwell, Jeffrey Harris, Margo Seltzer.
Heuristic Cleaning Algorithms in Log-Structured File Systems.
Proceedings of the 1995 USENIX Technical Conference, pp. 277 - 288. New Orleans, LA. January, 1995.

[Griffioen94] Jim Griffioen, Randy Appleton.
Reducing File System Latency using a Predictive Approach.
Proceedings of the Summer 1994 USENIX Technical Conference, pp. 197 - 207. Boston, MA. June, 1994.

[Chiang93] Chi-ming Chiang, Matt W. Mutka.
Characteristics of User File Usage Patterns.
Systems and Software, Vol. 23, No. 3, pp. 257 - 268. December, 1993.

[Ruemmler93] Chris Ruemmler, John Wilkes.
UNIX Disk Access Patterns.
Proceedings of the Winter 1993 USENIX Technical Conference, pp. 405 - 420. San Diego, CA. January, 1993.

[Ramakrishnan92] K.K. Ramakrishnan, Prabuddha Biswas, Ramakrishna Karedla.
Analysis of File I/O Traces in Commercial Computing Environments.
Proceedings of SIGMETRICS '92, pp. 78 - 90. Newport, RI. June, 1992.

[Roselli98] Drew Roselli, Thomas E. Anderson.
Characteristics of File System Workloads.
University of California Berkeley Computer Science Division Technical Report UCB//CSD-98-1029. 1992.

[Shirriff92] Ken Shirriff, John K. Ousterhout.
A Trace-Driven Analysis of Name and Attribute Caching in a Distributed System.
Proceedings of the Winter 1992 USENIX Technical Conference, pp. 315 - 332. San Francisco, CA. January, 1992.

[Miller91] Ethan L. Miller, Randy H. Katz.
Input/Output Behavior of Supercomputing Applications.
Proceedings of the 1991 Conference on Supercomputing, pp. 567 - 576. Albuquerque, NM. November, 1991.

[Baker91] M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout.
Measurements of a Distributed File System.
Proceedings of the 13th ACM Symposium of Operating Systems Principles, pp. 198 - 212. October 1991.

[Bozman91] G.P. Bozman, H.H. Ghannad, E.D. Weinberger.
A trace-driven study of CMS file references.
IBM Journal of Research and Development, Vol. 35, No. 5/6, pp. 815 - 828. September/November, 1991.

[Bennet91] J. Michael Bennet, Michael A. Bauer, David Kinchlea.
Characteristics of Files in NFS Environments.
Proceedings of the 1991 ACM Symposium on Small Systems, pp. 33 - 40. 1991.

[Biswas90] P. Biswas, K.K. Ramakrishnan.
File Access Characterization of VAX/VMS Environments.
Proceedings of the 10th International Conference on Distributed Computing Systems, pp. 227 - 234. Paris, France. May, 1990.

[Floyd86] Rick Floyd.
Short-Term File Reference Patterns in a UNIX Environment.
University of Rochester Computer Science Technical Report #177. March, 1986.

[Ousterhout85] J. Ousterhout, H. Costa, D. Harrison, J. Kunze, M. Kupfer, J. Thompson.
A Trace-Driven Analysis of the UNIX 4.2BSD File System.
Proceedings of the 10th Symposium on Operating System Principles, pp. 15 - 24. Orcas Island, WA. December, 1985.

[Satyanarayanan81] M. Satyanarayanan.
A Study of File Sizes and Functional Lifetimes.
Proceedings of the 8th Symposium on Operating System Principles, pp. 96 - 108. Pacific Grove, CA. December, 1981.

[Smith81] A. J. Smith.
Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms.
IEEE Transactions on Software Engineering, Vol SE-7, No. 4, pp. 403 - 417. July, 1981.

Publications That Cite iotta.snia.org

The following publications cite iotta.snia.org as a source of trace data used in their research. They are organized in reverse chronological order. This list attempts to be comprehensive but is not complete; feel free to contact us to suggest additional entries.


[Kwon, 2016]
Se Jin Kwon. A cache-based flash translation layer for TLC-based multimedia storage devices. ACM Transactions on Embedded Computing Systems, 15(11):11:1–11:28, February 2016. (doi:10.1145/2820614)
[Margaglia et al., 2016]
Fabio Margaglia, Gala Yadgar, Eitan Yaakobi, Yue Li, Assaf Schuster, and André Brinkmann. The devil is in the details: Implementing flash page reuse with WOM codes. In Proceedings of the 14th USENIX Conference on File and Storage Technologies, pages 95–109, Santa Clara, CA, February 2016.
[Stefanovici et al., 2016]
Ioan Stefanovici, Bianca Schroeder, Greg O'Shea, and Eno Thereska. sRoute: Treating the storage stack like a network. In Proceedings of the 14th USENIX Conference on File and Storage Technologies, pages 197–212, Santa Clara, CA, February 2016. USENIX Association.
[Yang et al., 2016]
Ming-Chang Yang, Yuan-Hao Chang, Tei-Wei Kuo, and Po-Chun Huang. Capacity-independent address mapping for flash storage devices with explosively growing capacity. IEEE Transactions on Computers, 65(2):448–465, February 2016. (doi:10.1109/TC.2015.2428702)
[Zhang et al., 2016]
Xuebin Zhang, Jiangpeng Li, Hao Wang, Kai Zhao, and Tong Zhang. Reducing solid-state storage device write stress through opportunistic in-place delta compression. In Proceedings of the 14th USENIX Conference on File and Storage Technologies, pages 111–124, Santa Clara, CA, February 2016.
[Das et al., 2016]
Gautam Das, Hao H. Huang, Sandor Szalay, and Nan Zhang. Just-in-time analytics on large file systems. United States Patent 9,244,975, January 26 2016.
[Chang et al., 2016]
Li-Pin Chang, Yu-Syun Liu, and Wen-Huei Lin. Stable greedy: Adaptive garbage collection for durable page-mapping multichannel SSDs. ACM Transactions on Embedded Computing Systems, 15(1), January 2016. (doi:10.1145/2820613)
[Ragnarsson, 2016]
Petur Orri Ragnarsson. Enabling space elasticity in storage systems. Master's thesis, Reykjavik University, January 2016.
[Sun et al., 2016]
Chao Sun, Ayumi Soga, Chihiro Matsui, Asuka Arakawa, and Ken Takeuchi. LBA scrambler: A NAND flash aware data management scheme for high-performance solid-state drives. IEEE Transactions on Very Large Scale Integration Systems, 24(1):115–128, January 2016. (doi:10.1109/TVLSI.2015.2396515)
[Tian et al., 2016]
Hong-Liang Tian, Yong Zhang, Xin-Hui Xu, Chao Li, and Chun-Xiao Xing. TrustedSSD: New foundation for big data security. Chinese Journal of Computers, 39(1), January 2016.
[Wang et al., 2016]
Wei-Lin Wang, Yuan-Hao Chang, Po-Chun Huang, Chia-Heng Tu, Hsin-Wen Wei, and Wei-Kuan Shih. Relay-based key management to support secure deletion for resource-constrained flash-memory storage devices. In Proceedings of the 21stAsia and South Pacific Design Automation Conference, pages 444–449, Macau, China, January 2016. ACM. (doi:10.1109/ASPDAC.2016.7428052)
[He and Du, 2015]
Weiping He and David H.C. Du. T-STL: Track-based shingled translation layer for autonomous SWD, 2015.
[Stefanovici et al., 2015]
Ioan Stefanovici, Eno Thereska, Greg O'Shea, Bianca Schroeder, Hitesh Ballani, Thomas Karagiannis, Antony Rowstron, and Tom Talpey. Software-defined caching. Technical Report CSRG-626, University of Toronto, 2015.
[Zhou et al., 2015]
Jian Zhou, Jun Wang, Fei Wu, Changsheng Xie, and Dexhi Han. On the cooling of energy efficient storage. In Proceedings of the 10th IEEE International Conference on Networking, Architecture, and Storage, Boston, MA, 2015. IEEE. (doi:10.1109/NAS.2015.7255212)
[Baek and Park, 2015]
Sung Hoon Baek and Ki-Woong Park. Parity resynchronization using a block-level journaling for software RAID. Information Systems, 54:28–42, December 2015. (doi:10.1016/j.is.2015.05.004)
[He et al., 2015]
Dan He, Fang Wang, Dan Feng, Jingning Liu, Yunxiang Wu, Ying He, and Yang Hu. Parallel aware hybrid solid-state storage. In Algorithms and Architectures for Parallel Processing, pages 47–60. Springer International Publishing, December 2015. (doi:10.1007/978-3-319-27140-8_4)
[Luo et al., 2015]
Shengmei Luo, Guangyan Zhang, Chengwen Wu, Samee Khan, and Keqin Li. Boafft: Distributed deduplication for big data storage in the cloud. IEEE Transactions on Cloud Computing, December 2015. (doi:10.1109/TCC.2015.2511752)
[Mandal, 2015]
Sonam Mandal. Design and implementation of an open-source deduplication platform for research. Technical Report FSL-15-03, Stony Brook University, December 2015.
[Oe et al., 2015]
Kazuichi Oe, Takeshi Nanri, and Koji Okamura. On-the-fly automated storage tiering with caching and both proactive and observational migration. In Proceedings of the 3rd IEEE International Symposium on Computing and Networking (CANDAR), Sapporo, Japan, December 2015. IEEE. (doi:10.1109/CANDAR.2015.42)
[Oh et al., 2015]
Yongseok Oh, Eunjae Lee, Choulseeung Hyun, Jongmoo Choi, Donghee Lee, and Sam H. Noh. Enabling cost-effective flash based caching with an array of commodity SSDs. In Proceedings of the 16th ACM/IFIP/Usenix International Middleware Conference, pages 63–74, Vancouver, Canada, December 2015. (doi:10.1145/2814576.2814814)
[Tsao et al., 2015]
Che-Wei Tsao, Yuan-Hao Chang, Ming-Chang Yang, and Po-Chun Huang. Efficient victim block selection for flash storage devices. IEEE Transactions on Computers, 64(12):3444–3460, December 2015. (doi:10.1109/TC.2015.2409850)
[Wang and Xie, 2015]
Wei Wang and Tao Xie. PCFTL: A plane-centric flash translation layer utilizing copy-back operations. IEEE Transactions on Parallel and Distributed Systems, 26(12):3420–3432, December 2015. (doi:10.1109/TPDS.2014.2371022)
[Wilson et al., 2015]
Wang Yonghong Wilson, Lim Chun Teck, Kyawt Kyawt Khaing, and Yong Khai Leong. Design and development of enterprise storage systems with hybrid disks for future datacenters. Journal of Communications, 10(12):1012–1019, December 2015.
[Luo and Liu, 2015]
Tian Luo and Deng Liu. Hypervisor-based flash cache space management in a multi-VM environment. United States Patent 2015/9189410, November 17 2015.
[Basak and Bharde, 2015]
Jayanta Basak and Madhumita Bharde. Dynamic provisioning of storage workloads. In Proceedings of the 29th USENIX Large Installation Systems Administration Conference, pages 13–24, Washington, D.C., November 2015.
[Chamazcoti et al., 2015]
Saeideh Alinezhad Chamazcoti, Ziba Delavari, Seyed Ghassem Miremadi, and Hossein Asadi. On endurance and performance of erasure codes in SSD-based storage systems. Microelectronics Reliability, 55:2453–2467, November 2015. (doi:10.1016/j.microrel.2015.07.046)
[Jain et al., 2015]
Nitisha Jain, Nikolay Grozev, J. Lakshmi, and Rajkumar Buyya. PriDynSim a simulator for dynamic priority based I/O scheduling for cloud applications. In Proceedings of the IEEE International Conference on Cloud Computing in Emerging Markets, pages 8–15, Bangalore, India, November 2015. IEEE. (doi:10.1109/CCEM.2015.17)
[Park et al., 2015]
Hee Jung Park, Kyung Tae Kim, Man Yun Kim, and Hee Yong Youn. Enhanced hypervisor-based SSD cache with dynamic cache scanning and allocation for virtualized cloud system. International Journal of Networked and Distributed Computing, 3(4):224–233, November 2015. (doi:10.2991/ijndc.2015.3.4.3)
[Qasem, 2015]
Mais Ahmad Haj Qasem. Data mining approach for commercial data classification and migration in hybrid storage system. Master's thesis, University of Jordan, November 2015.
[Wu et al., 2015a]
Mengnan Wu, Yang Yang, Liangliang Dai, Xinxin Zhang, Hongbin Sun, Ruizhi Zhang, Jianxiao Wang, and Nanning Zheng. An experimental study on the potential use of ReRAM as SSD buffer. In Proceedings of the 2015 IEEE 11th International Conference on ASIC, Chengdu, China, November 2015. (doi:10.1109/ASICON.2015.7517039)
[Wu et al., 2015b]
Suzhen Wu, Weijian Yang, Bo Mao, and Yanping Lin. MC-RAIS: Multi-chunk redundant array of independant SSDs with improved performance. In Proceedings of the 15th International Conference on Algorithms and Architectures for Parallel Processing, Zhangjiajie, China, November 2015. Springer International Publishing. (doi:10.1007/978-3-319-27140-8_2)
[Xie et al., 2015]
Wei Xie, Yong Chen, and Philip C. Roth. A low-cost adaptive data separation method for the flash translation layer of solid state drives. In Proceedings of the 2015 International Workshop on Data-Intensive Scalable Computing Systems, Austin, TX, November 2015. ACM. (doi:10.1145/2831244.2831250)
[Zheng, 2015]
Ning Zheng. Signal Processing System Design for Two-Dimensional Magnetic Recording Disk Drives. PhD thesis, Rensselaer Polytechnic Institute, November 2015.
[Mao and Wu, 2015]
Bo Mao and Suzhen Wu. Exploiting request characteristics and internal parallelism to improve SSD performance. In Proceedings of the 33rd IEEE International Conference on Computer Design, pages 447–450, New York, NY, October 2015. (doi:10.1109/ICCD.2015.7357145)
[Park et al., 2015]
Hee Jung Park, Kyung Tae Kim, Byungjun Lee, Rhee Man Kil, and Hee Yong Youn. Improving hypervisor based SSD caching with logically partitioned blocks and scanning in cloud environment. In Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing 2015, pages 45–59. Springer International Publishing, October 2015. (doi:10.1007/978-3-319-23509-7_4)
[Tsao et al., 2015]
Che-Wei Tsao, Chun-Yi Liu, Chien-Chung Ho, Tse-Yuan Wang, and Po-Chun Huang. Rethinking I/O request management over eMMC-based solid-state drives. In Proceedings of the International Conference on Research in Adaptive and Convergent Systems (RACS), pages 451–456, Prague, Czech Republic, October 2015. (doi:10.1145/2811411.2811536)
[Wan et al., 2015]
Jiguang Wan, Xiaoyang Qu, Nannan Zhao, Jun Wang, and Changsheng Xie. ThinRAID: Thinning down RAID array for energy conservation. IEEE Transactions on Parallel and Distributed Systems, 26(10):2903–2915, October 2015. (doi:10.1109/TPDS.2014.2360696)
[Xia and Xiao, 2015]
Qianbin Xia and Weijun Xiao. Flash-aware high-performance and endurable cache. In Proceedings of the 23rd IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Atlanta, GA, October 2015. IEEE. (doi:10.1109/MASCOTS.2015.22)
[Ayele et al., 2015]
Sololia Gudeta Ayele, Rize Jin, Se Jin Kwon, Muhammad Attique, and Tae-Sung Chung. Efficient FTL-aware data categorization and identification scheme for flash memory. Journal of Circuits, Systems and Computers, 24(8), September 2015. (doi:10.1142/S0218126615501133)
[Naskos et al., 2015]
Athanasios Naskos, Anastasios Gounaris, and Spyros Sioutas. Cloud elasticity: A survey. In 2015 International Workshop on Algorithmic Aspects of Cloud Computing, pages 151–167, Patras, Greece, September 2015. (doi:10.1007/978-3-319-29919-8_12)

Displaying items 521–560 of 770 in total
Showing citations per page


Member Links