Resources

NOTE: Neither the IOTTA TWG nor SNIA vouch for the accuracy or reliability of any of the traces or other information provided below. Please contact us regarding any broken or inaccurate links.

Jump To:


Tools and Documentation

Microsoft Event Tracing (1) (2)

Stonybrook University Dataseries Documentation Wiki

Storage Research List (Computer Storage Systems Research Discussion Forum)

Traces and Snapshots Public Archive

Re-Animator tracing and replay tool


Storage Conferences

This is a non-exhaustive list of conferences relating to storage and data management. Note that some of these websites do not have stable domains, so please contact us if a link is broken.

ATC
The USENIX Annual Technical Conference (ATC). Hosted every summer.

EuroSys
EuroSys is organized by EuroSys, the European Chapter of SIGOPS, sponsored by ACM SIGOPS. Hosted annually in mid-spring. This conference does not have a stable URL, so we have linked to a Google search.

FAST
The USENIX File and Storage Technologies (FAST) conference. Hosted annually in February.

HotStorage
The USENIX Workshop on Hot Topics in Storage and File Systems. Hosted every summer directly before ATC.

ICDCS
The IEEE International Conference on Distributed Computing Systems (ICDCS). This conference does not have a stable URL so we have linked to a Google search.

ICS
The ACM International Conference on Supercomputing (ICS). Hosted every summer.

MSST
The International Conference on Massive Storage Systems and Technology (MSST). Hosted every summer at the Santa Clara University School of Engineering in Santa Clara, CA.

NAS
The IEEE International Conference on Networking, Architecture, and Storage. Hosted annually.

NVMSA
The IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA). Hosted annually in the late summer. This conference does not have a stable URL, so we have linked to a Google search.

OSDI
The USENIX Symposium on Operating Systems Design and Implementation (OSDI). Hosted annually.

SIGMETRICS
The ACM Special Interest Group for the computer systems performance evaluation community. Hosted annually in June.

SIGOPS
The ACM Special Interest Group in Operating Systems. Hosts a number of conferences annually.

SoCC
The ACM Symposium on Cloud Computing (SoCC). Hosted annually. This conference does not have a stable URL, so we have linked to a Google search.

SOSP
The ACM Symposium on Operating Systems Principles (SOSP). Hosted annually.

Supercomputing
The International Conference for High Performance Computing, Networking, Storage, and Analysis. Hosted annually in late fall.

SYSTOR
The ACM International Systems and Storage Conference (SYSTOR). Hosted annually in Haifa, Israel.

VLDB
The Very Large Data Bases (VLDB) Conference. Hosted annually in late August.


Storage Research Centers

Carnegie Mellon University
Parallel Data Lab (PDL)

San Diego Supercomputer Center (SDSC)

University of Minnesota
Digital Technology Center (DTC)
Intelligent Storage Consortium (DISC)

Storage Performance Council (SPC)


Papers and Publications

Papers Relating to Traces

[Harter11] Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau.
A File is Not a File: Understanding the I/O Behavior of Apple Desktop Applications.
Department of Computer Sciences, University of Wisconsin, Madison. 2011.

[Ellard03b] Daniel Ellard, Margo Seltzer.
NFS Tricks and Benchmarking Traps.
Proceedings of the FREENIX Technical Conference, San Antonio, Texas. June, 2003.

[Ellard03a] Daniel Ellard, Jonathan Ledlie, Pia Malkani, Margo Seltzer.
Passive NFS Tracing of Email and Research Workloads.
Proceedings of the Second Annual USENIX File and Storage Technologies Conference, pp. 203-216, San Francisco, CA. March, 2003.

[Roselli00] Drew Roselli, Jacob R. Lorch, Thomas E. Anderson.
A Comparison of File System Workloads.
Proceedings of the 2000 USENIX Technical Conference, pp. 44 - 54. San Diego, CA. June, 2000.

[Vogels99] Werner Vogels.
File system usage in Windows NT 4.0.
Proceedings of the 17th Symposium on Operating System Principles, pp. 93 - 109. Kiawah Island Resort, SC. December, 1999.

[Douceur99] John R. Douceur, William J. Bolosky.
A Large-Scale Study of File-System Contents.
Proceedings of SIGMETRICS '99, pp. 59 - 70. Atlanta, GA. May, 1999.

[Kuenning97] Geoffrey H. Kuenning and Gerald J. Popek.
Automated Hoarding for Mobile Computers.
Proceedings of the 16th ACM Symposium on Operating Systems Principles, St. Malo, France, October 5-8, 1997.

[Uysal97] Mustafa Uysal, Anurag Acharya, Joel Saltz.
Requirements of I/O Systems for Parallel Machines: An Application-driven Study.
Technical Report, CS-TR-3802, University of Maryland, College Park. May 1997.

[Mummert96] L. Mummert, M. Satyanarayanan.
Long Term Distributed File Reference Tracing: Implementation and Experience.
Software - Practice and Experience, Vol. 26, No. 6, pp. 705 - 736. June, 1996.

[Blackwell95] Trevor Blackwell, Jeffrey Harris, Margo Seltzer.
Heuristic Cleaning Algorithms in Log-Structured File Systems.
Proceedings of the 1995 USENIX Technical Conference, pp. 277 - 288. New Orleans, LA. January, 1995.

[Griffioen94] Jim Griffioen, Randy Appleton.
Reducing File System Latency using a Predictive Approach.
Proceedings of the Summer 1994 USENIX Technical Conference, pp. 197 - 207. Boston, MA. June, 1994.

[Chiang93] Chi-ming Chiang, Matt W. Mutka.
Characteristics of User File Usage Patterns.
Systems and Software, Vol. 23, No. 3, pp. 257 - 268. December, 1993.

[Ruemmler93] Chris Ruemmler, John Wilkes.
UNIX Disk Access Patterns.
Proceedings of the Winter 1993 USENIX Technical Conference, pp. 405 - 420. San Diego, CA. January, 1993.

[Ramakrishnan92] K.K. Ramakrishnan, Prabuddha Biswas, Ramakrishna Karedla.
Analysis of File I/O Traces in Commercial Computing Environments.
Proceedings of SIGMETRICS '92, pp. 78 - 90. Newport, RI. June, 1992.

[Roselli98] Drew Roselli, Thomas E. Anderson.
Characteristics of File System Workloads.
University of California Berkeley Computer Science Division Technical Report UCB//CSD-98-1029. 1992.

[Shirriff92] Ken Shirriff, John K. Ousterhout.
A Trace-Driven Analysis of Name and Attribute Caching in a Distributed System.
Proceedings of the Winter 1992 USENIX Technical Conference, pp. 315 - 332. San Francisco, CA. January, 1992.

[Miller91] Ethan L. Miller, Randy H. Katz.
Input/Output Behavior of Supercomputing Applications.
Proceedings of the 1991 Conference on Supercomputing, pp. 567 - 576. Albuquerque, NM. November, 1991.

[Baker91] M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout.
Measurements of a Distributed File System.
Proceedings of the 13th ACM Symposium of Operating Systems Principles, pp. 198 - 212. October 1991.

[Bozman91] G.P. Bozman, H.H. Ghannad, E.D. Weinberger.
A trace-driven study of CMS file references.
IBM Journal of Research and Development, Vol. 35, No. 5/6, pp. 815 - 828. September/November, 1991.

[Bennet91] J. Michael Bennet, Michael A. Bauer, David Kinchlea.
Characteristics of Files in NFS Environments.
Proceedings of the 1991 ACM Symposium on Small Systems, pp. 33 - 40. 1991.

[Biswas90] P. Biswas, K.K. Ramakrishnan.
File Access Characterization of VAX/VMS Environments.
Proceedings of the 10th International Conference on Distributed Computing Systems, pp. 227 - 234. Paris, France. May, 1990.

[Floyd86] Rick Floyd.
Short-Term File Reference Patterns in a UNIX Environment.
University of Rochester Computer Science Technical Report #177. March, 1986.

[Ousterhout85] J. Ousterhout, H. Costa, D. Harrison, J. Kunze, M. Kupfer, J. Thompson.
A Trace-Driven Analysis of the UNIX 4.2BSD File System.
Proceedings of the 10th Symposium on Operating System Principles, pp. 15 - 24. Orcas Island, WA. December, 1985.

[Satyanarayanan81] M. Satyanarayanan.
A Study of File Sizes and Functional Lifetimes.
Proceedings of the 8th Symposium on Operating System Principles, pp. 96 - 108. Pacific Grove, CA. December, 1981.

[Smith81] A. J. Smith.
Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms.
IEEE Transactions on Software Engineering, Vol SE-7, No. 4, pp. 403 - 417. July, 1981.

Publications That Cite iotta.snia.org

The following publications cite iotta.snia.org as a source of trace data used in their research. They are organized in reverse chronological order. This list attempts to be comprehensive but is not complete; feel free to contact us to suggest additional entries.


[Agrawal et al., 2012]
Nitin Agrawal, Leo Arulraj, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. Emulating Goliath storage systems with David. ACM Transactions on Storage, 7(4), January 2012. (doi:10.1145/2078861.2078862)
[Wang et al., 2011]
Di Wang, Anand Sivasubramaniam, and Bhuvan Urgaonkar. A case for heterogeneous flash. Technical Report CSE-11-015, Pennsylvania State University, Department of Computer Science, 2011.
[Narayanan et al., 2011]
Dushyanth Narayanan, Austin Donnelly, Antony Rowstron, Sameh Elnikety, and Eno Thereska. Storage systems using write off-loading. United States Patent 8,074,014, December 6 2011.
[Wang et al., 2011]
Jia-Hao Wang, Hsin-Hung Chen, Wei-Jian Su, and Da-Wei Chang. Cross-layer optimizations in solid-state drives. IEEE Embedded Systems Letters, 3(4):109–112, December 2011. (doi:10.1109/LES.2011.2168941)
[Hodges et al., 2011]
Stephen E. Hodges, Yuvraj Agarwal, James W. Scott, Ranveer Chandra, and Paramvir Bahl. Low power operation of networked devices. United States Patent 8,068,433, November 29 2011.
[Lee et al., 2011]
DongJin Lee Lee, Michael O'Sullivan, Cameron Walker, and Monique Mackenzie. Robust benchmarking for archival storage tiers. In Proceedings of the 6th Workshop on Parallel Data Storage, Seattle, WA, November 2011. ACM. (doi:10.1145/2159352.2159354)
[Qin and Yi, 2011]
Xia Qin and Tian Yi. Distributed detecting and real-time advertising system of equipment failure based on MANET. In Advances in Computer Science and Education, Wuhan, China, November 2011. Springer International Publishing. (doi:10.1007/978-3-642-27945-4)
[Chen et al., 2011]
Zhiguang Chen, Fang Liu, and Yimo Du. Reorder the write sequence by virtual write buffer to extend SSD's lifespan. In Proceedings of the 8th IFIP International Conference on Network and Parallel Computing, pages 263–276, Changsha, China, October 2011. Springer-Verlag.
[Chen et al., 2011]
Zhiguang Chen, Nong Xiao, Fang Liu, and Yimo Du. PBFTL: The page to block mapping FTL with low response time. In Proceedings of the 19th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Singapore, August 2011. (doi:10.1109/MASCOTS.2011.31)
[Tjioe, 2011]
Jonathan Oscar Tjioe. Making a flash translation layer reliability-aware (RA): An optimized strategy for wear-leveling and garbage collection. Master's thesis, San Diego State University, August 2011.
[Wang, 2011]
Chengjun Wang. Enhancing Flash Lifetime in Secondary Storage. PhD thesis, Auburn University, Auburn, AL, August 2011.
[Akoush et al., 2011]
Sherif Akoush, Ripduman Sohan, Bogdan Roman, Andrew Rice, and Andy Hopper. Activity based sector synchronisation: Efficient transfer of disk-state for WAN live migration. In Proceedings of the 19th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pages 22–31, Singapore, July 2011. IEEE.
[Wang and Varman, 2011]
Hui Wang and Peter Varman. Nested QoS: Providing flexible performance in shared IO environment. In Proceedings of the 3rd USENIX Workshop on I/O Virtualization, Portland, OR, June 2011.
[Yang and Ryu, 2011]
Soo-Hyeon Yang and Yeonseung Ryu. An efficient mapping table management in NAND flash-based mobile computers. In International Conference on Computational Science and Its Applications (ICCSA), volume 6784 of Lecture Notes in Computer Science, Santander, Spain, June 2011. Springer-Verlag.
[Hu et al., 2011]
Yang Hu, Hong Jiang, Dan Feng, Lei Tian, Hao Luo, and Shuping Zhang. Performance impact and interplay of SSD parallelism through advanced commands, allocation strategy and data granularity. In Proceedings of the ACM International Conference on Supercomputing, pages 96–107, Tucson, Arizona, May 2011. (doi:10.1145/1995896.1995912)
[Jiang et al., 2011]
Song Jiang, Lei Zhang, XinHao Yuan, Hao Hu, and Yu Chen. S-FTL: An efficient address translation for flash memory by exploiting spatial locality. In Proceedings of the 27th IEEE Symposium on Mass Storage Systems and Technologies, Denver, CO, May 2011. (doi:10.1109/MSST.2011.5937215)
[Jin et al., 2011]
Chao Jin, Dan Feng, Hong Jiang, and Lei Tian. RAID6L: A log-assisted RAID6 storage architecture with improved write performance. In Proceedings of the 27th IEEE Symposium on Mass Storage Systems and Technologies, Denver, CO, May 2011. (doi:10.1109/MSST.2011.5937230)
[Park and Du, 2011]
Dongchul Park and David Du. Hot data identification for flash-based storage systems using multiple Bloom filters. In Proceedings of the 27th IEEE Symposium on Mass Storage Systems and Technologies, pages 1–11, Denver, CO, May 2011.
[Wei et al., 2011]
Qingsong Wei, Bozhao Gong, Suraj Pathak, Bharadwaj Veeravalli, LingFang Zeng, and Kanzo Okada. WAFTL: A workload adaptive flash translation layer with data partition. In Proceedings of the 27th IEEE Symposium on Mass Storage Systems and Technologies, Denver, CO, May 2011. IEEE. (doi:10.1109/MSST.2011.5937217)
[Zola et al., 2011]
Matteo Zola, Valerio Bioglio, Cosimo Anglano, Rossano Gaeta, Marco Grangetto, and Matteo Sereno. ENIGMA: Distributed virtual disks for cloud computing. In Proceedings of the IEEE International Symposium on Parallel & Distributed Processing Workshops and PhD Forum, pages 898–906, Shanghai, China, May 2011. IEEE.
[Gupta et al., 2011]
Aayush Gupta, Raghav Pisolkar, Bhuvan Urgaonkar, and Anand Sivasubramaniam. Leveraging value locality in optimizing NAND flash-based SSDs. In Proceedings of the 9th USENIX Conference on File and Storage Technologies, San Jose, CA, February 2011.
[Huang et al., 2011]
H. Howie Huang, Nan Zhang, Wei Wang, Gautam Das, and Alexander S. Szalay. Just-in-time analytics on large file systems. In Proceedings of the 9th USENIX Conference on File and Storage Technologies, San Jose, CA, February 2011.
[Lee et al., 2011]
Woojoong Lee, Sejin Park, Baegjae Sung, and Chanik Park. Improving adaptive replacement cache (ARC) by reuse distance. Poster presented at the 9th USENIX Conference on File and Storage Technologies, February 2011.
[Sivathanu et al., 2011]
Sankaran Sivathanu, Jinpyo Kim, Devaki Kulkarni, and Ling Liu. Load-aware replay of I/O traces. Poster presented at 9th USENIX Conference on File and Storage Technologies, February 2011.
[Tarasov et al., 2011]
Vasily Tarasov, Koundinya Santhosh Kumar, Erez Zadok, and Geoff Kuenning. T2M: Converting I/O traces to workload models. Poster presented at the 9th USENIX Conference on File and Storage Technologies, February 2011.
[Bozhao, 2010]
Gong Bozhao. HBM: A hybrid buffer management scheme for solid state disks. Master's thesis, National University of Singapore, 2010.
[Debnath et al., 2010]
Biplob Debnath, Srinivasan Krishnan, Weijun Xiao, David J. Lilja, and David Du. Sampling-based metadata management for flash storage. Technical Report ARCTIC 10-01, University of Minnesota ECE, 2010.
[Goodson and Iyer, 2010]
Garth Goodson and Rahul Iyer. Design tradeoffs in a flash translation layer. In Proceedings of the HPCA Workshop on the Use of Emerging Storage and Memory Technologies (WEST), 2010.
[Mohan et al., 2010]
Vidyabhushan Mohan, Taniya Siddiqua, Sudhanva Gurumurthi, and Mircea R. Stan. How I learned to stop worrying and love flash endurance. In Proceedings of the 2nd USENIX Workshop on Hot Topics in Storage and File Systems, Boston, MA, 2010. USENIX Association.
[Gunawardena et al., 2010]
Dinan Srilal Gunawardena, Richard Harper, and Eno Thereska. Data store including a file location attribute. United States Patent 8,656,454, December 1 2010.
[Lewis et al., 2010]
Joshua Lewis, Mohammed Alghamdi, Maen Al Assaf, Xiaojun Ruan, Zhiyang Ding, and Xiao Qin. An automatic prefetching and caching system. In Proceedings of the 29th IEEE International Performance, Computing, and Communications Conference, Albuquerque, NM, December 2010. (doi:10.1109/PCCC.2010.5682310)
[Anderson et al., 2010]
Eric Anderson, Christopher Hoover, and Xiaozhou Li. New algorithms for file system cooperative caching. In Proceedings of the 18th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Miami Beach, FL, August 2010. (doi:10.1109/MASCOTS.2010.59)
[Hu et al., 2010]
Jian Hu, Hong Jiang, Lei Tian, and Lei Xu. PUD-LRU: An erase-efficient write buffer management algorithm for flash memory SSD. In Proceedings of the 18th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Miami, FL, August 2010. IEEE. (doi:10.1109/MASCOTS.2010.16)
[Kang et al., 2010]
Yangwook Kang, Jingpei Yang, and Ethan L. Miller. Efficient storage management for object-based flash memory. In Proceedings of the 18th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pages 407–409, Miami Beach, FL, August 2010. IEEE.
[Pereira da Cunha Silva, 2010]
Thiago Emmanuel Pereira da Cunha Silva. Políticas de alocação e migração de arquivos em sistemas de arquivos distribuídos para redes locais. Master's thesis, Universidade Federal de Campina Grande, Campina Grande, Paraíba, Brazil, July 2010.
[Mohan, 2010]
Vidyabhushan Mohan. Modeling the physical characteristics of NAND flash memory. Master's thesis, University of Virginia, May 2010.
[Pereira et al., 2010]
Thiago Emmanuel Pereira, Jonhnny Weslley Silva, Alexandro Soares, and Francisco Brasileiro. BeeFS: A cheaper and naturally scalable distributed file system for corporate environments. In Proceedings of the 28th Brazilian Symposium on Computer Networks and Distributed Systems (SBRC), Gramado, Brazil, May 2010.
[Oprea and Juels, 2010]
Alina Oprea and Ari Juels. A clean-slate look at disk scrubbing. In Proceedings of the 8th USENIX Conference on File and Storage Technologies, San Jose, CA, February 2010.
[Thereska et al., 2009]
Eno Thereska, Austin Donnelly, and Dushyanth Narayanan. Sierra: A power-proportional, distributed storage system. Technical report, Microsoft Research, November 2009.
[Riska and Riedel, 2009]
Alma Riska and Erik Riedel. Evaluation of disk-level workloads at different time-scales. In Proceedings of the IEEE International Symposium on Workload Characterization, Austin, TX, October 2009. (doi:10.1109/IISWC.2009.5306787)

Displaying items 721–760 of 770 in total
Showing citations per page


Member Links