Publications

Books

Casey Rosenthal, Lorin Hochstein, Aaron Blohowiak, Nora Jones, Ali Basiri, Chaos Engineering: Building Confidence in System Behavior through experiments , O'Reilly Media, 2017.

Lorin Hochstein, Ansible: Up and Running, O'Reilly Media, 2015.

Tom Fifield, Diane Fleming, Anne Gentle, Lorin Hochstein, Jonathan Proulx, Everett Toews, Joe Topjian, OpenStack Operations Guide, O'Reilly Media, 2014.

Book chapters

Lorin Hochstein, "Making Work Visible", in 97 Things Every SRE Should Know, Emil Stolarsky, Jaime Woo, eds., O'Reilly Media, 2020.

Lorin Hochstein, Taiga Nakamura, Forrest Shull, Nico Zazworka, Victor R. Basili, Marvin V. Zelkowitz, "An Environment for Conducting Families of Software Engineering Experiments", Advances in Computers 74, Elsevier, 2008.

Journal publications

Haley Tucker, Lorin Hochstein, Nora Jones, Ali Basiri and Casey Rosenthal, The Business Case for Chaos Engineering, IEEE Cloud Computing, vol. 5, no. 3, pp. 45-54, May./Jun. 2018 (doi:10.1109/MCC.2018.032591616).

Ali Basiri, Niosha Behnam, Ruud de Rooij, Lorin Hochstein, Luke Kosewski, Justin Reynolds, Casey Rosenthal, Chaos Engineering, IEEE Software, Vol. 33, Issue 3, May/June 2016 (doi:10.1109/MS.2016.60).

Amianghu Bosu, Jeffrey Carver, Rosanna Guadagno, Blake Bassett, Debra McCallum, and Lorin Hochstein, Peer Impressions in Open Source Organizations: A Survey, Journal of Systems and Software (JSS), Vol. 94, August 2014, pages 4-15 (doi:10.1016/j.jss.2014.03.061).

Jeffrey Carver, Dustin Heaton, Lorin Hochstein, and Roscoe Bartlett, Self-Perceptions About Software Engineering: A Survey of Scientists and Engineers, IEEE Computing in Science & Engineering, Vol. 15, No.1, January/February 2013 (doi:10.1109/MCSE.2013.12).

Lorin Hochstein, Brian Schott, and Robert B. Graybill, Computational Engineering in the Cloud: Benefits and Challenges, Journal of Organizational and End User Computing, Vol. 23, No. 4, 2011, pages 31-50 (doi:10.4018/joeuc.2011100103).

Lorin Hochstein, Victor R. Basili, Uzi Vishkin, John Gilbert A Pilot Study to Compare Programming Effort for Two Parallel Programming Models, Journal of Systems and Software, 81, 2008 (doi:10.1016/j.jss.2007.12.798).

Victor R. Basili, Jeffrey Carver, Daniela Cruzes, Lorin Hochstein, Jeffrey K. Hollingsworth, Forrest Shull, and Marvin V. Zelkowitz, "Understanding the High Performance Computing Community: A Software Engineer's Perspective", IEEE Software, special issue on developing scientific software, July/August 2008.

Lorin Hochstein, Victor Basili, "The ASC-Alliance projects: A case study of large-scale parallel scientific code development", IEEE Computer, March 2008.

Mikael Lindvall, Ioana Rus, Paolo Donzelli, Atif Memon, MarvinZelkowitz, Aysu Betin-Can, Tevfik Bultan, Chris Ackermann, Bettina Anders, Sima Asgari, Victor Basili, Jorg Fellmann, Daniel Hirschbach, Lorin Hochstein, Forrest Shull, Roseanne Tvedt, Daniel Pech, Experimenting with software testbeds for evaluating new technologies, Empirical Software Engineering, Vol 12, No. 4, August 2007.

Lorin Hochstein, Taiga Nakamura, Victor R. Basili, Sima Asgari, Marvin V. Zelkowitz, Jeffrey K. Hollingsworth, Forrest Shull, Jeffrey Carver, Martin Voelp, Nico Zazworka, Philip Johnson, Experiments to Understand HPC Time to Development, CTWatch Quarterly, Vol 2, No. 4A, November 2006. (Invited paper)

Nicole Wolter, Michael O. McCracken, Allan Snavely, Lorin Hochstein, Taiga Nakamura, Victor Basili, What's working in HPC: Investigating HPC User Behavior and Productivity, CTWatch Quarterly, Vol. 2, No. 4A, November 2006. (Invited paper)

Jeffrey Carver, Lorin Hochstein, Richard Kendall, Taiga Nakamura, Marvin Zelkowitz, Victor Basili, Douglass Post, Observations about Software Development for High End Computing, CTWatch Quarterly, Vol. 2, No. 4A, November 2006. (Invited paper)

Andrew Funk, Victor Basili, Lorin Hochstein, Jeremy Kepner, Analysis of Parallel Software Development using the Relative Development Time Productivity Metric, CTWatch Quarterly, Vol. 2, No. 4A, November 2006. (Invited paper)

Lorin Hochstein, Mikael Lindvall. "Combating architectural degeneration: A Survey". Information & Software Technology. July 2005.

Mikael Lindvall, Ioana Rus, Forrest Shull, Marv Zelkowitz, Paolo Donzelli, Atif Memon, Vic Basili, Patricia Costa, Roseanne Tvedt, Lorin Hochstein, Sima Asgari, Chris Ackermann, Daniel Pech. "An Evolutionary Testbed for Software Technology Evaluation". NASA Journal of Innovations in Systems and Software Engineering. April 2005.

Conference publications

Ali Basiri, Lorin Hochstein, Nora Jones, Haley Tucker, "Automating chaos experiments in production", 41st ACM/IEEE International Conference on Software Engineering (ICSE '19), June 2019.

Ali Basiri, Aaron Blohowiak, Lorin Hochstein and Casey Rosenthal, "A Platform for Automating Chaos Experiments", 27th IEEE International Symposium on Software Reliability Engineering (ISSRE '16), October 2016. Best industry paper award.

Peter Alvaro, Kolton Andrus, Chris Sanden, Casey Rosenthal, Ali Basiri, Lorin Hochstein, "Automating Failure Testing Research at Internet Scale", ACM Symposium on Cloud Computing (SOCC '16), October 2016.

Lorin Hochstein, "Chaos Engineering", IEEE International Conference on Software Testing, Verification and Validation (ICST '16), April 2016

Scott Devoid, Lorin Hochstein, Narayan Desai, "Poncho: Enabling Smart Administration of Full Private Clouds", USENIX LISA 2013, 27th Large Installation System Administration Conference, November 2013.

Lorin Hochstein, Yang Jiao. "The cost of the build tax in scientific software", 5th International Symposium on Empirical Software Engineering and Measurement (ESEM ’11), September 2011.

Min Zhang, Lorin Hochstein, "Fitting a Workflow Model to Captured Development Data", Third International Symposium on Empirical Software Engineering and Measurement (ESEM '09), October 2009.

Lorin Hochstein, Forrest Shull, Lynn B. Reid, "The Role of MPI in Development Time: A Case Study", International Conference for High Performance Computing, Networking, Storange and Analysis (SC 08). November 2008 (doi: 10.1109/SC.2008.5213771).

Andhy Koesnandar, Sebastian Elbaum, Gregg Rothermel, Lorin Hochstein, Kathryn Stolee, Christopher Scaffidi, "Using Assertions to Help End-User Programmers Create Dependable Web Macros", 16th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE 16), November 2008.

Taiga Nakamura, Lorin Hochstein, Victor R. Basili. Identifying Domain-Specific Defect Classes Using Inspections and Change History. 5th International Symposium on Empirical Software Engineering (ISESE '06). September 2006.

Lorin Hochstein, Victor R. Basili. "An Empirical Study to Compare Two Parallel Programming Models". 18th ACM Symposium on Parallelism in Algorithms and Architectures (SPAA '06). July 2006. (Brief announcement)

Lorin Hochstein, Jeff Carver, Forrest Shull, Sima Asgari, Victor R. Basili, Jeffrey K. Hollingsworth, Marvin Zelkowitz. "Parallel Programmer Productivity: A Case Study of Novice Parallel Programmers". International Conference for High Performance Computing, Networking and Storage (SC'05). November 2005. Best student paper award.

Forrest Shull, Victor R. Basili, Jeff Carver, Lorin Hochstein. "Empirical study design in the area of High-Performance Computing (HPC)". 4th International Symposium on Empirical Software Engineering (ISESE '05). November 2005.

Lorin Hochstein, Victor R. Basili, Marvin Zelkowitz, Jeff Hollingsworth, Jeff Carver. "Combining self-reported and automatic data to improve effort measurement". Joint 10th European Software Engineering Conference and 13th ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2005). September 2005.

Marvin Zelkowitz, Victor Basili, Sima Asgari, Lorin Hochstein, Jeff Hollingsworth, Taiga Nakamura. "Measuring Productivity on High Performance Computers". 11th IEEE International Software Metrics Symposium. September 2005.

S. Hamid Nawab, Robert P. Wotiz, Lorin M. Hochstein, Carlos J. De Luca. "Next-Generation Decomposition of Multi-channel EMG Signals". Proceedings of the 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society. October 2002.

Lorin Hochstein, Sorin Lerner, James Clark, Jeremy Cooperstock. "Soccer-Swarm: A Graphical Framework for Soccer-Player Design". Proceedings of the International Symposium on Robotics, Montreal, Canada. May 2000.

Workshop publications

Prakashan Korambath, Jianwu Wang, Ankur Kumar, Lorin Hochstein, Brian Schott, Robert Graybill, Michael Baldea, and Jim Davis, "Deploying Kepler Workflows as Services on a Cloud Infrastructure for Smart Manufacturing", 2nd Workshop on Advances in the Kepler Scientific Workflow System and Its Applications, (short paper), June 2014.

Steve Crago, Kyle Dunn, Patrick Eads, Lorin Hochstein, Dong-In Kang, Mikyung Kang, Devendra Modium, Karandeep Singh, Jinwoo Suh, and John Paul Walters, "Heterogeneous Cloud Computing", Workshop on Parallel Programming on Accelerator Clusters (PPAC2011), IEEE Cluster, Austin, Texas. September 2011.

Jeffrey C. Carver, Lorin Hochstein, Jason Oslin, "Identifying Programmer Ability Using Peer Evaluation: An Exploratory Study", First Workshop on Human Aspects of Software Engineering (HAoSE 2009), OOPSLA, Orlando, Florida. September 2009.

Victor Basili, Thiago Craveiro, Daniela Cruzes, Kate Despain, Bill Dorland, Lorin Hochstein, Nico Zazworka, Marvin Zelkowitz, "Large Efficient Table-Top Teraflop Computing", Workshop on Software Engineering for Computational Science & Engineering (SE-CSE), ICSE, Leipzig, Germany. May 2008.

Lorin Hochstein, Victor R. Basili, Position Paper and Brief Announcement: "An Empirical Study to Compare Two Parallel Programming Models", ACM Symposium on Parallel Algorithms and Architectures (06). July 2006

Sima Asgari, Lorin Hochstein, Vic Basili, Jeff Carver, Jeff Hollingsworth, Forrest Shull. "Generating Testable Hypotheses from Tacit Knowledge for High Productivity Computing". Workshop on Software Engineering for High Performance Computing Applications (SE-HPCS), ICSE, St. Louis, MO. May 2005.

Andy Funk, Lorin Hochstein, Vic Basili, Jeremy Kepner. "Application of a Development Time Productivity Metric to Parallel Software Development". Workshop on Software Engineering for High Performance Computing Applications (SE-HPCS), ICSE, St. Louis, MO. May 2005.

Robert Numrich, Lorin Hochstein, Vic Basili. "A Metric Space for Productivity Measurement in Software Development". Workshop on Software Engineering for High Performance Computing Applications (SE-HPCS), ICSE, St. Louis, MO. May 2005.

Sima Asgari, Vic Basili, Jeff Carver, Lorin Hochstein, Jeff Hollingsworth, Forrest Shull, Marv Zelkowitz. "Challenges in Measuring HPCS Learner Productivity in an Age of Ubiquitous Computing". Workshop on Software Engineering for High Performance Computing Applications (SE-HPCS), ICSE, Edinburgh, Scotland. May 2004.

Jeff Carver, Sima Asgari, Vic Basili, Lorin Hochstein, Jeff Hollingsworth, Forrest Shull, Marv Zelkowitz. "Studying Code Development for High Performance Computing: The HPCS Program". Workshop on Software Engineering for High Performance Computing Applications (SE-HPCS), ICSE, Edinburgh, Scotland. May 2004.

Sima Asgari, Vic Basili, Patricia Cost, Paolo Donzelli, Lorin Hochstein, Mikael Lindvall, Ioana Rus, Forrest Shull, Roseanne Tvedt, Marv Zelkowitz. "Empirical-based Estimation of the Effect on Software Dependability of a Technique for Architecture Conformance Verification". Workshop on Architecting Dependable Systems, ICSE, Edinburgh, Scotland. May 2004.

Lorin Hochstein, Mikael Lindvall. "Diagnosing Architectural Degeneration". Proceedings of the 28th NASA/IEEE Software Engineering Workshop,Greenbelt, MD. December 2003.

Technical reports

Lorin Hochstein, Victor R. Basili, A Preliminary Empirical Study to Compare MPI and OpenMP, USC/ISI Technical Report ISI-TR-676, December 2011.

Jeffrey C. Carver, Roscoe Bartlett, Dustin Heaton, Lorin Hochstein, Self-Perceptions about Software Engineering: A Survey of Scientists and Engineers, University of Alabama Technical Report SERG-2011-04. November 2011.

Lorin Hochstein, Victor R. Basili, The ASC-Alliance Projects: A Case Study of Large-scale Parallel Scientific Code Development. University of Maryland Technical Report CS-TR-4834, UMIACS-TR-2006-50. October 2006.

Victor Basili, Sima Asgari, Jeff Carver, Lorin Hochstein, Jeffrey K. Hollingsworth, Forrest, Shull, Marv Zelkowitz. A Pilot Study to Evaluate Development Effort for High Performance Computing. University of Maryland Technical Report CS-TR-4588. April 2004.