skip to main content
research-article
Open Access

Always measure one level deeper

Published:25 June 2018Publication History
Skip Abstract Section

Abstract

Performance measurements often go wrong, reporting surface-level results that are more marketing than science.

References

  1. Nickerson, R.S. Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology 2, 2 (June 1998), 175--220.Google ScholarGoogle ScholarCross RefCross Ref
  2. Ousterhout, J. A Philosophy of Software Design. Yaknyam Press, Palo Alto, CA, 2018.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ousterhout, J., Gopalan, A., Gupta, A., Kejriwal, A., Lee, C., Montazeri, B., Ongaro, D., Park, S.J., Qin, H., Rosenblum, M. et al. The RAMCloud storage system. ACM Transactions on Computer Systems 33, 3 (Aug. 2015), 7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Rosenblum, M. and Ousterhout, J.K. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1 (Feb. 1992), 26--52. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Always measure one level deeper

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Communications of the ACM
      Communications of the ACM  Volume 61, Issue 7
      July 2018
      90 pages
      ISSN:0001-0782
      EISSN:1557-7317
      DOI:10.1145/3234519
      Issue’s Table of Contents

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 25 June 2018

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Popular
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format