People systematically overlook subtractive changes

10 min read Original article ↗

Data availability

All data and materials are available on the Open Science Framework at https://osf.io/7v6r2/. The coded responses from study S2 are posted per our agreement with the organization that supplied the data. Open-ended responses are available from the authors upon reasonable request and with permission of the organization.

Code availability

All R code used to produce analyses for all studies is available on the Open Science Framework at https://osf.io/7v6r2/.

References

  1. Holyoak, K. J. in Advances in the Psychology of Human Intelligence Vol. 2 (ed. Sternberg, R. J.) 199–230 (Erlbaum, 1984).

  2. Newell, A. & Simon, H. A. Human Problem Solving (Prentice-Hall, 1972).

  3. Reitman, W. R. in Human Judgments and Optimality (eds Shelley, M. W. & Bryan, G. L.) 282–315 (Wiley, 1964).

  4. Kahneman, D. A perspective on judgment and choice: mapping bounded rationality. Am. Psychol. 58, 697–720 (2003).

    Article  Google Scholar 

  5. Payne, J. W., Bettman, J. R. & Johnson, E. J. Behavioral decision research: a constructive processing perspective. Annu. Rev. Psychol. 43, 87–131 (1992).

    Article  Google Scholar 

  6. Higgins, E. T. in Social Psychology: Handbook of Basic Principles (eds Higgins, E. T. & Kruglanski, A. W.) 75–123 (Guilford, 1996).

  7. Klayman, J. & Ha, Y. W. Confirmation, disconfirmation, and information in hypothesis-testing. Psychol. Rev. 94, 211–228 (1987).

    Article  Google Scholar 

  8. Schwarz, N. & Skurnik, I. in The Psychology of Problem Solving (eds Davidson, J. E. & Sternberg, R. J.). 263–290. (Cambridge Univ. Press, 2003).

  9. Gettys, C. F., Pliske, R. M., Manning, C. & Casey, J. T. An evaluation of human act generation performance. Org. Behav. & Hum. Dec. Proc. 39, 23–51 (1987).

    Article  Google Scholar 

  10. Wiley, J. Expertise as mental set: the effects of domain knowledge in creative problem solving. Mem. Cognit. 26, 716–730 (1998).

    Article  CAS  Google Scholar 

  11. Perlow, L. A. The time famine: toward a sociology of work time. Adm. Sci. Q. 44, 57–81 (1999).

    Article  Google Scholar 

  12. Sunstein, C. R. Simpler: The Future of Government (Simon & Schuster, 2013).

  13. Steffen, W. et al. Planetary boundaries: guiding human development on a changing planet. Science 347, 1259855 (2015).

    Article  Google Scholar 

  14. Lewis, S. L. & Maslin, M. A. Defining the Anthropocene. Nature 519, 171–180 (2015).

    Article  ADS  CAS  Google Scholar 

  15. Kahneman, D. & Tversky, A. Prospect theory: an analysis of decision under risk. Econometrica 47, 263–291 (1979).

    Article  MathSciNet  Google Scholar 

  16. Higgins, E. T. Promotion and prevention: regulatory focus as a motivational principle. Adv. Exp. Soc. Psychol. 30, 1–46 (1998).

    Google Scholar 

  17. Roese, N. J. Counterfactual thinking. Psychol. Bull. 121, 133–148 (1997).

    Article  CAS  Google Scholar 

  18. Lidwell, W., Holden, K. & Butler, J. Universal Principles of Design, Revised and Updated: 125 Ways to Enhance Usability, Influence Perception, Increase Appeal, Make Better Design Decisions, and Teach Through Design (Rockport, 2010).

  19. Strunk, W. & White, E. B. The Elements of Style 4th edn (Allyn & Bacon, 1999).

  20. Lewin, K. Field Theory in Social Science (Harper, 1951).

  21. Thaler, R. & Sunstein, C. Nudge: Improving Decisions About Health, Wealth, and Happiness (Yale Univ. Press, 2009).

  22. Gilbert, D. T., Tafarodi, R. W. & Malone, P. S. You can’t not believe everything you read. J. Pers. Soc. Psychol. 65, 221–233 (1993).

    Article  CAS  Google Scholar 

  23. Glucksberg, S. & McGlone, M. S. Understanding Figurative Language: From Metaphors to Idioms (Oxford Univ. Press, 2001).

  24. McAdams, D. P. & de St. Aubin, E. A theory of generativity and its assessment through self-report, behavioral acts, and narrative themes in autobiography. J. Pers. Soc. Psychol. 62, 1003–1015 (1992).

    Article  Google Scholar 

  25. Stephens, D. W. & Krebs, J. R. Foraging Theory (Princeton, 1986).

  26. Veblen, T. The Theory of the Leisure Class: An Economic Study of Institutions (Dover, 1994).

  27. Johnson, E. J., Häubl, G. & Keinan, A. Aspects of endowment: a query theory of value construction. J. Exp. Psychol. Learn. Mem. Cogn. 33, 461–474 (2007).

    Article  Google Scholar 

  28. Eidelman, S., Crandall, C. S. & Pattershall, J. The existence bias. J. Pers. Soc. Psychol. 97, 765–775 (2009).

    Article  Google Scholar 

  29. Anderson, J. R. Acquisition of cognitive skill. Psychol. Rev. 89, 369–406 (1982).

    Article  Google Scholar 

  30. Ginossar, Z. & Trope, Y. Problem solving in judgment under uncertainty. J. Pers. Soc. Psychol. 52, 464–474 (1987).

    Article  Google Scholar 

  31. Higgins, E. T., King, G. A. & Mavin, G. H. Individual construct accessibility and subjective impressions and recall. J. Pers. Soc. Psychol. 43, 35–47 (1982).

    Article  Google Scholar 

  32. Greene, J. D., Morelli, S. A., Lowenberg, K., Nystrom, L. E. & Cohen, J. D. Cognitive load selectively interferes with utilitarian moral judgment. Cognition 107, 1144–1154 (2008).

    Article  Google Scholar 

  33. Converse, B. A. & Dennis, P. J. The role of “Prominent Numbers” in open numerical judgment: Strained decision makers choose from a limited set of accessible numbers. Organ. Behav. Hum. Decis. Process. 147, 94–107 (2018).

    Article  Google Scholar 

  34. Torchiano, M. effsize: Efficient Effect Size Computation. R package version 0.7.6, https://CRAN.R-project.org/package=effsize (2020).

  35. Revelle, W. psych: Procedures for Personality and Psychological Research. R package version 1.8.12, https://CRAN.R-project.org/package=psych (2020).

  36. The Jamovi Project. jamovi (version 1. 2), https://www.jamovi.org (2021).

  37. Delacre, M., Lakens, D. & Leys, C. Why psychologists should by default use Welch’s t-test instead of Student’s t-test. Int. Rev. Soc. Psychol. 30, 92–101 (2017).

    Article  Google Scholar 

Download references

Acknowledgements

We thank E. Caruso, J. Goldstein-Greenwood, D. Player, K. Stenger, S. Trawalter and T. Wilson for comments; Y. Muramoto, Z. Magraw-Mickelson and M. Gollwitzer for assisting with data collection for study S12; A. Myer, J. Holland and M. Wiwuga for research management; and B. Stein and H. Koizumi for research assistance. This research was supported by a 3 Cavaliers grant from the University of Virginia and US National Science Foundation grant no. 153104.

Author information

Author notes

  1. These authors contributed equally: Gabrielle S. Adams, Benjamin A. Converse, Andrew H. Hales, Leidy E. Klotz

Authors and Affiliations

  1. Frank Batten School of Leadership and Public Policy, University of Virginia, Charlottesville, VA, USA

    Gabrielle S. Adams, Benjamin A. Converse & Andrew H. Hales

  2. Department of Psychology, College and Graduate School of Arts and Sciences, University of Virginia, Charlottesville, VA, USA

    Benjamin A. Converse

  3. Engineering Systems and Environment, School of Engineering and Applied Science, University of Virginia, Charlottesville, VA, USA

    Leidy E. Klotz

Authors

  1. Gabrielle S. Adams
  2. Benjamin A. Converse
  3. Andrew H. Hales
  4. Leidy E. Klotz

Contributions

As all authors contributed equally to this work, they are listed alphabetically in the front matter. G.S.A. and L.E.K. conceived the initial question; G.S.A., B.A.C., A.H.H. and L.E.K. developed the hypothesis, designed studies and oversaw data collection for all studies; G.S.A. and A.H.H. analysed data; B.A.C. wrote the first draft with input from G.S.A., A.H.H. and L.E.K. A.H.H. and G.S.A. wrote the Supplementary Information with input from B.A.C. and L.E.K.

Corresponding authors

Correspondence to Gabrielle S. Adams or Benjamin A. Converse.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Peer review information Nature thanks Tom Meyvis and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Extended data figures and tables

Extended Data Fig. 1 People are more likely to subtract from recipes with atypical ingredients (study S9).

Each dot represents one recipe (k = 27). Placement on the x axis reflects the atypicality score for each recipe, determined by the mean rating from n = 80 workers from Amazon Mechanical Turk. Independent samples of n = 7–12 workers from Amazon Mechanical Turk (total, n = 284) then had an opportunity to transform one of the randomly assigned recipes. Placement on the y axis reflects the percentage of participants who produced a subtractive transformation of each recipe. The atypicality score of an ingredient positively predicted the percentage of participants who subtracted; r25 = 0.54, P = 0.003; two-sided test. Error band represents the 95% confidence interval of predicted percentage subtracting.

Extended Data Fig. 2 Study material for experiment 1.

In the stimuli that participants saw, a toy action figure (image removed for reasons of copyright) stood at the height marked on the white paper. Participants could stabilize the top platform of the Lego structure so it could hold a masonry brick above the head of the action figure by adding new supports to reinforce the single corner block or by removing the corner block and letting the platform sit flush on the layer below. They earned $1 for successful completion, but adding Lego bricks cost money. The most profitable solution was to remove the single support. Participants were randomly assigned to instructions that explicitly stated ‘removing pieces is free’ (cue condition) or instructions that did not mention removing pieces (control condition).

Extended Data Fig. 3 Study material for experiments 2 to 4.

Participants reported their ideas for how to change this miniature golf hole. We coded whether each idea was additive (for example, ‘add a windmill’), subtractive (for example, ‘remove the sand trap’) or neither (for example, ‘reverse the direction’). Participants were randomly assigned to a no-cue instruction that mentioned neither addition nor subtraction or to a cue condition that reminded participants they could ‘add or subtract’. In experiments 2 and 3, participants reported all of the ways that they might improve the original. In experiment 4, participants were randomly assigned to a condition that solicited their improvement ideas or a condition that solicited their ideas for making the hole worse.

Extended Data Fig. 4 Cumulative percentage of participants who included at least one type of idea by the ith idea in their list in experiments 2 to 4.

Participants were randomly assigned to one of two conditions in experiments 2 and 3 (no-cue versus cue) (n = 312); and one of four conditions in experiment 4 ((no-cue versus cue) × (improve versus make-it-worse)) (n = 369). The y axes show cumulative percentage. The x axes show idea order (i). Empty blue shapes represent subtractive ideas and filled orange shapes represent additive ideas. Dotted lines represent no-cue conditions and solid lines represent cue conditions. Circles represent responses to an improve prompt and triangles represent responses to a make-it-worse prompt. a, b, Across experiments 2 (a) and 3 (b), we did not find evidence that the cue affected the likelihood of participants listing at least one additive idea (odds ratio = 0.92, z = −0.24, P = 0.810), but we did find evidence that it increased the likelihood of participants listing at least one subtractive idea (odds ratio = 1.93, z = 2.73, P = 0.006). c, In experiment 4, the cue increased the likelihood of participants listing at least one subtractive idea within the improvement conditions (no-cue = 21%, cue = 48%, χ2 = 13.63, P < 0.001) and the make-it-worse conditions (no-cue = 28%, cue = 50%, χ2 = 9.71, P = 0.002). The error band represents s.e. of proportion.

Extended Data Table 1 Observed rates of subtractive changes, additive changes and other changes in studies S1 to S8

Full size table

Extended Data Table 2 Changing originals with more and fewer components in study S10

Full size table

Extended Data Table 3 Overlooking subtraction in samples from university students from the USA, Germany and Japan

Full size table

Supplementary information

Supplementary Information

This file contains information about participant exclusions, analyses, and results for experiments 1—8 (section 1), descriptions of methods and results for studies S1—S12 (section 2), and additional references (see page 1 for details).

Reporting Summary

Peer Review File

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Adams, G.S., Converse, B.A., Hales, A.H. et al. People systematically overlook subtractive changes. Nature 592, 258–261 (2021). https://doi.org/10.1038/s41586-021-03380-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Version of record:

  • Issue date:

  • DOI: https://doi.org/10.1038/s41586-021-03380-y