nature.com

Psychological insights for judging expertise and implications for adversarial legal contexts

Abstract

Determining which experts to trust is essential for both routine and high-stakes decisions, yet evaluating expertise can be difficult. In this Review, we examine the cognitive processes that underpin genuine expertise and explore the disconnect between psychological insights into expertise and the practical methods used to evaluate it. In settings where expertise must be evaluated by laypeople, such as adversarial legal trials, evaluators face substantial challenges, including knowledge disparities that hinder analysis, communication barriers that impact the clear explanation of expert methods, and procedural constraints that limit the scrutiny of expert evidence. These challenges complicate the assessment of expert claims and contribute to wrongful convictions and unjust outcomes. We suggest that a distinction between ‘show-it’ and ‘know-it’ expert performances that differ in their visibility, measurability and immediacy can be used as a heuristic for identifying when evaluations of expertise require greater care and should incorporate a variety of diagnostic factors including foundational and applied validity. Finally, we highlight key knowledge gaps and propose promising directions for future research to improve evaluations of expertise in a range of contexts.

This is a preview of subscription content, access via your institution

Access options

Access through your institution

Change institution

Buy or subscribe

Subscribe to this journal

Receive 12 digital issues and online access to articles

$59.00 per year

only $4.92 per issue

Learn more

Buy this article

Purchase on SpringerLink

Instant access to full article PDF

Buy now

Prices may be subject to local taxes which are calculated during checkout

Additional access options:

Log in

Learn about institutional subscriptions

Read our FAQs

Contact customer support

Fig. 1: ‘Show-it’ versus ‘know-it’ tasks.

Fig. 2: Trade-off between the visibility and diagnosticity of expert traits.

Fig. 3: Data for diagnosing expertise.

References

Evans, R. The sociology of expertise: the distribution of social fluency. Sociol. Compass 2, 281–298 (2008).

Grundmann, R. The problem of expertise in knowledge societies. Minerva 55, 25–48 (2017).

ArticlePubMedGoogle Scholar

Campbell, W., Goss, A., Trottier, K. & Claypool, M. in Global Esports: Transformation of Cultural Perceptions of Competitive Gaming (ed Jin, D. Y.) 35–59 (Bloomsbury, 2021).

Karadakis, K. & Painchaud, M. M. Esport knowledge, skills, and abilities: perspectives from subject matter experts. Athens J. Sports 9, 79–100 (2022).

ArticleGoogle Scholar

Farrington-Darby, T. & Wilson, J. R. The nature of expertise: a review. Appl. Ergonomics 37, 17–32 (2006).

ArticleGoogle Scholar

Gobet, F. Understanding Expertise: A Multi-Disciplinary Approach (Palgrave, 2016).

Shanteau, J., Weiss, D. J., Thomas, R. P. & Pounds, J. C. Performance-based assessment of expertise: how to decide if someone is an expert or not. Eur. J. Oper. Res. 136, 253–263 (2002).

ArticleGoogle Scholar

Selinger, E. & Crease, R. P. The Philosophy of Expertise (Columbia Univ. Press, 2006).

Bédard, J. & Chi, M. T. H. Expertise. Curr. Dir. Psychol. Sci. 1, 135–139 (2016).

ArticleGoogle Scholar

Kahneman, D. & Klein, G. Conditions for intuitive expertise: a failure to disagree. Am. Psychol. 64, 515–526 (2009).

ArticlePubMedGoogle Scholar

Martire, K. A. & Edmond, G. Rethinking expert opinion evidence. Melb. Univ. Law Rev. 40, 967–998 (2017).

Google Scholar

Herling, R. W. Operational definitions of expertise and competence. Adv. Dev. Hum. Resour. 2, 8–21 (2016).

ArticleGoogle Scholar

Faigman, D. L. et al. Modern Scientific Evidence: The Law and Science of Expert Testimony (Thomson West, 2024).

Guisinger, A. & Saunders, E. N. Mapping the boundaries of elite cues: how elites shape mass opinion across international issues. Int. Stud. Q. 61, 425–441 (2017).

ArticleGoogle Scholar

Australian Associated Press. More than 100,000 DNA samples may need re-testing as Queensland lab bungle worsens. The Guardianhttps://www.theguardian.com/australia-news/2023/nov/20/more-than-100000-dna-samples-may-need-re-testing-as-queensland-lab-bungle-worsens (2023).

Gross, S. R. Expert evidence. Wis. Law Rev. 1991, 1113–1232 (1991).

Google Scholar

Jankowicz, M. Psychiatrist who testified for Amber Heard recounts tide of ‘horrific’ and ‘vile’ social-media responses. Business Insiderhttps://www.businessinsider.com/amber-heard-psychiatrist-dr-spiegel-social-media-response-was-vile-2022-6 (2022).

MacLean, C. L., Smith, L. & Dror, I. E. Experts on trial: unearthing bias in scientific evidence. Univ. Br. Columbia Law Rev. 53, 101 (2020).

Google Scholar

Rickard, D. Truth or doubt: questioning legal outcomes in true-crime documentaries. Law Humanities 17, 60–89 (2022).

ArticleGoogle Scholar

Stern, B. Social media’s influence on the outcome of trials: State v. Casey Anthony & Depp v. Heard—how Florida can prevent a breakdown in the adversarial process. Nova Law Rev. 47, 6 (2022).

Google Scholar

Sutherland, E. E. Undue deference to experts syndrome. Indiana Int. Competition Law Rev. 16, 375 (2005).

ArticleGoogle Scholar

National Research Council. Strengthening Forensic Science in the United States: A Path Forward (National Academies Press, 2009).

President’s Council of Advisors on Science & Technology. Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methodshttps://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/PCAST/pcast_forensic_science_report_final.pdf (2016).

Federal Rules of Evidence Rule 702, 28 U.S.C § 702 (2023).

Shanteau, J. Why task domains (still) matter for understanding expertise. J. Appl. Res. Mem. Cogn. 4, 169–175 (2015).

ArticleGoogle Scholar

Einhorn, H. J. Expert judgment: some necessary conditions and an example. J. Appl. Psychol. 59, 562–571 (1974).

ArticleGoogle Scholar

Shanteau, J. Competence in experts: the role of task characteristics. Organ. Behav. Hum. Decis. Process. 53, 252–266 (1992).

ArticleGoogle Scholar

Neal, T. M. S. & Grisso, T. The cognitive underpinnings of bias in forensic mental health evaluations. Psychol. Public Policy Law 20, 200–211 (2014).

ArticleGoogle Scholar

Patel, V. L., Arocha, J. F. & Kaufman, D. R. in Vol. 31: Advances in Research and Theory. Psychology of Learning and Motivation (ed Medin, D. L.) 187–252 (Academic, 1994).

Meehl, P. E. Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence (Univ. Minnesota Press, 1954).

Campitelli, G. & Gobet, F. Herbert Simon’s decision-making approach: investigation of cognitive processes in experts. Rev. Gen. Psychol. 14, 354–364 (2010).

ArticleGoogle Scholar

Voss, J. F., Greene, T. R., Post, T. A. & Penner, B. C. in Volume 17. Psychology of Learning and Motivation (ed Bower, G. H.) 165–213 (Elsevier, 1983).

Eyal, G. The Crisis of Expertise (John Wiley & Sons, 2019).

Chow, D. L. et al. The role of deliberate practice in the development of highly effective psychotherapists. Psychotherapy 52, 337–345 (2015).

ArticlePubMedGoogle Scholar

Ericsson, K. A., Hoffman, R. R. & Kozbelt, A. The Cambridge Handbook of Expertise and Expert Performance (Cambridge Univ. Press, 2018).

Ericsson, K. A., Krampe, R. T. & Tesch-Römer, C. The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100, 363–406 (1993).

ArticleGoogle Scholar

Macnamara, B. N., Hambrick, D. Z. & Oswald, F. L. Deliberate practice and performance in music, games, sports, education, and professions: a meta-analysis. Psychol. Sci. 25, 1608–1618 (2014).

ArticlePubMedGoogle Scholar

Macnamara, B. N., Moreau, D. & Hambrick, D. Z. The relationship between deliberate practice and performance in sports: a meta-analysis. Perspect. Psychol. Sci. 11, 333–350 (2016).

ArticlePubMedGoogle Scholar

Platz, F., Kopiez, R., Lehmann, A. C. & Wolf, A. The influence of deliberate practice on musical achievement: a meta-analysis. Front. Psychol. 5, 646 (2014).

ArticlePubMedPubMed CentralGoogle Scholar

Ward, P., Hodges, N. J., Starkes, J. L. & Williams, M. A. The road to excellence: deliberate practice and the development of expertise. High Ability Stud. 18, 119–153 (2007).

ArticleGoogle Scholar

Ericsson, K. A. & Harwell, K. W. Deliberate practice and proposed limits on the effects of practice on the acquisition of expert performance: why the original definition matters and recommendations for future research. Front. Psychol. 10, 2396 (2019).

ArticlePubMedPubMed CentralGoogle Scholar

Hambrick, D. Z. et al. Deliberate practice: is that all it takes to become an expert? Intelligence 45, 34–45 (2014).

ArticleGoogle Scholar

Staff, T., Gobet, F. & Parton, A. Investigating the period of practice needed to acquire expertise in Great Britain 2012 track and field Olympic athletes. J. Expert. 2, 148–163 (2020).

Google Scholar

Sternberg, R. J. in The Road to Excellence (ed Ericsson, K. A.) 347–354 (Psychology Press, 2014).

Kimball, D. R. & Holyoak, K. J. in The Oxford Handbook of Memory (eds Tulving, E. & Craik, F. I. M.) 109–122 (Oxford Univ. Press, 2000).

Singley, M. K. & Anderson, J. R. The transfer of text-editing skill. Int. J. Man Machine Stud. 22, 403–423 (1985).

ArticleGoogle Scholar

Growns, B. et al. Finding the perfect match: fingerprint expertise facilitates statistical learning and visual comparison decision-making. J. Exp. Psychol. Appl. 29, 386–397 (2023).

ArticlePubMedGoogle Scholar

Searston, R. A. & Tangen, J. M. The style of a stranger: identification expertise generalizes to coarser level categories. Psychon. Bull. Rev. 24, 1324–1329 (2017).

ArticlePubMedGoogle Scholar

Bilalic, M., McLeod, P. & Gobet, F. Specialization effect and its influence on memory and problem solving in expert chess players. Cogn. Psychol. 33, 1117–1143 (2009).

Google Scholar

Chiesi, H. L., Spilich, G. J. & Voss, J. F. Acquisition of domain-related information in relation to high and low domain knowledge. J. Verbal Learn. Verbal Behav. 18, 257–273 (1979).

ArticleGoogle Scholar

Rikers, R. M. et al. The robustness of medical expertise: clinical case processing by medical experts and subexperts. Am. J. Psychol. 115, 609–629, (2002).

ArticlePubMedGoogle Scholar

Searston, R. A. & Tangen, J. M. Expertise with unfamiliar objects is flexible to changes in task but not changes in class. PLoS One 12, e0178403 (2017).

ArticlePubMedPubMed CentralGoogle Scholar

Towler, A. et al. Are forensic scientists experts? J. Appl. Res. Mem. Cogn. 7, 199–208 (2018).

ArticleGoogle Scholar

Gegenfurtner, A., Lehtinen, E. & Säljö, R. Expertise differences in the comprehension of visualizations: a meta-analysis of eye-tracking research in professional domains. Educ. Psychol. Rev. 23, 523–552 (2011).

ArticleGoogle Scholar

Ziv, G. Gaze behavior and visual attention: a review of eye tracking studies in aviation. Int. J. Aviat. Psychol. 26, 75–104 (2016).

ArticleGoogle Scholar

Brams, S. et al. The relationship between gaze behavior, expertise, and performance: a systematic review. Psychol. Bull. 145, 980–1027 (2019).

ArticlePubMedGoogle Scholar

Kocak, E., Ober, J., Berme, N. & Melvin, W. S. Eye motion parameters correlate with level of experience in video-assisted surgery: objective testing of three tasks. J. Laparoendosc. Adv. Surg. Tech. Part A 15, 575–580 (2005).

ArticleGoogle Scholar

Krupinski, E. A., Graham, A. R. & Weinstein, R. S. Characterizing the development of visual search expertise in pathology residents viewing whole slide images. Hum. Pathol. 44, 357–364 (2013).

ArticlePubMedGoogle Scholar

Manning, D., Ethell, S., Donovan, T. & Crawford, T. How do radiologists do it? The influence of experience and training on searching for chest nodules. Radiography 12, 134–142 (2006).

ArticleGoogle Scholar

de Groot, A., Gobet, F. & Jongman, R. W. Perception and Memory in Chess: Studies in the Heuristics of the Professional Eye (Mouton, 1996).

Gauthier, I., Tarr, M. & Bub, D. Perceptual Expertise: Bridging Brain and Behavior (OUP USA, 2010).

Helsen, W. F. & Starkes, J. L. A multidimensional approach to skilled perception and performance in sport. Appl. Cogn. Psychol. 13, 1–27 (1999).

3.0.CO;2-T" data-track-item_id="10.1002/(SICI)1099-0720(199902)13:1<1::AID-ACP540>3.0.CO;2-T" data-track-value="article reference" data-track-action="article reference" href="https://doi.org/10.1002%2F%28SICI%291099-0720%28199902%2913%3A1%3C1%3A%3AAID-ACP540%3E3.0.CO%3B2-T" aria-label="Article reference 62" data-doi="10.1002/(SICI)1099-0720(199902)13:1<1::AID-ACP540>3.0.CO;2-T">ArticleGoogle Scholar

Kundel, H. L. & Nodine, C. F. Interpreting chest radiographs without visual search. Radiology 116, 527–532 (1975).

ArticlePubMedGoogle Scholar

de Groot, A. D. Thought and Choice in Chess (Walter de Gruyter, 1978).

Simon, H. A. & Chase, W. G. Skill in chess. Am. Scientist 61, 393–403 (1973).

Google Scholar

Thompson, M. B. & Tangen, J. M. The nature of expertise in fingerprint matching: experts can do a lot with a little. PLoS One 9, e114759 (2014).

ArticlePubMedPubMed CentralGoogle Scholar

Ericsson, K. A. & Staszewski, J. J. in Complex Information Processing: The Impact of Herbert A. Simon (eds Klahr, D. & Kotovsky, K.) 255–288 (Psychology Press, 2013).

Nodine, C. F. & Kundel, H. L. in Eye Movements from Physiology to Cognition (eds O’Regan, J. K. & Levy-Schoen, A.) 573–582 (Elsevier, 1987).

Gobet, F. et al. Chunking mechanisms in human learning. Trends Cogn. Sci. 5, 236–243 (2001).

ArticlePubMedGoogle Scholar

Swensson, R. G. A two-stage detection model applied to skilled visual search by radiologists. Percept. Psychophys. 27, 11–16 (1980).

ArticleGoogle Scholar

Frey, P. W. & Adesman, P. Recall memory for visually presented chess positions. Mem. Cogn. 4, 541–547 (1976).

ArticleGoogle Scholar

Dewar, K. M., Cuddy, L. L. & Mewhort, D. Recognition memory for single tones with and without context. J. Exp. Psychol. Hum. Learn. Mem. 3, 60 (1977).

ArticleGoogle Scholar

Gobet, F. & Oliver, I. Memory for the random: A simulation of computer program recall. In Proc. 38th Annual Meeting of the Cognitive Science Society, CogSci 2016 1355–1360 (2016).

Gobet, F. & Simon, H. A. Recall of random and distorted chess positions: implications for the theory of expertise. Mem. Cogn. 24, 493–503 (1996).

ArticleGoogle Scholar

Gobet, F. & Simon, H. A. Five seconds or sixty? Presentation time in expert memory. Cogn. Sci. 24, 651–682 (2000).

ArticleGoogle Scholar

Sala, G. & Gobet, F. Experts’ memory superiority for domain-specific random material generalizes across fields of expertise: a meta-analysis. Mem. Cogn. 45, 183–193 (2017).

ArticleGoogle Scholar

Gobet, F. & Simon, H. A. Templates in chess memory: a mechanism for recalling several boards. Cogn. Psychol. 31, 1–40 (1996).

ArticlePubMedGoogle Scholar

Chi, M. T. H. & Glaser, R. in Human Abilities; An Information-Processing Approach (ed Sternberg, R. J.) (W H Freeman & Co., 1985).

Stokes, D. On perceptual expertise. Mind Lang. 36, 241–263 (2020).

ArticleGoogle Scholar

Blättler, C., Ferrari, V., Didierjean, A., van Elslande, P. & Marmèche, E. Can expertise modulate representational momentum? Vis. Cogn. 18, 1253–1273 (2010).

ArticleGoogle Scholar

Didierjean, A. & Marmèche, E. Anticipatory representation of visual basketball scenes by novice and expert players. Vis. Cogn. 12, 265–283 (2017).

ArticleGoogle Scholar

Farrow, D. & Abernethy, B. Do expertise and the degree of perception-action coupling affect natural anticipatory performance? Perception 32, 1127–1139 (2003).

ArticlePubMedGoogle Scholar

Chi, M. T., Feltovich, P. J. & Glaser, R. Categorization and representation of physics problems by experts and novices. Cogn. Sci. 5, 121–152 (1981).

ArticleGoogle Scholar

Chassy, P., Lahaye, R., Didierjean, A. & Gobet, F. Intuition in chess: a study with world-class players. Psychol. Res. 87, 2380–2389 (2023).

ArticlePubMedPubMed CentralGoogle Scholar

Gobet, F. & Borg, J. L. The intermediate effect in clinical case recall is present in musculoskeletal physiotherapy. Man. Ther. 16, 327–331 (2011).

ArticlePubMedGoogle Scholar

Gobet, F., de Voogt, A. & Retschitzki, J. Moves in Mind: The Psychology of Board Games (Psychology Press, 2004).

Thompson, M. B., Tangen, J. M. & Searston, R. A. Understanding expertise and non-analytic cognition in fingerprint discriminations made by humans. Front. Psychol. 5, 737 (2014).

ArticlePubMedPubMed CentralGoogle Scholar

Gobet, F. & Chassy, P. Expertise and intuition: a tale of three theories. Minds Mach. 19, 151–180 (2008).

ArticleGoogle Scholar

Klein, G. A. A recognition-primed decision (RPD) model of rapid decision making. Decis. Mak. Action Model. Methods 5, 138–147 (1993).

Google Scholar

Klein, G. Naturalistic decision making. Hum. Factors 50, 456–460 (2008).

ArticlePubMedGoogle Scholar

Simon, H. A. Explaining the ineffable: AI on the topics of intuition, insight and inspiration. Proc. 14th Int. Join. Conf. Artif. Intell. 1, 939–949 (1995).

Google Scholar

Dreyfus, H. & Dreyfus, S. E. Mind Over Machine (Simon and Schuster, 1986).

Eberhard, J., Klomp, H. J., Foge, M., Hedderich, J. & Schmidt, H. G. The intermediate effect and the diagnostic accuracy in clinical case recall of students and experts in dental medicine. Eur. J. Dental Educ. 13, 128–134 (2009).

ArticleGoogle Scholar

Patel, V. L. & Groen, G. J. Knowledge based solution strategies in medical reasoning. Cogn. Sci. 10, 91–116 (1986).

ArticleGoogle Scholar

Rikers, R. M., Schmidt, H. G. & Boshuizen, H. P. Knowledge encapsulation and the intermediate effect. Contemp. Educ. Psychol. 25, 150–166 (2000).

ArticlePubMedGoogle Scholar

Drew, T., Võ, M. L.-H. & Wolfe, J. M. The invisible gorilla strikes again: sustained inattentional blindness in expert observers. Psychol. Sci. 24, 1848–1853 (2013).

ArticlePubMedGoogle Scholar

Edmond, G. & Martire, K. A. Just cognition: scientific research on bias and some implications for legal procedure and decision‐making. Mod. Law Rev. 82, 633–664 (2019).

ArticleGoogle Scholar

Gilovich, T., Griffin, D. & Kahneman, D. Heuristics and Biases: The Psychology of Intuitive Judgment (Cambridge Univ. Press, 2002).

Growns, B. & Neal, T. M. S. in The Cambridge Handbook of Psychology and Legal Decision-Making (eds Miller, M. K., Yelderman, L. A., Huss, M. T. & Cantones, J. A.) 193–210 (Cambridge Univ. Press, 2024).

Kahneman, D. Thinking, Fast and Slow (Macmillan, 2011).

Kahneman, D., Sibony, O. & Sunstein, C. R. Noise: A Flaw in Human Judgment (Hachette UK, 2021).

Kahneman, D., Slovic, P. & Tversky, A. (Eds.) Judgment Under Uncertainty: Heuristics and Biases (Cambridge Univ. Press, 1982).

Neal, T. M. S., Lienert, P., Denne, E. & Singh, J. P. A general model of cognitive bias in human judgment and systematic review specific to forensic mental health. Law Hum. Behav. 46, 99–120 (2022).

ArticlePubMedGoogle Scholar

Neal, T. M. S. & Pronin, E. Measuring the Objectivity and Bias of Experts Award Abstract 1655011, NSF (2023).

Reyna, V. F., Chick, C. F., Corbin, J. C. & Hsia, A. N. Developmental reversals in risky decision making: intelligence agents show larger decision biases than college students. Psychol. Sci. 25, 76–84 (2014).

ArticlePubMedGoogle Scholar

Reyna, V. F. & Lloyd, F. J. Physician decision making and cardiac risk: effects of knowledge, risk perception, risk tolerance, and fuzzy processing. J. Exp. Psychol. Appl. 12, 179–195 (2006).

ArticlePubMedGoogle Scholar

Tversky, A. & Kahneman, D. Judgment under uncertainty: heuristics and biases. Science 185, 1124–1131 (1974).

ArticlePubMedGoogle Scholar

Anderson, J. C., Lowe, D. J. & Reckers, P. M. Evaluation of auditor decisions: hindsight bias effects and the expectation gap. J. Econ. Psychol. 14, 711–737 (1993).

ArticleGoogle Scholar

Dawson, N. V. et al. Hindsight bias: an impediment to accurate probability estimation in clinicopathologic conferences. Med. Decis. Mak. 8, 259–264 (1988).

ArticleGoogle Scholar

Gouvier, W. D., Uddo-Crane, M. & Brown, L. M. Base rates of post-concussional symptoms. Arch. Clin. Neuropsychol. 3, 273–278 (1988).

ArticlePubMedGoogle Scholar

Neal, T. M. S., MacLean, N., Morgan, R. D. & Murrie, D. C. Confirmatory information seeking is robust in psychologists’ diagnostic reasoning.Law Human. Behav.https://doi.org/10.1037/lhb0000574 (2024).

ArticleGoogle Scholar

Englich, B., Mussweiler, T. & Strack, F. Playing dice with criminal sentences: the influence of irrelevant anchors on experts’ judicial decision making. Pers. Soc. Psychol. Bull. 32, 188–200 (2006).

ArticlePubMedGoogle Scholar

Northcraft, G. B. & Neale, M. A. Experts, amateurs, and real estate: an anchoring-and-adjustment perspective on property pricing decisions. Organ. Behav. Hum. Decis. Process. 39, 84–97 (1987).

ArticleGoogle Scholar

Cooper, G. S. & Meterko, V. Cognitive bias research in forensic science: a systematic review. Forensic Sci. Int. 297, 35–46 (2019).

ArticlePubMedGoogle Scholar

Dror, I. E., Charlton, D. & Peron, A. E. Contextual information renders experts vulnerable to making erroneous identifications. Forensic Sci. Int. 156, 74–78 (2006).

ArticlePubMedGoogle Scholar

Murrie, D. C. & Boccaccini, M. T. Adversarial allegiance among expert witnesses. Annu. Rev. Law Soc. Sci. 11, 37–55 (2015).

ArticleGoogle Scholar

Gobet, F. The Psychology of Chess (Routledge, 2018).

Bilalic, M., McLeod, P. & Gobet, F. Why good thoughts block better ones: the mechanism of the pernicious Einstellung (set) effect. Cognition 108, 652–661 (2008).

ArticlePubMedGoogle Scholar

Saariluoma, P. Error in chess: the apperception-restructuring view. Psychol. Res. 54, 17–26 (1992).

ArticlePubMedGoogle Scholar

Sheridan, H. & Reingold, E. M. The mechanisms and boundary conditions of the Einstellung effect in chess: evidence from eye movements. PLoS One 8, e75796 (2013).

ArticlePubMedPubMed CentralGoogle Scholar

Walmsley, S. & Gilbey, A. Cognitive biases in visual pilots’ weather‐related decision making. Appl. Cogn. Psychol. 30, 532–543 (2016).

ArticleGoogle Scholar

Tetlock, P. E. & Gardner, D. Superforecasting: The Art and Science of Prediction (Random House, 2016).

Robson, S. G., Tangen, J. M. & Searston, R. A. The effect of expertise, target usefulness and image structure on visual search. Cogn. Res. Princ. Implic. 6, 16 (2021).

ArticlePubMedPubMed CentralGoogle Scholar

Van de Wiel, M. W. Examining expertise using interviews and verbal protocols. Frontline Learn. Res. 5, 112–140 (2017).

Google Scholar

Cantou, P., Platel, H., Desgranges, B. & Groussard, M. How motor, cognitive and musical expertise shapes the brain: focus on fMRI and EEG resting-state functional connectivity. J. Chem. Neuroanat. 89, 60–68 (2018).

ArticlePubMedGoogle Scholar

Debarnot, U., Sperduti, M., Di Rienzo, F. & Guillot, A. Experts bodies, experts minds: how physical and mental training shape the brain. Front. Hum. Neurosci. 8, 280 (2014).

ArticlePubMedPubMed CentralGoogle Scholar

Waters, A. & Gobet, F. in Overcoming the Myth of Neutrality: Expertise for a New World (Farina, M. & Lavazza, A.) 13–28 (Routledge, 2024).

Berger, C. Criminalistics is reasoning backwards. Ned. Juristenblad 85, 784–789 (2010).

Google Scholar

Gustafson, A. & Rice, R. E. A review of the effects of uncertainty in public science communication. Public Underst. Sci. 29, 614–633 (2020).

ArticlePubMedGoogle Scholar

Martin, T. G. et al. Eliciting expert knowledge in conservation science. Conserv. Biol. 26, 29–38 (2012).

ArticlePubMedGoogle Scholar

Mehlenbacher, A. R. On Expertise: Cultivating Character, Goodwill, and Practical Wisdom (Penn State Press, 2022).

Detterman, D. K. Introduction to the intelligence special issue on the development of expertise: is ability necessary? Intelligence 45, 1–5 (2014).

ArticleGoogle Scholar

Simonton, D. K. Creative performance, expertise acquisition, individual differences, and developmental antecedents: an integrative research agenda. Intelligence 45, 66–73 (2014).

ArticleGoogle Scholar

Edmond, G., Cole, S., Cunliffe, E. & Roberts, A. Admissibility compared: the reception of incriminating expert evidence (ie, forensic science) in four adversarial jurisdictions. Univ. Denver Crim. Law Rev. 3, 31 (2013).

Google Scholar

Cordner, S. R v Klamo: an example of miscommunication and misunderstanding of expert evidence where the conviction was overturned. Austr. J. Forensic Sci. 44, 323–331 (2012).

ArticleGoogle Scholar

Mnookin, J. L. Expert evidence, partisanship, and epistemic competence. Brooklyn Law Rev. 73, 1009 (2007).

Google Scholar

Tetlock, P. E. Expert Political Judgment (Princeton Univ. Press, 2017).

Daubert v. Merrell Dow Pharmaceuticals, Inc. US Reporter 509, 579 (Supreme Court, 1993).

Law Commission. Expert Evidence in Criminal Proceedings in England and Wales (The Stationery Office, 2011).

Huber, P. W. Galileo’s Revenge: Junk Science In The Courtroom (Basic Books, 1991).

R. v. Mohan Supreme Court Judgments 2 SCR 9 (1994).

R. v. J.-L.J. Supreme Court Judgments 2 SCR 600 (2000).

Cunliffe, E. & Edmond, G. Justice without science? Judging the reliability of forensic science in Canada. Can. Bar. Rev. 99, 65 (2021).

Google Scholar

Maxwell, C. Preventing miscarriages of justice: the reliability of forensic evidence and the role of the trial judge as gatekeeper. Austr. Law J. 93, 642–654 (2019).

Google Scholar

Faigman, D. L., Monahan, J. & Slobogin, C. Group to individual (G2i) inference in scientific expert testimony.Univ. Chic. Law Rev. 81, 417–480 (2014).

Google Scholar

Hand, L. Expert testimony, historical and practical considerations regarding expert testimony. Harv. Law Rev. 15, 40 (1901).

ArticleGoogle Scholar

Chin, J. & Dallen, S. R v Awer and the dangers of science in sheep’s clothing. Crim. Law Q. 63, 527 (2016).

Google Scholar

Edmond, G., Cunliffe, E. & Hamer, D. Fingerprint comparison and adversarialism: the scientific and historical evidence. Mod. Law Rev. 83, 1287–1327 (2020).

ArticleGoogle Scholar

Brewer, S. Scientific expert testimony and intellectual due process. Yale Law J. 107, 1535 (1997).

ArticleGoogle Scholar

Collins, H. M. & Evans, R. Rethinking Expertise (Univ. Chicago Press, 2007).

Edmond, G., Chin, J. M., Martire, K. A. & Roque, M. S. A warning about judicial directions and warnings. Adel. Law Rev. 44, 194–245 (2023).

Google Scholar

White, D., Kemp, R. I., Jenkins, R., Matheson, M. & Burton, A. M. Passport officers’ errors in face matching. PLoS One 9, e103510 (2014).

ArticlePubMedPubMed CentralGoogle Scholar

Collins, H. M. & Evans, R. in The Philosophy of Expertise (eds Selinger, E. & Crease, R. P.) (Columbia Univ. Press, 2006).

Caudill, D. S. & LaRue, L. H. No Magic Wand: The Idealization of Science in Law (Rowman & Littlefield, 2006).

Cunliffe, E. Murder, Medicine and Motherhood (Bloomsbury, 2011).

Neal, T. M. S., Slobogin, C., Saks, M. J., Faigman, D. L. & Geisinger, K. F. Psychological assessments in legal contexts: are courts keeping “junk science” out of the courtroom? Psychol. Sci. Public Interest. 20, 135–164 (2019).

ArticlePubMedGoogle Scholar

Saks, M. & Koehler, J. J. The coming paradigm shift in forensic identification science. Science 309, 892–895 (2005).

ArticlePubMedGoogle Scholar

Bonventre, C. L. Wrongful convictions and forensic science. WIREs Forensic Sci. 3, e1406 (2020).

ArticleGoogle Scholar

Cole, S. A. Forensic science and wrongful convictions: from exposer to contributor to corrector. N. Engl. Law Rev. 46, 711 (2011).

Google Scholar

Dioso-Villa, R., Julian, R., Kebbell, M., Weathered, L. & Westera, N. Investigation to exoneration: a systemic review of wrongful conviction in Australia. Curr. Issues Crim. Justice 28, 157–172 (2016).

ArticleGoogle Scholar

Garrett, B. L. & Neufeld, P. J. Invalid forensic science testimony and wrongful convictions. Virginia Law Rev. 95, 1–97 (2009).

Google Scholar

Hamer, D. & Edmond, G. Forensic science evidence, wrongful convictions and adversarial process. Univ. Qld Law J. 38, 185 (2019).

Google Scholar

Hoyle, C. Forensic science and expert testimony in wrongful convictions: a study of decision-making at the criminal cases review commission. Br. J. Criminol. 59, 919–937 (2019).

ArticleGoogle Scholar

Laporte, G. Wrongful convictions and DNA exonerations: understanding the role of forensic science. Natl Inst. Justice J. 279, 1–16 (2018).

Google Scholar

Thompson, W. C. Beyond bad apples: analyzing the role of forensic science in wrongful convictions. Southwest. Univ. Law Rev. 37, 1027 (2008).

Google Scholar

Campbell, A. The Fingerprint Inquiry Report (Fingerprint Inquiry by APS Group Scotland, 2011).

Goudge, S. T. Inquiry into Pediatric Forensic Pathology in Ontario: Report (Government of Ontario, 2009).

Kaye, D. H., Busey, T., Gische, M. R., LaPorte, G. & Shappell, S. A. Latent Print Examination and Human Factors: Improving the Practice through a Systems Approach (NIST/NIJ, 2012).

Science & Technology Select Committee. Forensic Science and the Criminal Justice System: A Blueprint for Change (House of Lords, 2019).

Diaz v. United States, 602 U.S._(2024) https://supreme.justia.com/cases/federal/us/602/23-14/ (2024).

Garrett, B. L., Gardner, B. O., Murphy, E. E. & Grimes, P. Judges and forensic science education: a national survey. Forensic Sci. Int. 321, 110714 (2021).

ArticlePubMedGoogle Scholar

Collins, H. Are We All Scientific Experts Now? (John Wiley & Sons, 2014).

Dillon, J. R. Expertise on trial. Columbia Sci. Technol. Law Rev.https://doi.org/10.7916/aztb-9v23 (2018).

Nichols, T. The Death of Expertise: The Campaign Against Established Knowledge and Why it Matters (Oxford Univ. Press, 2017).

Goldman, A. I. Experts: which ones should you trust? Philos. Phenomenol. Res. 63, 85–110 (2001).

ArticleGoogle Scholar

Walton, D. Appeal to Expert Opinion: Arguments from Authority (Penn State Press, 2010).

Edmond, G., Cunliffe, E., Martire, K. A. & San Roque, M. Forensic science evidence and the limits of cross-examination. Melb. Univ. Law Rev. 42, 858–920 (2019).

Google Scholar

Neal, T. M. S., Sellbom, M. & de Ruiter, C. Personality assessment in legal contexts: introduction to the special issue. J. Personality Assess. 104, 127–136 (2022).

ArticleGoogle Scholar

Chi, M. T. in The Cambridge Handbook of Expertise and Expert Performance (eds Ericsson, K. A., Charness, N., Feltovich, P. J. & Hoffman, R. R.) 21–30 (Cambridge Univ. Press, 2006).

Edmond, G. et al. How to cross-examine forensic scientists: a guide for lawyers. Aust. Bar Rev. 39, 174 (2014).

Google Scholar

Evans, K. K., Georgian-Smith, D., Tambouret, R., Birdwell, R. L. & Wolfe, J. M. The gist of the abnormal: above-chance medical decision making in the blink of an eye. Psychon. Bull. Rev. 20, 1170–1175 (2013).

ArticlePubMedGoogle Scholar

Hammond, K. R., Hamm, R. M., Grassia, J. & Pearson, T. Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment. IEEE Trans. Syst. Man Cybern. 17, 753–770 (1987).

ArticleGoogle Scholar

Nisbett, R. E. & Wilson, T. D. Telling more than we can know: verbal reports on mental processes. Psychol. Rev. 84, 231 (1977).

ArticleGoogle Scholar

Proctor, R. W. & Dutta, A. Skill Acquisition and Human Performance (Sage, 1995).

Pronin, E. The introspection illusion. Adv. Exp. Soc. Psychol. 41, 1–67 (2009).

ArticleGoogle Scholar

Kukucka, J., Kassin, S. M., Zapf, P. A. & Dror, I. E. Cognitive bias and blindness: a global survey of forensic science examiners. J. Appl. Res. Mem. Cogn. 6, 452–459 (2017).

ArticleGoogle Scholar

Neal, T. M. S. & Brodsky, S. L. Forensic psychologists’ perceptions of bias and potential correction strategies in forensic mental health evaluations. Psychol. Public Policy Law 22, 58 (2016).

ArticleGoogle Scholar

Christensen, A. M., Crowder, C. M., Ousley, S. D. & Houck, M. M. Error and its meaning in forensic science. J. Forensic Sci. 59, 123–126 (2014).

ArticlePubMedGoogle Scholar

Thompson, W. C. & Scurich, N. How cross-examination on subjectivity and bias affects jurors’ evaluations of forensic science evidence. J. Forensic Sci. 64, 1379–1388 (2019).

ArticlePubMedGoogle Scholar

Crozier, W. E., Kukucka, J. & Garrett, B. L. Juror appraisals of forensic evidence: effects of blind proficiency and cross-examination. Forensic Sci. Int. 315, 110433 (2020).

ArticlePubMedGoogle Scholar

Hogarth, R. M., Lejarraga, T. & Soyer, E. The two settings of kind and wicked learning environments. Curr. Dir. Psychol. Sci. 24, 379–385 (2015).

ArticleGoogle Scholar

Bonner, C. et al. Current best practice for presenting probabilities in patient decision aids: fundamental principles. Med. Decis. Mak. 41, 821–833 (2021).

ArticleGoogle Scholar

Budescu, D. V., Por, H.-H. & Broomell, S. B. Effective communication of uncertainty in the IPCC reports. Clim. Change 113, 181–200 (2012).

ArticleGoogle Scholar

Budescu, D. V., Por, H.-H., Broomell, S. B. & Smithson, M. The interpretation of IPCC probabilistic statements around the world. Nat. Clim. Change 4, 508–512 (2014).

ArticleGoogle Scholar

Dhami, M. K. & Mandel, D. R. Words or numbers? Communicating probability in intelligence analysis. Am. Psychol. 76, 549–560 (2021).

ArticlePubMedGoogle Scholar

Spiegelhalter, D. Risk and uncertainty communication. Annu. Rev. Stat. Appl. 4, 31–60 (2017).

ArticleGoogle Scholar

Visschers, V. H. M., Meertens, R. M., Passchier, W. W. F. & de Vries, N. N. K. Probability information in risk communication: a review of the research literature. Risk Anal. 29, 267–287 (2009).

ArticlePubMedGoogle Scholar

Eldridge, H. Juror comprehension of forensic expert testimony: a literature review and gap analysis. Forensic Sci. Int. Synergy 1, 24–34 (2019).

ArticlePubMedGoogle Scholar

Hilton, N. Z., Scurich, N. & Helmus, L.-M. Communicating the risk of violent and offending behavior: review and introduction to this special issue. Behav. Sci. Law 33, 1–18 (2015).

ArticlePubMedGoogle Scholar

Martire, K. A. & Edmond, G. in Handbook of Forensic Statistics (eds Banks, D. L., Kafadar, K., Kaye, D. H. & Tackett, M.) 201–224 (Chapman Hall/CRC, 2020).

Howes, L. M. The communication of forensic science in the criminal justice system: a review of theory and proposed directions for research. Sci. Justice 55, 145–154 (2015).

ArticlePubMedGoogle Scholar

Howes, L. M. & Kemp, N. Discord in the communication of forensic science. J. Lang. Soc. Psychol. 36, 96–111 (2016).

ArticleGoogle Scholar

McQuiston-Surrett, D. & Saks, M. The testimony of forensic identification science: what expert witnesses say and what factfinders hear. Law Hum. Behav. 33, 436–453 (2009).

ArticlePubMedGoogle Scholar

Martire, K. A., Kemp, R. I. & Newell, B. R. The psychology of interpreting expert evaluative opinions. Aust. J. Forensic Sci. 45, 305–314 (2013).

ArticleGoogle Scholar

Martire, K. A., Kemp, R. I., Sayle, M. & Newell, B. R. On the interpretation of likelihood ratios in forensic science evidence: presentation formats and the weak evidence effect. Forensic Sci. Int. 240, 61–68 (2014).

ArticlePubMedGoogle Scholar

Martire, K. A., Kemp, R. I., Watkins, I., Sayle, M. A. & Newell, B. R. The expression and interpretation of uncertain forensic science evidence: verbal equivalence, evidence strength, and the weak evidence effect. Law Hum. Behav. 37, 197–207 (2013).

ArticlePubMedGoogle Scholar

Martire, K. A. & Watkins, I. Perception problems of the verbal scale: a reanalysis and application of a membership function approach. Sci. Justice 55, 264–273 (2015).

ArticlePubMedGoogle Scholar

Bali, A. S., Edmond, G., Ballantyne, K. N., Kemp, R. I. & Martire, K. A. Communicating forensic science opinion: an examination of expert reporting practices. Sci. Justice 60, 216–224 (2020).

ArticlePubMedGoogle Scholar

Howes, L. M., Kirkbride, K. P., Kelty, S. F., Julian, R. & Kemp, N. Forensic scientists’ conclusions: how readable are they for non-scientist report-users? Forensic Sci. Int. 231, 102–112 (2013).

ArticlePubMedGoogle Scholar

Spellman, B. A. Communicating forensic evidence: lessons from psychological science. Seton Hall Law Rev. 48, 827–840 (2017).

Google Scholar

Bullock, O. M., Colón Amill, D., Shulman, H. C. & Dixon, G. N. Jargon as a barrier to effective science communication: evidence from metacognition. Public Underst. Sci. 28, 845–853 (2019).

ArticlePubMedGoogle Scholar

Shulman, H. C., Dixon, G. N., Bullock, O. M. & Colón Amill, D. The effects of jargon on processing fluency, self-perceptions, and scientific engagement. J. Lang. Soc. Psychol. 39, 579–597 (2020).

ArticleGoogle Scholar

Edmond, G., Martire, K. A. & Roque, M. S. Expert reports and the forensic sciences. Univ. N. South Wales Law J. 40, 590–637 (2017).

Google Scholar

Auld, L. J. A Review of the Criminal Courts of England and Wales (Stationery Office, 2001).

Krauss, D. A. & Lee, D. H. Deliberating on dangerousness and death: jurors’ ability to differentiate between expert actuarial and clinical predictions of dangerousness. Int. J. Law Psychiatry 26, 113–137 (2003).

ArticlePubMedGoogle Scholar

Krauss, D. A. & Sales, B. D. The effects of clinical and scientific expert testimony on juror decision making in capital sentencing. Psychol. Public Policy Law 7, 267–310 (2001).

ArticleGoogle Scholar

Levett, L. M. & Kovera, M. B. The effectiveness of opposing expert witnesses for educating jurors about unreliable expert evidence. Law Hum. Behav. 32, 363 (2008).

ArticlePubMedGoogle Scholar

Findley, K. A. Innocents at risk: adversary imbalance, forensic science, and the search for truth. Seton Hall Law Rev. 38, 893 (2008).

Google Scholar

Freckelton, I., Goodman-Delahunty, J., Horan, J. & McKimmie, B. Expert Evidence and Criminal Jury Trials (Oxford Univ. Press, 2016).

Giannelli, P. C. The right to defense experts. Crim. Justice 18, 15–22 (2003).

Google Scholar

Baguley, C. M., McKimmie, B. M. & Masser, B. M. Deconstructing the simplification of jury instructions: how simplifying the features of complexity affects jurors’ application of instructions. Law Hum. Behav. 41, 284 (2017).

ArticlePubMedGoogle Scholar

Marder, N. S. Bringing jury instructions into the twenty-first century. Notre Dame Law Rev. 81, 449 (2005).

Google Scholar

Severance, L. J. & Loftus, E. F. Improving the ability of jurors to comprehend and apply criminal jury instructions. Law Soc. Rev. 17, 153 (1982).

ArticleGoogle Scholar

Steele, W. W. Jr & Thornburg, E. G. Jury instructions: a persistent failure to communicate. North Carol. Law Rev. 67, 77 (1988).

Google Scholar

Qureshi, A. M. Relying on demeanour evidence to assess credibility during trial: a critical examination. Crim. LQ 61, 235 (2014).

Google Scholar

McKimmie, B. M., Antrobus, E. & Baguley, C. Objective and subjective comprehension of jury instructions in criminal trials. N. Crim. Law Rev. 17, 163–183 (2014).

ArticleGoogle Scholar

Martire, K. A. & Kemp, R. I. The impact of eyewitness expert evidence and judicial instruction on juror ability to evaluate eyewitness testimony. Law Hum. Behav. 33, 225–236 (2009).

ArticlePubMedGoogle Scholar

Kleider-Offutt, H. M., Clevinger, A. M. & Bond, A. D. Working memory and cognitive load in the legal system: influences on police shooting decisions, interrogation and jury decisions. J. Appl. Res. Mem. Cogn. 5, 426–433 (2016).

ArticleGoogle Scholar

Pennington, N. & Hastie, R. Explaining the evidence: tests of the Story Model for juror decision making. J. Pers. Soc. Psychol. 62, 189–206 (1992).

ArticleGoogle Scholar

Costabile, K. A. & Klein, S. B. Finishing strong: recency effects in juror judgments. Basic Appl. Soc. Psychol. 27, 47–58 (2010).

ArticleGoogle Scholar

Pritchard, M. E. & Keenan, J. M. Memory monitoring in mock jurors. J. Exp. Psychol. Appl. 5, 152 (1999).

ArticleGoogle Scholar

Slavich, G. M. & Zimbardo, P. G. Transformational teaching: theoretical underpinnings, basic principles, and core methods. Educ. Psychol. Rev. 24, 569–608 (2012).

ArticlePubMedPubMed CentralGoogle Scholar

Hans, V. P. & Vidmar, N. Judging the Jury (Springer, 2013).

Rosenhan, D. L., Eisner, S. L. & Robinson, R. J. Notetaking can aid juror recall. Law Hum. Behav. 18, 53–61 (1994).

ArticleGoogle Scholar

ForsterLee, L., Horowitz, I., Athaide-Victor, E. & Brown, L. M. The bottom line: the effect of written expert witness statements on juror verdicts and information processing. Law Hum. Behav. 24, 259–270 (2000).

ArticlePubMedGoogle Scholar

Thorley, C., Baxter, R. E. & Lorek, J. The impact of note taking style and note availability at retrieval on mock jurors’ recall and recognition of trial information. Memory 24, 560–574 (2016).

ArticlePubMedGoogle Scholar

Tootle v R [2017] NSWCCA 150 (New South Wales Court of Criminal Appeal, 2017).

Chaiken, S. in Social Influence (eds. Zanna, M. P., Olson, J. M. & Herman, C. P.) 3–39 (Psychology Press, 2014).

Petty, R. E. & Cacioppo, J. T. The effects of involvement on responses to argument quantity and quality: Central and peripheral routes to persuasion. J. Pers. Soc. Psychol. 46, 69–81 (1984).

ArticleGoogle Scholar

Reimer, T., Mata, R. & Stoecklin, M. The use of heuristics in persuasion: deriving cues on source expertise from argument quality. Curr. Res. Soc. Psychol. 10, 69–84 (2004).

Google Scholar

SanJose-Cabezudo, R., Gutierrez-Arranz, A. M. & Gutierrez-Cillan, J. The combined influence of central and peripheral routes in the online persuasion process. CyberPsychol. Behav. 12, 299–308 (2009).

ArticlePubMedGoogle Scholar

Bornstein, B. H. & Greene, E. Jury decision making: implications for and from psychology. Curr. Dir. Psychol. Sci. 20, 63–67 (2011).

ArticleGoogle Scholar

Chaiken, S. Heuristic versus systematic information processing and the use of source versus message cues in persuasion. J. Pers. Soc. Psychol. 39, 752–766 (1980).

ArticleGoogle Scholar

Cooper, J., Bennett, E. A. & Sukel, H. L. Complex scientific testimony: how do jurors make decisions? Law Hum. Behav. 20, 379–394 (1996).

ArticleGoogle Scholar

Curley, L. J., Munro, J. & Dror, I. E. Cognitive and human factors in legal layperson decision making: sources of bias in juror decision making. Med. Sci. Law 62, 206–215 (2022).

ArticlePubMedPubMed CentralGoogle Scholar

Daftary‐Kapur, T., Dumas, R. & Penrod, S. D. Jury decision‐making biases and methods to counter them. Leg. Criminol. Psychol. 15, 133–154 (2011).

ArticleGoogle Scholar

Heuer, L. & Penrod, S. Trial complexity: a field investigation of its meaning and its effects. Law Hum. Behav. 18, 29–51 (1994).

ArticleGoogle Scholar

Ivković, S. K. & Hans, V. P. Jurors’ evaluations of expert testimony: judging the messenger and the message. Law Soc. Inq. 28, 441–482 (2003).

ArticleGoogle Scholar

Lord, C. G. & Taylor, C. A. Biased assimilation: effects of assumptions and expectations on the interpretation of new evidence. Soc. Pers. Psychol. Compass 3, 827–841 (2009).

ArticleGoogle Scholar

Maeder, E. M. et al. Jurors’ perceptions of scientific testimony: the role of gender and testimony complexity in trials involving DNA evidence. Cogent Psychol. 3, 1264657 (2016).

ArticleGoogle Scholar

Neal, T. M. S. Women as expert witnesses: a review of the literature. Behav. Sci. Law 32, 164–179 (2014).

ArticlePubMedGoogle Scholar

Schuller, R. A., Terry, D. & McKimmie, B. The impact of expert testimony on jurors’ decisions: gender of the expert and testimony complexity1. J. Appl. Soc. Psychol. 35, 1266–1280 (2005).

ArticleGoogle Scholar

Shuman, D. W., Champagne, A. & Whitaker, E. Assessing the believability of expert witnesses: science in the jurybox. Jurimetrics 37, 23 (1996).

Google Scholar

Shuman, D. W., Whitaker, E. & Champagne, A. An empirical examination of the use of expert witnesses in the courts-Part II: a three city study. Jurimetrics 34, 193 (1993).

Google Scholar

Simon, D. & Read, S. J. Toward a general framework of biased reasoning: coherence-based reasoning. Perspect. Psychol. Sci.https://doi.org/10.1177/17456916231204579 (2023).

ArticlePubMedGoogle Scholar

Martire, K. et al. Observability x diagnosticity tradeoffs affecting cue-based evaluations of expertise. Preprint at PsyArXivhttps://doi.org/10.31234/osf.io/bcdyw (2024).

Cramer, R. J., DeCoster, J., Neal, T. M. & Brodsky, S. L. The observed witness efficacy scale: a measure of effective testimony skills. J. Appl. Soc. Psychol. 43, 1696–1703 (2013).

ArticleGoogle Scholar

McCarthy Wilcox, A. & NicDaeid, N. Jurors’ perceptions of forensic science expert witnesses: experience, qualifications, testimony style and credibility. Forensic Sci. Int. 291, 100–108 (2018).

ArticlePubMedGoogle Scholar

Brodsky, S. L., Griffin, M. P. & Cramer, R. J. The Witness Credibility Scale: an outcome measure for expert witness research. Behav. Sci. Law 28, 892–907 (2010).

ArticlePubMedGoogle Scholar

Goldberg, L. R. Simple models or simple processes? Some research on clinical judgments. Am. Psychol. 23, 483 (1968).

ArticlePubMedGoogle Scholar

Brodsky, S. L., Neal, T. M. S., Cramer, R. J. & Ziemke, M. H. Credibility in the courtroom: how likeable should an expert witness be? J. Am. Acad. Psychiatry Law 37, 525–532 (2009).

PubMedGoogle Scholar

Neal, T. M. S., Guadagno, R. E., Eno, C. A. & Brodsky, S. L. Warmth and competence on the witness stand: implications for the credibility of male and female expert witnesses. J. Am. Acad. Psychiatry Law 40, 488–497 (2012).

PubMedGoogle Scholar

Younan, M. & Martire, K. A. Likeability and expert persuasion: dislikeability reduces the perceived persuasiveness of expert evidence. Front. Psychol. 12, 785677 (2021).

ArticlePubMedPubMed CentralGoogle Scholar

McKimmie, B. M., Newton, C. J., Terry, D. J. & Schuller, R. A. Jurors’ responses to expert witness testimony: the effects of gender stereotypes. Group Process. Intergroup Relat. 7, 131–143 (2004).

ArticleGoogle Scholar

Edmond, G. Latent justice? A review of adversarial challenges to fingerprint evidence. Sci. Justice 62, 21–29 (2022).

ArticlePubMedGoogle Scholar

Kukucka, J., Dror, I. E., Yu, M., Hall, L. & Morgan, R. M. The impact of evidence lineups on fingerprint expert decisions. Appl. Cognit. Psychol. 34, 1143–1153 (2020).

ArticleGoogle Scholar

Quigley-McBride, A. Practical solutions to forensic contextual bias. Z. Psychol. 228, 162–174 (2020).

Google Scholar

Merton, R. K. in The Sociology of Science: Theoretical and Empirical Investigations 267–278 (1979).

Moher, D. et al. The Hong Kong principles for assessing researchers: fostering research integrity. PLoS Biol. 18, e3000737 (2020).

ArticlePubMedPubMed CentralGoogle Scholar

Nosek, B. A., Spies, J. R. & Motyl, M. Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspect. Psychol. Sci. 7, 615–631 (2012).

ArticlePubMedPubMed CentralGoogle Scholar

Betz, G. in Current Controversies in Values and Science. (eds Elliott, K. C. & Steel, D.) 94–110 (Routledge, 2017).

Elliott, K. C. A taxonomy of transparency in science. Can. J. Philos. 52, 342–355 (2020).

ArticleGoogle Scholar

Farina, M., Lavazza, A. & Pritchard, D. Expertise: Philosophical Perspectives (Oxford Univ. Press, 2024).

Koppl, R. Expert Failure (Cambridge Univ. Press, 2018).

Neal, T. M. S., Martire, K. A., Johan, J. L., Mathers, E. M. & Otto, R. K. The law meets psychological expertise: eight best practices to improve forensic psychological assessment. Annu. Rev. Law Soc. Sci. 18, 169–192 (2022).

ArticleGoogle Scholar

Oreskes, N. Why Trust Science? (Princeton Univ. Press, 2021).

Chin, J. M. & Ibaviosa, C. M. Beyond CSI: calibrating public beliefs about the reliability of forensic science through openness and transparency. Sci. Justice 62, 272–283 (2022).

ArticlePubMedGoogle Scholar

Weinberg, A. M. Science and trans-science. Science 177, 211 (1972).

ArticlePubMedGoogle Scholar

Walton, D. & Zhang, N. An argumentation interface for expert opinion evidence. Ratio Juris 29, 59–82 (2016).

ArticleGoogle Scholar

Martire, K. A., Edmond, G. & Navarro, D. Exploring juror evaluations of expert opinions using the Expert Persuasion Expectancy framework. Leg. Criminol. Psychol. 25, 90–110 (2020).

ArticleGoogle Scholar

Robson, S. G. et al. People who believe implausible claims are not cognitive misers: evidence from evaluation tasks. J. Appl. Res. Mem. Cogn.https://doi.org/10.1037/mac0000190 (2024).

LaBat, D. E. et al. Improving juror assessments of forensic testimony and its effects on decision-making and evidence evaluation. Law Hum. Behav. 47, 566–578 (2023).

ArticlePubMedGoogle Scholar

Bishop, D. Rein in the four horsemen of irreproducibility. Nature 568, 435 (2019).

ArticlePubMedGoogle Scholar

Ballantyne, K. N., Edmond, G. & Found, B. Peer review in forensic science. Forensic Sci. Int. 277, 66–76 (2017).

ArticlePubMedGoogle Scholar

Carr, S., Piasecki, E. & Gallop, A. Demonstrating reliability through transparency: a scientific validity framework to assist scientists and lawyers in criminal proceedings. Forensic Sci. Int. 308, 110110 (2020).

ArticlePubMedGoogle Scholar

Chin, J. M., Ribeiro, G. & Rairden, A. Open forensic science. J. Law Biosci. 6, 255–288 (2019).

ArticlePubMedPubMed CentralGoogle Scholar

Searston, R. A. & Chin, J. M. The legal and scientific challenge of black box expertise. Univ. Qld Law J. 38, 237–260 (2019).

Google Scholar

Earwaker, H., Nakhaeizadeh, S., Smit, N. M. & Morgan, R. M. A cultural change to enable improved decision-making in forensic science: a six phased approach. Sci. Justice 60, 9–19 (2020).

ArticlePubMedGoogle Scholar

Edmond, G. et al. Model forensic science. Austr. J. Forensic Sci. 48, 496–537 (2016).

ArticleGoogle Scholar

Edmond, G., Carr, S. & Piasecki, E. Science friction: streamlined forensic reporting, reliability and justice. Oxf. J. Leg. Stud. 38, 764–792 (2018).

ArticleGoogle Scholar

Edmond, G., Cunliffe, E., Martire, K. A. & San Roque, M. Forensic science evidence and the limits of cross-examination. Melb. Univ. Law Rev. 42, 858 (2018).

Google Scholar

Gelman, A. & Loken, E. The garden of forking paths: why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time. Dep. Stat. Columbia Univ. 348, 1–17 (2013).

Google Scholar

Georgiou, N., Morgan, R. & French, J. Conceptualising, evaluating and communicating uncertainty in forensic science: identifying commonly used tools through an interdisciplinary configurative review. Sci. Justice 60, 313–336 (2020).

ArticlePubMedGoogle Scholar

Sjerps, M. J. & Berger, C. E. How clear is transparent? Reporting expert reasoning in legal cases. Law Probability Risk 11, 317–329 (2012).

ArticleGoogle Scholar

Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J. & Kievit, R. A. An agenda for purely confirmatory research. Perspect. Psychol. Sci. 7, 632–638 (2012).

ArticlePubMedGoogle Scholar

Chin, J. M., Cullen, H. J. & Clarke, B. The prejudices of expert evidence. Monash Univ. Law Rev. 48, 59–96 (2022).

Google Scholar

Edmond, G. & Roberts, A. in Expert Evidence and Scientific Proof in Criminal Trials (ed Roberts, P.) 533-551 (Routledge, 2017).

Steiner-Dillon, J. R. Epistemic exceptionalism. Indiana Law Rev. 52, 207–256 (2019).

ArticleGoogle Scholar

Dror, I. E. et al. Letter to the editor- context management toolbox: a linear sequential unmasking (LSU) approach for minimizing cognitive bias in forensic decision making. J. Forensic Sci. 60, 1111–1112 (2015).

ArticlePubMedGoogle Scholar

Krane, D. et al. Sequential unmasking: a means of minimizing observer effects in forensic DNA interpretation. J. Forensic Sci. 53, 1006–1007 (2008).

ArticlePubMedGoogle Scholar

Lilienfeld, S. O., Ammirati, R. & Landfield, K. Giving debiasing away: can psychological research on correcting cognitive errors promote human welfare? Perspect. Psychol. Sci. 4, 390–398 (2009).

ArticlePubMedGoogle Scholar

Robertson, C. T. & Kesselheim, A. S. Blinding as a Solution to Bias: Strengthening Biomedical Science, Forensic Science, and Law (Academic, 2016).

Chase, W. G. & Simon, H. A. Perception in chess. Cogn. Psychol. 4, 55–81 (1973).

ArticleGoogle Scholar

Simon, H. A. What is an “Explanation” of behavior? Psychol. Sci. 3, 150–161 (1992).

ArticleGoogle Scholar

Download references

Acknowledgements

During the preparation of this work, the authors used OpenAI ChatGPT4 to harmonize portions of the text. After using this tool, the authors reviewed and edited the content as needed and take full responsibility for the content of the publication.

Author information

Authors and Affiliations

School of Psychology, University of New South Wales, Sydney, New South Wales, Australia

Kristy A. Martire

Department of Psychology, Iowa State University, Ames, IA, USA

Tess M. S. Neal

Centre for Philosophy of Natural and Social Science, The London School of Economics and Political Science, London, UK

Fernand Gobet

College of Law, Australian National University, Canberra, Australian Capital Territory, Australia

Jason M. Chin

School of Biomedical Sciences, University of New South Wales, Sydney, New South Wales, Australia

Jonathan F. Berengut

School of Law, Society and Criminology, University of New South Wales, Sydney, New South Wales, Australia

Gary Edmond

Authors

Kristy A. Martire

View author publications

You can also search for this author in PubMedGoogle Scholar

2. Tess M. S. Neal

View author publications

You can also search for this author in PubMedGoogle Scholar

3. Fernand Gobet

View author publications

You can also search for this author in PubMedGoogle Scholar

4. Jason M. Chin

View author publications

You can also search for this author in PubMedGoogle Scholar

5. Jonathan F. Berengut

View author publications

You can also search for this author in PubMedGoogle Scholar

6. Gary Edmond

View author publications

You can also search for this author in PubMedGoogle Scholar

Contributions

K.A.M., T.M.S.N., F.G., J.M.C. and J.F.B. researched data for the article. All authors contributed substantially to discussion of the content. K.A.M., T.M.S.N., F.G., J.M.C. and G.E. wrote the article. K.A.M., T.M.S.N., F.G., J.M.C. and G.E. reviewed and/or edited the manuscript before submission.

Corresponding author

Correspondence to Kristy A. Martire.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Reviews Psychology thanks Daniel Krauss and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martire, K.A., Neal, T.M.S., Gobet, F. et al. Psychological insights for judging expertise and implications for adversarial legal contexts. Nat Rev Psychol (2025). https://doi.org/10.1038/s44159-025-00430-4

Download citation

Accepted:13 February 2025

Published:17 March 2025

DOI:https://doi.org/10.1038/s44159-025-00430-4

Share this article

Anyone you share the following link with will be able to read this content:

Get shareable link

Sorry, a shareable link is not currently available for this article.

Copy to clipboard

Provided by the Springer Nature SharedIt content-sharing initiative

Read full news in source page