User login
Mrs. M, age 27, suffered a head injury in a motor vehicle accident 9 months ago. She is referred to you by a neurologist with complaints of persistent headache and diffculties with memory and attention “worse now than right after the accident.” She tried to return to work 3 months after the accident but could not concentrate enough to be productive.
Review of medical records shows that she had minimal, if any, loss of consciousness at the accident scene, and she followed commands at the emergency room without apparent difficulty. Neurologic exam and head CT were normal. She is cooperative and fully oriented but appears upset about the difficulties she has experienced and occasionally complains of headache.
Three days later you receive a signed release of information from her attorney, requesting all records related to her examination.
In cases such as Mrs. M’s, the differential diagnosis often comes down to a somatoform disorder vs factitious disorder vs malingering, a decision that rarely seems as clear-cut as one might believe when reading the DSM-IV-TR. Particularly in litigation- or compensation-related situations, clinicians must make 2 fundamental judgments:
- Is the patient intentionally generating the symptoms?
- Are the symptoms plausibly related to neurologic injury or illness?
This article describes how symptom validity testing (SVT) as part of a comprehensive neuropsychological evaluation can help answer these questions. Inconsistencies in the way patients perform on SVT (Table)18-30 can provide “red flags” to possible embellishment of neurocognitive symptoms. We also offer recently developed guidelines for diagnosing malingering of neurocognitive dysfunction that may be more helpful than the DSM-IV-TR criteria.
Table
Performance consistencies in patients
who fail symptom validity testing (SVT)
| Consistency | Comment |
|---|---|
| 25% to 40% of patients seeking some form compensation for their injuries or illness fail SVT | This appears to hold true not only for ‘brain’ cases but also for ‘pain’ cases |
| Deficits are not exaggerated in a constant manner across tests of different abilities | Deficits most likely to be exaggerated are concentration, memory, weakness, and processing speed; may be due to assumptions about what ‘brain damage’ looks like |
| Patients failing SVT report greater levels of emotional distress, psychological maladjustment, and severity of neurocognitive difficulties on self-report measures | Patterns of exaggerated responses are not the same as those exaggerating psychopathology |
| Very few patients who fail SVT score significantly below chance | Below-chance responding is an insensitive criterion for identifying suboptimal effort, but this level of performance is quite specific; short of confession, below-chance performance on SVT is closest to an evidentiary ‘gold standard’ for malingering |
| Not all SVTs are created equal | Sensitivity and specificity vary, and measures may disagree when more than one is administered |
| Coaching makes a difference | Malingering subjects who are told which tests to look for and how to approach them are more difficult to discriminate from genuine patients |
| Invalid effort does not rule out a genuine neurologic injury or illness | Exaggeration can coexist with neurologically driven neurocognitive deficits; neuropsychologists who do forensic work encounter patients with documented injuries who fail SVT, sometimes in blatantly obvious or absurd ways |
| Source: References 1-13 | |
Why ‘gut feelings’ are fallible
Differential diagnosis of neurocognitive impairment is challenging. Some patients have normal neurologic examinations in all respects but cognition, such as those with early Alzheimer’s disease or recent concussion. Others may show significant neurobehavioral changes but normal results on neuroimaging (such as the rare patient in a coma after a traumatic brain injury whose head CT is read as normal). Thus, the absence of findings other than impaired cognition in a neurologic exam is not proof that a disorder is driven primarily by psychiatric or behavioral issues.
- rely on their training and intuition
- refer for psychological evaluation
- rely on traditional malingering measures in standard psychological tests, such as the Minnesota Multiphasic Personality Inventory-2 (MMPI-2).
The problem with this approach is its high error rate. Health care professionals do not discriminate poor effort from genuine neurocognitive impairment very effectively. Diagnostic algorithms routinely outperform clinical judgment, particularly when diagnostic parameters are relatively well understood.19
Although discerning conscious intent often remains more art than science, neuropsychologists have developed cross-validated techniques to identify implausible cognitive performances that suggest embellished symptoms. Thus, relying on clinical judgment is accepting an error rate that can be reduced by using other approaches.
‘Let the psychologist figure it out.’ The success of this approach depends on the psychologist’s methodology. The psychologist’s gut instinct is no more accurate than that of the psychiatrist or neurologist.
Relying on traditional scales. Measures of malingering in psychological testing can be quite effective for identifying exaggerated psychopathology,20-22 but exaggerated psychopathology differs from exaggerated neurocognitive symptoms.23 Embellished psychopathology is not the same as embellished “brain damage,” and they are not detected equally well by the same techniques.
Validity scales on the MMPI and MMPI-2 do a poor job of detecting patients known to be exaggerating neurocognitive impairment23 (although the more recently developed Lees-Haley “Fake Bad Scale” has shown promise).24 Thus, the clinician who feels confident that a patient has not exaggerated neurocognitive complaints because he or she scored in the normal range on the MMPI-2 validity scales (or other measures shown to help identify exaggeration of psychopathology) has drawn a conclusion based on scales that likely are inadequate for this purpose.
3 ways to measure patient effort
Using SVT is the most effective way to determine the validity of a patient’s effort on a neuropsychological test battery. SVT using 3 approaches has been shown to reliably discriminate patients who are putting forth valid effort from those who are not:
- forced-choice testing
- unusual patterns of responses within established neurocognitive tests
- unusual patterns of variability on the same test given on different occasions.
On some validated forced-choice SVTs, patients with moderate to severe traumatic brain injuries perform at ≥90% accuracy; thus, a far lower performance from a mildly injured patient raises a red flag that some-thing exceptional is occurring that demands an explanation.
Patterns within established tests. As empiric evidence about SVTs grows, we understand more about how neurologically impaired patients perform—and do not perform—on these tests. These patterns can then be used to examine the extent to which they discriminate between patients who are exaggerating and those who are not. Cross-validated techniques are available for the Wechsler Adult Intelligence Scale, 3rd edition, and the California Verbal Learning Test, among others.25,26
Patterns across different evaluations. Variation in test results is expected when a patient takes the same test on different dates. Along with having previously seen the test, other patient factors may include fatigue or inattention. When a patient is recovering from a brain injury or illness, additional variation is expected because of recovery or progression over time.
Some abilities—and test scores—are more stable than others, however, even in patients with genuine neurologic damage. At least one method that analyzes data from different administrations of the Halstead Reitan Neuropsychological Battery uses this insight,27 although this method has yet to be cross-validated.
What have we learned?
Cross-validated techniques have demonstrated that effort has a significant effect on neurocognitive test scores, often greater than the effect of the neurologic condition being studied.28,29 For example, you will be more accurate predicting a patient’s overall performance on a neuropsychological test battery on the basis of their performance on the Word Memory Test (one type of SVT) than on how long he or she was in a coma after a head injury until the coma has persisted for >6 days.30
SVTs are not ‘malingering tests.’ A malingering patient simulates or exaggerates symptoms with the conscious intention of deceiving someone. An SVT does a good job identifying exaggerated symptoms, but it has little (and, in most cases, nothing) to say about the extent to which this exaggeration is conscious or intentional.
For instance, patients with somatoform disorders tend to fail SVT at a higher rate than general medical populations.6,31 Our group32 recently reported that approximately one-half of patients diagnosed with psychogenic nonepileptic seizures at an epilepsy center fail SVTs. It is unlikely, however, that all—or even most—of these patients were malingering.
SVTs do not reveal motivation or intention—they merely state the extent to which the effort put into testing provides a valid estimate of neurocognitive function.
Alternative guidelines have been suggested to guide decisions about when to diagnose a patient as malingering neurocognitive deficits.33 See the original publication for a full explication of the criteria.
Clinical recommendations
Particularly when someone with a mild brain injury is seeking compensation, keep in mind that 25% to 40% of these patients perform in such a way on SVT that the validity of their cognitive performances should be questioned. It does not necessarily mean they are malingering; rather, they are performing in a way that cannot be explained by established brain-behavior relationships in the absence of obvious severe neurologic injury or illness.
Ask for SVT when you refer cases such as this for neuropsychological or psychological evaluation. SVT can provide an empirically based foundation on which to formulate an opinion, particularly about the severity of reported cognitive symptoms. Your opinion about the intentionality of symptoms likely will rely primarily on other information (such as the consistency of complaints with behavior during the assessment or presence of primary or secondary gain), but SVT provides a valuable tool with which to examine the validity of cognitive complaints.
Related resources
- Slick DJ, Sherman EMS, Iverson GL. Diagnostic criteria for malingering cognitive dysfunction: proposed standards for clinical practice and research. Clin Neuropsychol 1999;13:545-61.
- National Academy of Neuropsychology. Position paper: Symptom validity testing: practice issues and medical necessity. http://nanonline.org/paio/svt.shtm.
The author reports no financial relationship with any company whose products are mentioned in this article or with manufacturers of competing products.
1. Bianchini KJ, Greve KW, Glynn G. On the diagnosis of malingered pain-related disability: lessons from cognitive malingering research. Spine 2005;5:404-17.
2. Gervais RO, Green P, Allen LM, Iverson GL. Effects of coaching on symptom validity testing in chronic pain patients presenting for disability assessments. J Forensic Neuropsychol 2001;2:1.-
3. Meyers JE, Diep A. Assessment of malingering in chronic pain patients using neuropsychological tests. Applied Neuropsychol 2000;7:133-9.
4. Williamson DJ, Rohling ML, Green P, Allen L. Evaluating effort with the Word Memory Test and Category Test–or not: inconsistencies in a forensic sample. J Forensic Neuropsychol 2003;3:19-44.
5. Gouvier WD, Prestholdt P, Warner M. A survey of common misperceptions about head injury and recovery. Arch Clin Neuropsychology 1988;3:331-43.
6. Boone KB, Lu P. Impact of somatoform symptomatology on credibility of cognitive performance. Clin Neuropsychol 1999;13:414-9.
7. Greiffenstein MF, Baker WJ, Axelrod BN, et al. The Fake Bad Scale and MMPI-2 F-family in detection of implausible psychological trauma claims. Clin Neuropsychol 2004;18:573-90.
8. Larrabee GJ. Detection of symptom exaggeration with the MMPI-2 in litigants with malingered neurocognitive dysfunction. Clin Neuropsychol 2003;17:54.-
9. Tan JE, Slick DJ, Strauss E, Hultsch DF. How’d they do it? Malingering strategies on symptom validity tests. Clin Neuropsychol 2002;16:495.-
10. Iverson GL, Binder LM. Detecting exaggeration and malingering in neuropsychological assessment. J Head Trauma Rehabil 2000;15:829-58.
11. Sweet JJ. Malingering: differential diagnosis. In: Sweet JJ, ed. Forensic neuropsychology: fundamentals and practice. New York: Swets & Zeitlinger, 1999:255-85.
12. Coleman RD, Rapport LJ, Millis SR, et al. Effects of coaching on detection of malingering on the California Verbal Learning Test. J Clin Exp Neuropsychol 1998;20:201.-
13. Rapport LJ, Farchione TJ, Coleman RD, Axelrod BN. Effects of coaching on malingered motor function profiles. J Clin Exp Neuropsychol 1998;20:89-97.
14. Carone DA, Benedict RHB, Munschauer FE, et al. Interpreting patient/informant discrepancies of reported cognitive symptoms in MS. J Int Neuropsychol Soc 2005;11:574.-
15. Meador KJ, Loring DW, Vahle VJ, et al. Subjective perception of cognitive effects of antiepileptic drugs is more related to mood than to objective performance. Epilepsia 2005;46:261-2.
16. Sawrie SM, Martin RC, Kuzniecky R, et al. Subjective versus objective memory change after temporal lobe epilepsy surgery. Neurology 1999;53:1511.-
17. Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA 2006;296:1094-102.
18. Faust D. The detection of deception. Neurol Clin 1995;13:255-65.
19. Swets JA, Dawes RM, Monahan J. Psychological science can improve diagnostic decisions. Psychol Sci Public Interest 2000;1:1-26.
20. Knoll J, Resnick PJ. The detection of malingered post-traumatic stress disorder. Psychiatr Clin North Am 2006;29:629-47.
21. Morey LC, Lanier VW. Operating characteristics of six response distortion indicators for the Personality Assessment Inventory. Assessment 1998;5:203-14.
22. Rogers R, Sewell KW, Salekin RT. A meta-analysis of malingering on the MMPI-2. Assessment 1994;1:227-37.
23. Larrabee GJ. Somatic malingering on the MMPI and MMPI-2 in personal injury litigants. Clin Neuropsychol 1998;12:179.-
24. Nelson NW, Sweet JJ, Demakis GJ. Meta-analysis of the MMPI-2 Fake Bad Scale: utility in forensic practice. Clin Neuropsychol 2006;20:39-58.
25. Curtis KL, Greve KW, Bianchini KJ, Brennan A. California Verbal Learning Test indicators of malingered neurocognitive dysfunction: sensitivity and specificity in traumatic brain injury. Assessment 2006;13:46.-
26. Greve KW, Bianchini KJ, Mathias CW, et al. Detecting malingered performance on the Wechsler Adult Intelligence Scale: validation of Mittenberg’s approach in traumatic brain injury. Arch Clin Neuropsychol 2003;18:245.-
27. Reitan RM, Wolfson D. The question of validity of neuropsychological test scores among head-injured litigants: development of a dissimulation index. Arch Clin Neuropsychology 1996;11:573-80.
28. Green P, Lees-Haley PR, Allen LM. The Word Memory Test and the validity of neuropsychological test scores. J Forensic Neuropsychol 2002;2:97.-
29. Vickery CD, Berry DTR, Hanlon IT, et al. Detection of inadequate effort on neuropsychological testing: a meta-analytic review of selected procedures. Arch Clin Neuropsychology 2002;16:45-73.
30. Iverson GL, Viljoen JL. Practical and ethical issues regarding assessment of exaggeration, poor effort, and malingering in neuropsychology. Presented at First International Conference of Symptom, Diagnostic, and Disability Validity, 2002 Toronto, Ontario, Canada.
31. Mittenberg W, Patton C, Canyock EM, Condit DC. Base rates of malingering and symptom exaggeration. J Clin Exp Neuropsychol 2002;24:1094.-
32. Drane DL, Williamson DJ, Stroup ES, et al. Cognitive impairment is not equal in patients with epileptic and psychogenic nonepileptic seizures. Epilepsia 2006;47(11):1879-86.
33. Slick DJ, Sherman EMS, Iverson GL. Diagnostic criteria for malingering cognitive dysfunction: proposed standards for clinical practice and research. Clin Neuropsychol 1999;13:545-61.
Mrs. M, age 27, suffered a head injury in a motor vehicle accident 9 months ago. She is referred to you by a neurologist with complaints of persistent headache and diffculties with memory and attention “worse now than right after the accident.” She tried to return to work 3 months after the accident but could not concentrate enough to be productive.
Review of medical records shows that she had minimal, if any, loss of consciousness at the accident scene, and she followed commands at the emergency room without apparent difficulty. Neurologic exam and head CT were normal. She is cooperative and fully oriented but appears upset about the difficulties she has experienced and occasionally complains of headache.
Three days later you receive a signed release of information from her attorney, requesting all records related to her examination.
In cases such as Mrs. M’s, the differential diagnosis often comes down to a somatoform disorder vs factitious disorder vs malingering, a decision that rarely seems as clear-cut as one might believe when reading the DSM-IV-TR. Particularly in litigation- or compensation-related situations, clinicians must make 2 fundamental judgments:
- Is the patient intentionally generating the symptoms?
- Are the symptoms plausibly related to neurologic injury or illness?
This article describes how symptom validity testing (SVT) as part of a comprehensive neuropsychological evaluation can help answer these questions. Inconsistencies in the way patients perform on SVT (Table)18-30 can provide “red flags” to possible embellishment of neurocognitive symptoms. We also offer recently developed guidelines for diagnosing malingering of neurocognitive dysfunction that may be more helpful than the DSM-IV-TR criteria.
Table
Performance consistencies in patients
who fail symptom validity testing (SVT)
| Consistency | Comment |
|---|---|
| 25% to 40% of patients seeking some form compensation for their injuries or illness fail SVT | This appears to hold true not only for ‘brain’ cases but also for ‘pain’ cases |
| Deficits are not exaggerated in a constant manner across tests of different abilities | Deficits most likely to be exaggerated are concentration, memory, weakness, and processing speed; may be due to assumptions about what ‘brain damage’ looks like |
| Patients failing SVT report greater levels of emotional distress, psychological maladjustment, and severity of neurocognitive difficulties on self-report measures | Patterns of exaggerated responses are not the same as those exaggerating psychopathology |
| Very few patients who fail SVT score significantly below chance | Below-chance responding is an insensitive criterion for identifying suboptimal effort, but this level of performance is quite specific; short of confession, below-chance performance on SVT is closest to an evidentiary ‘gold standard’ for malingering |
| Not all SVTs are created equal | Sensitivity and specificity vary, and measures may disagree when more than one is administered |
| Coaching makes a difference | Malingering subjects who are told which tests to look for and how to approach them are more difficult to discriminate from genuine patients |
| Invalid effort does not rule out a genuine neurologic injury or illness | Exaggeration can coexist with neurologically driven neurocognitive deficits; neuropsychologists who do forensic work encounter patients with documented injuries who fail SVT, sometimes in blatantly obvious or absurd ways |
| Source: References 1-13 | |
Why ‘gut feelings’ are fallible
Differential diagnosis of neurocognitive impairment is challenging. Some patients have normal neurologic examinations in all respects but cognition, such as those with early Alzheimer’s disease or recent concussion. Others may show significant neurobehavioral changes but normal results on neuroimaging (such as the rare patient in a coma after a traumatic brain injury whose head CT is read as normal). Thus, the absence of findings other than impaired cognition in a neurologic exam is not proof that a disorder is driven primarily by psychiatric or behavioral issues.
- rely on their training and intuition
- refer for psychological evaluation
- rely on traditional malingering measures in standard psychological tests, such as the Minnesota Multiphasic Personality Inventory-2 (MMPI-2).
The problem with this approach is its high error rate. Health care professionals do not discriminate poor effort from genuine neurocognitive impairment very effectively. Diagnostic algorithms routinely outperform clinical judgment, particularly when diagnostic parameters are relatively well understood.19
Although discerning conscious intent often remains more art than science, neuropsychologists have developed cross-validated techniques to identify implausible cognitive performances that suggest embellished symptoms. Thus, relying on clinical judgment is accepting an error rate that can be reduced by using other approaches.
‘Let the psychologist figure it out.’ The success of this approach depends on the psychologist’s methodology. The psychologist’s gut instinct is no more accurate than that of the psychiatrist or neurologist.
Relying on traditional scales. Measures of malingering in psychological testing can be quite effective for identifying exaggerated psychopathology,20-22 but exaggerated psychopathology differs from exaggerated neurocognitive symptoms.23 Embellished psychopathology is not the same as embellished “brain damage,” and they are not detected equally well by the same techniques.
Validity scales on the MMPI and MMPI-2 do a poor job of detecting patients known to be exaggerating neurocognitive impairment23 (although the more recently developed Lees-Haley “Fake Bad Scale” has shown promise).24 Thus, the clinician who feels confident that a patient has not exaggerated neurocognitive complaints because he or she scored in the normal range on the MMPI-2 validity scales (or other measures shown to help identify exaggeration of psychopathology) has drawn a conclusion based on scales that likely are inadequate for this purpose.
3 ways to measure patient effort
Using SVT is the most effective way to determine the validity of a patient’s effort on a neuropsychological test battery. SVT using 3 approaches has been shown to reliably discriminate patients who are putting forth valid effort from those who are not:
- forced-choice testing
- unusual patterns of responses within established neurocognitive tests
- unusual patterns of variability on the same test given on different occasions.
On some validated forced-choice SVTs, patients with moderate to severe traumatic brain injuries perform at ≥90% accuracy; thus, a far lower performance from a mildly injured patient raises a red flag that some-thing exceptional is occurring that demands an explanation.
Patterns within established tests. As empiric evidence about SVTs grows, we understand more about how neurologically impaired patients perform—and do not perform—on these tests. These patterns can then be used to examine the extent to which they discriminate between patients who are exaggerating and those who are not. Cross-validated techniques are available for the Wechsler Adult Intelligence Scale, 3rd edition, and the California Verbal Learning Test, among others.25,26
Patterns across different evaluations. Variation in test results is expected when a patient takes the same test on different dates. Along with having previously seen the test, other patient factors may include fatigue or inattention. When a patient is recovering from a brain injury or illness, additional variation is expected because of recovery or progression over time.
Some abilities—and test scores—are more stable than others, however, even in patients with genuine neurologic damage. At least one method that analyzes data from different administrations of the Halstead Reitan Neuropsychological Battery uses this insight,27 although this method has yet to be cross-validated.
What have we learned?
Cross-validated techniques have demonstrated that effort has a significant effect on neurocognitive test scores, often greater than the effect of the neurologic condition being studied.28,29 For example, you will be more accurate predicting a patient’s overall performance on a neuropsychological test battery on the basis of their performance on the Word Memory Test (one type of SVT) than on how long he or she was in a coma after a head injury until the coma has persisted for >6 days.30
SVTs are not ‘malingering tests.’ A malingering patient simulates or exaggerates symptoms with the conscious intention of deceiving someone. An SVT does a good job identifying exaggerated symptoms, but it has little (and, in most cases, nothing) to say about the extent to which this exaggeration is conscious or intentional.
For instance, patients with somatoform disorders tend to fail SVT at a higher rate than general medical populations.6,31 Our group32 recently reported that approximately one-half of patients diagnosed with psychogenic nonepileptic seizures at an epilepsy center fail SVTs. It is unlikely, however, that all—or even most—of these patients were malingering.
SVTs do not reveal motivation or intention—they merely state the extent to which the effort put into testing provides a valid estimate of neurocognitive function.
Alternative guidelines have been suggested to guide decisions about when to diagnose a patient as malingering neurocognitive deficits.33 See the original publication for a full explication of the criteria.
Clinical recommendations
Particularly when someone with a mild brain injury is seeking compensation, keep in mind that 25% to 40% of these patients perform in such a way on SVT that the validity of their cognitive performances should be questioned. It does not necessarily mean they are malingering; rather, they are performing in a way that cannot be explained by established brain-behavior relationships in the absence of obvious severe neurologic injury or illness.
Ask for SVT when you refer cases such as this for neuropsychological or psychological evaluation. SVT can provide an empirically based foundation on which to formulate an opinion, particularly about the severity of reported cognitive symptoms. Your opinion about the intentionality of symptoms likely will rely primarily on other information (such as the consistency of complaints with behavior during the assessment or presence of primary or secondary gain), but SVT provides a valuable tool with which to examine the validity of cognitive complaints.
Related resources
- Slick DJ, Sherman EMS, Iverson GL. Diagnostic criteria for malingering cognitive dysfunction: proposed standards for clinical practice and research. Clin Neuropsychol 1999;13:545-61.
- National Academy of Neuropsychology. Position paper: Symptom validity testing: practice issues and medical necessity. http://nanonline.org/paio/svt.shtm.
The author reports no financial relationship with any company whose products are mentioned in this article or with manufacturers of competing products.
Mrs. M, age 27, suffered a head injury in a motor vehicle accident 9 months ago. She is referred to you by a neurologist with complaints of persistent headache and diffculties with memory and attention “worse now than right after the accident.” She tried to return to work 3 months after the accident but could not concentrate enough to be productive.
Review of medical records shows that she had minimal, if any, loss of consciousness at the accident scene, and she followed commands at the emergency room without apparent difficulty. Neurologic exam and head CT were normal. She is cooperative and fully oriented but appears upset about the difficulties she has experienced and occasionally complains of headache.
Three days later you receive a signed release of information from her attorney, requesting all records related to her examination.
In cases such as Mrs. M’s, the differential diagnosis often comes down to a somatoform disorder vs factitious disorder vs malingering, a decision that rarely seems as clear-cut as one might believe when reading the DSM-IV-TR. Particularly in litigation- or compensation-related situations, clinicians must make 2 fundamental judgments:
- Is the patient intentionally generating the symptoms?
- Are the symptoms plausibly related to neurologic injury or illness?
This article describes how symptom validity testing (SVT) as part of a comprehensive neuropsychological evaluation can help answer these questions. Inconsistencies in the way patients perform on SVT (Table)18-30 can provide “red flags” to possible embellishment of neurocognitive symptoms. We also offer recently developed guidelines for diagnosing malingering of neurocognitive dysfunction that may be more helpful than the DSM-IV-TR criteria.
Table
Performance consistencies in patients
who fail symptom validity testing (SVT)
| Consistency | Comment |
|---|---|
| 25% to 40% of patients seeking some form compensation for their injuries or illness fail SVT | This appears to hold true not only for ‘brain’ cases but also for ‘pain’ cases |
| Deficits are not exaggerated in a constant manner across tests of different abilities | Deficits most likely to be exaggerated are concentration, memory, weakness, and processing speed; may be due to assumptions about what ‘brain damage’ looks like |
| Patients failing SVT report greater levels of emotional distress, psychological maladjustment, and severity of neurocognitive difficulties on self-report measures | Patterns of exaggerated responses are not the same as those exaggerating psychopathology |
| Very few patients who fail SVT score significantly below chance | Below-chance responding is an insensitive criterion for identifying suboptimal effort, but this level of performance is quite specific; short of confession, below-chance performance on SVT is closest to an evidentiary ‘gold standard’ for malingering |
| Not all SVTs are created equal | Sensitivity and specificity vary, and measures may disagree when more than one is administered |
| Coaching makes a difference | Malingering subjects who are told which tests to look for and how to approach them are more difficult to discriminate from genuine patients |
| Invalid effort does not rule out a genuine neurologic injury or illness | Exaggeration can coexist with neurologically driven neurocognitive deficits; neuropsychologists who do forensic work encounter patients with documented injuries who fail SVT, sometimes in blatantly obvious or absurd ways |
| Source: References 1-13 | |
Why ‘gut feelings’ are fallible
Differential diagnosis of neurocognitive impairment is challenging. Some patients have normal neurologic examinations in all respects but cognition, such as those with early Alzheimer’s disease or recent concussion. Others may show significant neurobehavioral changes but normal results on neuroimaging (such as the rare patient in a coma after a traumatic brain injury whose head CT is read as normal). Thus, the absence of findings other than impaired cognition in a neurologic exam is not proof that a disorder is driven primarily by psychiatric or behavioral issues.
- rely on their training and intuition
- refer for psychological evaluation
- rely on traditional malingering measures in standard psychological tests, such as the Minnesota Multiphasic Personality Inventory-2 (MMPI-2).
The problem with this approach is its high error rate. Health care professionals do not discriminate poor effort from genuine neurocognitive impairment very effectively. Diagnostic algorithms routinely outperform clinical judgment, particularly when diagnostic parameters are relatively well understood.19
Although discerning conscious intent often remains more art than science, neuropsychologists have developed cross-validated techniques to identify implausible cognitive performances that suggest embellished symptoms. Thus, relying on clinical judgment is accepting an error rate that can be reduced by using other approaches.
‘Let the psychologist figure it out.’ The success of this approach depends on the psychologist’s methodology. The psychologist’s gut instinct is no more accurate than that of the psychiatrist or neurologist.
Relying on traditional scales. Measures of malingering in psychological testing can be quite effective for identifying exaggerated psychopathology,20-22 but exaggerated psychopathology differs from exaggerated neurocognitive symptoms.23 Embellished psychopathology is not the same as embellished “brain damage,” and they are not detected equally well by the same techniques.
Validity scales on the MMPI and MMPI-2 do a poor job of detecting patients known to be exaggerating neurocognitive impairment23 (although the more recently developed Lees-Haley “Fake Bad Scale” has shown promise).24 Thus, the clinician who feels confident that a patient has not exaggerated neurocognitive complaints because he or she scored in the normal range on the MMPI-2 validity scales (or other measures shown to help identify exaggeration of psychopathology) has drawn a conclusion based on scales that likely are inadequate for this purpose.
3 ways to measure patient effort
Using SVT is the most effective way to determine the validity of a patient’s effort on a neuropsychological test battery. SVT using 3 approaches has been shown to reliably discriminate patients who are putting forth valid effort from those who are not:
- forced-choice testing
- unusual patterns of responses within established neurocognitive tests
- unusual patterns of variability on the same test given on different occasions.
On some validated forced-choice SVTs, patients with moderate to severe traumatic brain injuries perform at ≥90% accuracy; thus, a far lower performance from a mildly injured patient raises a red flag that some-thing exceptional is occurring that demands an explanation.
Patterns within established tests. As empiric evidence about SVTs grows, we understand more about how neurologically impaired patients perform—and do not perform—on these tests. These patterns can then be used to examine the extent to which they discriminate between patients who are exaggerating and those who are not. Cross-validated techniques are available for the Wechsler Adult Intelligence Scale, 3rd edition, and the California Verbal Learning Test, among others.25,26
Patterns across different evaluations. Variation in test results is expected when a patient takes the same test on different dates. Along with having previously seen the test, other patient factors may include fatigue or inattention. When a patient is recovering from a brain injury or illness, additional variation is expected because of recovery or progression over time.
Some abilities—and test scores—are more stable than others, however, even in patients with genuine neurologic damage. At least one method that analyzes data from different administrations of the Halstead Reitan Neuropsychological Battery uses this insight,27 although this method has yet to be cross-validated.
What have we learned?
Cross-validated techniques have demonstrated that effort has a significant effect on neurocognitive test scores, often greater than the effect of the neurologic condition being studied.28,29 For example, you will be more accurate predicting a patient’s overall performance on a neuropsychological test battery on the basis of their performance on the Word Memory Test (one type of SVT) than on how long he or she was in a coma after a head injury until the coma has persisted for >6 days.30
SVTs are not ‘malingering tests.’ A malingering patient simulates or exaggerates symptoms with the conscious intention of deceiving someone. An SVT does a good job identifying exaggerated symptoms, but it has little (and, in most cases, nothing) to say about the extent to which this exaggeration is conscious or intentional.
For instance, patients with somatoform disorders tend to fail SVT at a higher rate than general medical populations.6,31 Our group32 recently reported that approximately one-half of patients diagnosed with psychogenic nonepileptic seizures at an epilepsy center fail SVTs. It is unlikely, however, that all—or even most—of these patients were malingering.
SVTs do not reveal motivation or intention—they merely state the extent to which the effort put into testing provides a valid estimate of neurocognitive function.
Alternative guidelines have been suggested to guide decisions about when to diagnose a patient as malingering neurocognitive deficits.33 See the original publication for a full explication of the criteria.
Clinical recommendations
Particularly when someone with a mild brain injury is seeking compensation, keep in mind that 25% to 40% of these patients perform in such a way on SVT that the validity of their cognitive performances should be questioned. It does not necessarily mean they are malingering; rather, they are performing in a way that cannot be explained by established brain-behavior relationships in the absence of obvious severe neurologic injury or illness.
Ask for SVT when you refer cases such as this for neuropsychological or psychological evaluation. SVT can provide an empirically based foundation on which to formulate an opinion, particularly about the severity of reported cognitive symptoms. Your opinion about the intentionality of symptoms likely will rely primarily on other information (such as the consistency of complaints with behavior during the assessment or presence of primary or secondary gain), but SVT provides a valuable tool with which to examine the validity of cognitive complaints.
Related resources
- Slick DJ, Sherman EMS, Iverson GL. Diagnostic criteria for malingering cognitive dysfunction: proposed standards for clinical practice and research. Clin Neuropsychol 1999;13:545-61.
- National Academy of Neuropsychology. Position paper: Symptom validity testing: practice issues and medical necessity. http://nanonline.org/paio/svt.shtm.
The author reports no financial relationship with any company whose products are mentioned in this article or with manufacturers of competing products.
1. Bianchini KJ, Greve KW, Glynn G. On the diagnosis of malingered pain-related disability: lessons from cognitive malingering research. Spine 2005;5:404-17.
2. Gervais RO, Green P, Allen LM, Iverson GL. Effects of coaching on symptom validity testing in chronic pain patients presenting for disability assessments. J Forensic Neuropsychol 2001;2:1.-
3. Meyers JE, Diep A. Assessment of malingering in chronic pain patients using neuropsychological tests. Applied Neuropsychol 2000;7:133-9.
4. Williamson DJ, Rohling ML, Green P, Allen L. Evaluating effort with the Word Memory Test and Category Test–or not: inconsistencies in a forensic sample. J Forensic Neuropsychol 2003;3:19-44.
5. Gouvier WD, Prestholdt P, Warner M. A survey of common misperceptions about head injury and recovery. Arch Clin Neuropsychology 1988;3:331-43.
6. Boone KB, Lu P. Impact of somatoform symptomatology on credibility of cognitive performance. Clin Neuropsychol 1999;13:414-9.
7. Greiffenstein MF, Baker WJ, Axelrod BN, et al. The Fake Bad Scale and MMPI-2 F-family in detection of implausible psychological trauma claims. Clin Neuropsychol 2004;18:573-90.
8. Larrabee GJ. Detection of symptom exaggeration with the MMPI-2 in litigants with malingered neurocognitive dysfunction. Clin Neuropsychol 2003;17:54.-
9. Tan JE, Slick DJ, Strauss E, Hultsch DF. How’d they do it? Malingering strategies on symptom validity tests. Clin Neuropsychol 2002;16:495.-
10. Iverson GL, Binder LM. Detecting exaggeration and malingering in neuropsychological assessment. J Head Trauma Rehabil 2000;15:829-58.
11. Sweet JJ. Malingering: differential diagnosis. In: Sweet JJ, ed. Forensic neuropsychology: fundamentals and practice. New York: Swets & Zeitlinger, 1999:255-85.
12. Coleman RD, Rapport LJ, Millis SR, et al. Effects of coaching on detection of malingering on the California Verbal Learning Test. J Clin Exp Neuropsychol 1998;20:201.-
13. Rapport LJ, Farchione TJ, Coleman RD, Axelrod BN. Effects of coaching on malingered motor function profiles. J Clin Exp Neuropsychol 1998;20:89-97.
14. Carone DA, Benedict RHB, Munschauer FE, et al. Interpreting patient/informant discrepancies of reported cognitive symptoms in MS. J Int Neuropsychol Soc 2005;11:574.-
15. Meador KJ, Loring DW, Vahle VJ, et al. Subjective perception of cognitive effects of antiepileptic drugs is more related to mood than to objective performance. Epilepsia 2005;46:261-2.
16. Sawrie SM, Martin RC, Kuzniecky R, et al. Subjective versus objective memory change after temporal lobe epilepsy surgery. Neurology 1999;53:1511.-
17. Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA 2006;296:1094-102.
18. Faust D. The detection of deception. Neurol Clin 1995;13:255-65.
19. Swets JA, Dawes RM, Monahan J. Psychological science can improve diagnostic decisions. Psychol Sci Public Interest 2000;1:1-26.
20. Knoll J, Resnick PJ. The detection of malingered post-traumatic stress disorder. Psychiatr Clin North Am 2006;29:629-47.
21. Morey LC, Lanier VW. Operating characteristics of six response distortion indicators for the Personality Assessment Inventory. Assessment 1998;5:203-14.
22. Rogers R, Sewell KW, Salekin RT. A meta-analysis of malingering on the MMPI-2. Assessment 1994;1:227-37.
23. Larrabee GJ. Somatic malingering on the MMPI and MMPI-2 in personal injury litigants. Clin Neuropsychol 1998;12:179.-
24. Nelson NW, Sweet JJ, Demakis GJ. Meta-analysis of the MMPI-2 Fake Bad Scale: utility in forensic practice. Clin Neuropsychol 2006;20:39-58.
25. Curtis KL, Greve KW, Bianchini KJ, Brennan A. California Verbal Learning Test indicators of malingered neurocognitive dysfunction: sensitivity and specificity in traumatic brain injury. Assessment 2006;13:46.-
26. Greve KW, Bianchini KJ, Mathias CW, et al. Detecting malingered performance on the Wechsler Adult Intelligence Scale: validation of Mittenberg’s approach in traumatic brain injury. Arch Clin Neuropsychol 2003;18:245.-
27. Reitan RM, Wolfson D. The question of validity of neuropsychological test scores among head-injured litigants: development of a dissimulation index. Arch Clin Neuropsychology 1996;11:573-80.
28. Green P, Lees-Haley PR, Allen LM. The Word Memory Test and the validity of neuropsychological test scores. J Forensic Neuropsychol 2002;2:97.-
29. Vickery CD, Berry DTR, Hanlon IT, et al. Detection of inadequate effort on neuropsychological testing: a meta-analytic review of selected procedures. Arch Clin Neuropsychology 2002;16:45-73.
30. Iverson GL, Viljoen JL. Practical and ethical issues regarding assessment of exaggeration, poor effort, and malingering in neuropsychology. Presented at First International Conference of Symptom, Diagnostic, and Disability Validity, 2002 Toronto, Ontario, Canada.
31. Mittenberg W, Patton C, Canyock EM, Condit DC. Base rates of malingering and symptom exaggeration. J Clin Exp Neuropsychol 2002;24:1094.-
32. Drane DL, Williamson DJ, Stroup ES, et al. Cognitive impairment is not equal in patients with epileptic and psychogenic nonepileptic seizures. Epilepsia 2006;47(11):1879-86.
33. Slick DJ, Sherman EMS, Iverson GL. Diagnostic criteria for malingering cognitive dysfunction: proposed standards for clinical practice and research. Clin Neuropsychol 1999;13:545-61.
1. Bianchini KJ, Greve KW, Glynn G. On the diagnosis of malingered pain-related disability: lessons from cognitive malingering research. Spine 2005;5:404-17.
2. Gervais RO, Green P, Allen LM, Iverson GL. Effects of coaching on symptom validity testing in chronic pain patients presenting for disability assessments. J Forensic Neuropsychol 2001;2:1.-
3. Meyers JE, Diep A. Assessment of malingering in chronic pain patients using neuropsychological tests. Applied Neuropsychol 2000;7:133-9.
4. Williamson DJ, Rohling ML, Green P, Allen L. Evaluating effort with the Word Memory Test and Category Test–or not: inconsistencies in a forensic sample. J Forensic Neuropsychol 2003;3:19-44.
5. Gouvier WD, Prestholdt P, Warner M. A survey of common misperceptions about head injury and recovery. Arch Clin Neuropsychology 1988;3:331-43.
6. Boone KB, Lu P. Impact of somatoform symptomatology on credibility of cognitive performance. Clin Neuropsychol 1999;13:414-9.
7. Greiffenstein MF, Baker WJ, Axelrod BN, et al. The Fake Bad Scale and MMPI-2 F-family in detection of implausible psychological trauma claims. Clin Neuropsychol 2004;18:573-90.
8. Larrabee GJ. Detection of symptom exaggeration with the MMPI-2 in litigants with malingered neurocognitive dysfunction. Clin Neuropsychol 2003;17:54.-
9. Tan JE, Slick DJ, Strauss E, Hultsch DF. How’d they do it? Malingering strategies on symptom validity tests. Clin Neuropsychol 2002;16:495.-
10. Iverson GL, Binder LM. Detecting exaggeration and malingering in neuropsychological assessment. J Head Trauma Rehabil 2000;15:829-58.
11. Sweet JJ. Malingering: differential diagnosis. In: Sweet JJ, ed. Forensic neuropsychology: fundamentals and practice. New York: Swets & Zeitlinger, 1999:255-85.
12. Coleman RD, Rapport LJ, Millis SR, et al. Effects of coaching on detection of malingering on the California Verbal Learning Test. J Clin Exp Neuropsychol 1998;20:201.-
13. Rapport LJ, Farchione TJ, Coleman RD, Axelrod BN. Effects of coaching on malingered motor function profiles. J Clin Exp Neuropsychol 1998;20:89-97.
14. Carone DA, Benedict RHB, Munschauer FE, et al. Interpreting patient/informant discrepancies of reported cognitive symptoms in MS. J Int Neuropsychol Soc 2005;11:574.-
15. Meador KJ, Loring DW, Vahle VJ, et al. Subjective perception of cognitive effects of antiepileptic drugs is more related to mood than to objective performance. Epilepsia 2005;46:261-2.
16. Sawrie SM, Martin RC, Kuzniecky R, et al. Subjective versus objective memory change after temporal lobe epilepsy surgery. Neurology 1999;53:1511.-
17. Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA 2006;296:1094-102.
18. Faust D. The detection of deception. Neurol Clin 1995;13:255-65.
19. Swets JA, Dawes RM, Monahan J. Psychological science can improve diagnostic decisions. Psychol Sci Public Interest 2000;1:1-26.
20. Knoll J, Resnick PJ. The detection of malingered post-traumatic stress disorder. Psychiatr Clin North Am 2006;29:629-47.
21. Morey LC, Lanier VW. Operating characteristics of six response distortion indicators for the Personality Assessment Inventory. Assessment 1998;5:203-14.
22. Rogers R, Sewell KW, Salekin RT. A meta-analysis of malingering on the MMPI-2. Assessment 1994;1:227-37.
23. Larrabee GJ. Somatic malingering on the MMPI and MMPI-2 in personal injury litigants. Clin Neuropsychol 1998;12:179.-
24. Nelson NW, Sweet JJ, Demakis GJ. Meta-analysis of the MMPI-2 Fake Bad Scale: utility in forensic practice. Clin Neuropsychol 2006;20:39-58.
25. Curtis KL, Greve KW, Bianchini KJ, Brennan A. California Verbal Learning Test indicators of malingered neurocognitive dysfunction: sensitivity and specificity in traumatic brain injury. Assessment 2006;13:46.-
26. Greve KW, Bianchini KJ, Mathias CW, et al. Detecting malingered performance on the Wechsler Adult Intelligence Scale: validation of Mittenberg’s approach in traumatic brain injury. Arch Clin Neuropsychol 2003;18:245.-
27. Reitan RM, Wolfson D. The question of validity of neuropsychological test scores among head-injured litigants: development of a dissimulation index. Arch Clin Neuropsychology 1996;11:573-80.
28. Green P, Lees-Haley PR, Allen LM. The Word Memory Test and the validity of neuropsychological test scores. J Forensic Neuropsychol 2002;2:97.-
29. Vickery CD, Berry DTR, Hanlon IT, et al. Detection of inadequate effort on neuropsychological testing: a meta-analytic review of selected procedures. Arch Clin Neuropsychology 2002;16:45-73.
30. Iverson GL, Viljoen JL. Practical and ethical issues regarding assessment of exaggeration, poor effort, and malingering in neuropsychology. Presented at First International Conference of Symptom, Diagnostic, and Disability Validity, 2002 Toronto, Ontario, Canada.
31. Mittenberg W, Patton C, Canyock EM, Condit DC. Base rates of malingering and symptom exaggeration. J Clin Exp Neuropsychol 2002;24:1094.-
32. Drane DL, Williamson DJ, Stroup ES, et al. Cognitive impairment is not equal in patients with epileptic and psychogenic nonepileptic seizures. Epilepsia 2006;47(11):1879-86.
33. Slick DJ, Sherman EMS, Iverson GL. Diagnostic criteria for malingering cognitive dysfunction: proposed standards for clinical practice and research. Clin Neuropsychol 1999;13:545-61.