|
|
||||||||
1 Department of Family and Community Medicine, University of California Davis School of Medicine, Sacramento, California
2 Laboratory of Personality and Development, Department of Psychiatry, University of Rochester Medical Center, Rochester, New York
3 Center for Healthcare Policy and Research, Department of Family and Community Medicine, University of California Davis School of Medicine, Sacramento, California
CORRESPONDING AUTHOR: Anthony Jerant, MD, Department of Family and Community Medicine, UC Davis School of Medicine, 4860 Y St, Suite 2300, Sacramento, CA 95817, afjerant{at}ucdavis.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS Individuals (N = 415) aged 40 years and older with various chronic conditions, plus basic activity impairment, depressive symptoms, or both, were recruited from a primary care network and enrolled in a 6-week RCT of an illness self-management intervention, delivered by means of home visits or telephone calls or usual care. Random effects logistic regression modeling was used to examine whether FFM factors predicted missing illness management self-efficacy data at any scheduled follow-up (2, 4, and 6 weeks, and 6 and 12 months), controlling for disease burden, study arm, and sociodemographic characteristics.
RESULTS Across all follow-up points, the missing data rate was 4.5%. Higher levels of Openness (adjusted odds ratio [AOR] for 1-SD increase = 0.24; 95% CI, 0.12–0.46; P <.001), Agreeableness (AOR = 0.29; CI 0.14–0.60; P=.001), and Conscientiousness (AOR = 0.24; CI 0.15–0.50; P <.001) were independently associated with fewer missing data. Accuracy of the missing data prediction model increased when personality variables were added (change in area under the receiver operating characteristic curve from 0.71 to 0.77;
21=6.6; P=.01).
CONCLUSIONS Personality was a powerful predictor of missing study data in this RCT. Assessing personality could inform efforts to enhance data completion and adjust analyses for bias caused by missing data.
Key Words: Bias (epidemiology) data interpretation, statistical patient compliance personality randomized controlled trials
| INTRODUCTION |
|---|
|
|
|---|
Psychological factors also likely affect study participants decisions to drop out from, keep data collection appointments for, or complete all questionnaire items in clinical research studies, yet they are rarely measured. This omission may be critical in assessing the validity and applicability of studies, since adherence to study protocols, including placebos, can have profound effects on outcomes, comparable to active treatment effects.10–12
Although earlier studies have explored attrition resulting from psychological factors in patients with psychiatric disorders13–15 and arthritis,16 finding associations with anxiety,13,14 depression,16 disordered personality,14 and disease attributions and treatment beliefs,15 the role of psychological factors in predicting attrition in other RCT settings remains unclear. The personality factors in the Five Factor Model (FFM)—Neuroticism, Extraversion, Openness, Agreeableness, and Conscientiousness—are particularly promising targets for study.17–19 The result of more than 7 decades of research,17 FFM factors are empirically derived, broad clusters of behavioral and dispositional tendencies (Table 1
). They capture the major axes of psychological and behavioral variation in humans and are associated with an array of important health behaviors and outcomes.20–24 Higher levels of Conscientiousness have been consistently associated with better adherence to chronic illness therapies.25–31 Similar associations might exist between Conscientiousness and incomplete trial data, but no studies have addressed this question, and associations between other FFM factors and missing data are also unexplored.
|
Based on prior FFM research,34 we examined the following hypotheses: Missing data will be more likely for participants higher in (1) Neuroticism because they will experience difficulties bearing the emotional distress of RCT participation; but missing data will be less likely for participants higher in (2) Extraversion, which is associated with gregariousness and positive mood,17–19 potentially enhancing enjoyment of trial participation; (3) Openness, which may stimulate interest in novel experiences,17–19 such as RCT participation; (4) Agreeableness, which is associated with adherence and altruism17–19; and (5) Conscientiousness, which is associated with reliability, diligence, and health-consciousness.17–19 Further analyses examined whether the FFM factors provide incremental power in predicting missing data beyond sociodemographic and other commonly measured variables2–9 or confound apparent associations of those variables with attrition.
| METHODS |
|---|
|
|
|---|
Using billing information, we identified patients aged 40 or older with arthritis, asthma, chronic obstructive pulmonary disease, congestive heart failure, depression, or diabetes mellitus and contacted them by mail and telephone. Interested patients were further screened for ability to speak and read English; residence in a private home with an active telephone; adequate eyesight and hearing to participate; and at least 1 basic activity impairment, as assessed by the Health Assessment Questionnaire35 or a score of 4 points or greater on the 10-item Center for Epidemiologic Studies Depression Scale.36 A study nurse visited eligible individuals in their homes to obtain informed consent, administer the baseline questionnaire, and implement randomized allocation in blocks of 12 participants using sealed opaque envelopes containing printed group assignments.
Procedures
Study Intervention
HIOH was delivered over 6 weekly sessions, and the content provided was essentially identical to that for the original CDSMP. HIOH differed from the CDSMP terms of delivery process, however, as only a single trained layperson provided all 6 intervention sessions to each participant. It also differed in delivery setting, being provided in participants homes or by telephone, using the same script for both intervention groups, rather than in centralized groups. Four non–health care professionals underwent intensive week-long training to deliver the intervention. Further details about HIOH are available from the authors upon request.
Usual-Care Control Group Usual-care participants completed the same baseline and follow-up telephone questionnaires as intervention participants. Otherwise, they received the care delivered by their usual clinicians.
Study outcomes, including efficacy for illness self-management, were measured through telephone calls at 2, 4, 6, 26, and 52 weeks. Data collection personnel were blinded to participant group assignment. Participants were paid $25 after each scheduled data collection ($125 if all 5 were completed).
Measures
Five Factor Model Personality Factors
At baseline, participants completed the 60-item NEO Five-Factor Inventory (NEO-FFI).34 Its 5, 12-item scales tap the FFM personality factors of Neuroticism, Extraversion, Openness, Agreeableness, and Conscientiousness. Scores were standardized (mean = 0, SD = 1) to facilitate interpretation. Cronbachs
for the 5 scales ranged from 0.70 to 0.87 in this sample.
Covariates Covariates measured by participant self-report at baseline were age in years, sex, race/ethnicity (white, black, Hispanic, Asian, other), health insurance (private, public, uninsured), education level (non–high school graduate, graduated high school, some college, graduated college, greater than college), and disease burden (1, 2, 3, 4, or more chronic diseases).
Missing Study Data Missing study data were defined as missing for illness management self-efficacy data—a primary outcome of the RCT—at any study follow-up point for any reason. Study data could have been missing because of study dropout, missed data collection appointments without permanent dropout, and failure to complete the illness management self-efficacy questionnaire at 1 or more data collection appointments. Missing data were assessed at each of the 5 scheduled follow-up points for each participant.
Analyses
Analyses were conducted using Stata, version 10.0 (StataCorp LP, College Station, Texas). We used mixed-effects logistic regression to model the status of illness management self-efficacy data collection at each of the 5 scheduled study follow-up points, including random effects to account for repeated measures. Independent variables of interest were the FFM personality factors. Adjustment for health status involved covariates for disease burden, with indicators for 2, 3, or 4 or more chronic diseases (reference = 1). Demographic covariates included age, an indicator variable for female sex (reference = male), and an indicator variable for racial/ ethnic minority category (reference category = white). Socioeconomic covariates included lack of insurance and education, with indicators for high school, some college, college, and greater than college (reference category = less than high school). We adjusted for length of follow-up through inclusion of indicators for the 2-, 4-, 6-, and 26-week follow-up (reference = 52 weeks). Study group was also included, with home group as the reference. To assess the degree to which personality factors might enhance power to predict missing study data over other commonly measured covariates alone, we compared the area under the receiver operating characteristic curve (sensitivity plotted against 1–specificity) for a model with only commonly measured covariates with that for a model with commonly measured covariates plus personality factors.
| RESULTS |
|---|
|
|
|---|
|
|
21=6.6, P=.01). Figure 2
|
|
| DISCUSSION |
|---|
|
|
|---|
Although this study is the first to find significant associations between FFM factors and missing trial data, the nature and direction of the associations were generally consistent with prior FFM research. For example, higher levels of Openness have been linked to receptivity to novel activities,37 which could increase interest in RCT completion. Similarly, individuals with higher levels of Agreeableness tend to be more compliant and eager to please,17,34 characteristics rendering RCT completion more likely. Finally, higher levels of Conscientiousness have been associated with greater dutifulness34 and treatment adherence,25–31 characteristics likely to reduce RCT attrition. These findings suggest a discrete psychological profile predicting missing trial data may exist.
Accounting for FFM personality factors also enhanced prediction of missing data beyond that achieved by commonly measured sociodemographic,2–6 disease burden-related,7,8 and study-related correlates of missing data in prediction models. The area under the receiver operating characteristic curve for random guesses about who will fail to complete any given data collection is 0.5. In the current study, the combined effects of disease, sociodemographic, and intervention covariates improved the area under the curve to 0.711, an increase of 0.211. Accounting for FFM personality factors resulted in further improvement of 0.063, increasing the total area under the curve to 0.774. Thus, the additional increment in predictive precision provided by FFM personality factors over other covariates was about 30% ([0.063/0.211] x100) as much as the initial increment over chance alone of health status, sociodemographic factors, intervention arm, and follow-up duration combined.
Inclusion of personality variables also attenuated the association between sex of the participant and missing data. Higher levels of Agreeableness and Neuroticism in women are 2 of the most universally observed associations in personality research, replicated in more than 27 countries and across age-groups.38,39 The current findings suggest differences by sex in missing data in some previous studies3,4,6 may be partially explained by personality.
Our study findings raise concerns about whether results of RCTs that rest on the psychological characteristics of enrollees, yet fail to measure and adjust for bias resulting from such characteristics, are applicable to the general population. Policy decisions stemming from such RCTs may lead to the expenditure of valuable resources supporting health interventions targeted to the general population, yet our findings suggest the interventions may only be effective in or adhered to by a subset of patients.40
Our findings also have important methodological ramifications for both RCTs and observational studies. Regarding RCTs, currently available methods for handling missing data, such as intention-to-treat analysis and last observation carried forward, assume dropout occurs at random41 and ignore the possibility that unmeasured variables driving missing data might interact with interventions to worsen outcomes. Thus, currently available methods for handling missing data do not address and may actually compound bias because of nonrandom missing data. By contrast, measuring and including the status of FFM personality factors in analyses may aid more precise modeling of missing data mechanisms,42 thereby improving their applicability to general practice. Integral to this aim will be the use of reliable, valid personality measures. A number of brief FFM measures are available,43–45 but they require broader use and testing to better establish their reliability and validity.
Our study findings further suggest that greater efforts to retain participants identified as being at-risk for missing data collection based on their psychological characteristics may be an important step toward improving the conduct of research studies. For example, we found participants with lower levels of Conscientiousness were more likely than those with higher levels to have missing data. Thus, additional structure in the data collection process (eg, reminder telephone calls, printed schedules, and other prompts) might help increase data collection individuals with lower levels of Conscientiousness, though research studies are required to examine this hypothesis formally. In light of the well-established association between Conscientiousness and treatment adherence,25–31 such approaches might also be considered for improving treatment adherence in clinical practice.
Finally, our findings raise the intriguing possibility that FFM personality factors may moderate participants responses to interventions.46 Substantial variation in response to RCT interventions may exist, with some participants improving while others do not respond or are even harmed as a result of the moderating effects of one or more variables.47 We recently conducted analyses, to be summarized in an additional report, showing that several FFM factors moderated the effects of HIOH on self-efficacy. These findings suggest the need to explore tailoring interventions to participant personality. They also underscore the need for broader use of brief FFM personality measures in both primary care research and practice43–45 to better assess their reliability, validity, and potential clinical utility.
More speculatively, it is also likely that personality is associated with decisions to enroll in clinical research studies48 and with adherence to study protocols once enrolled. Personality variables have been associated with important health outcomes,20–24 and ongoing faithful study participation can itself have potent effects on outcomes.10–12,49 The interrelationships among personality, study enrollment and retention, protocol adherence, and health outcomes suggest personality factors may be key variables confounding interpretation of the relationship between study interventions and outcomes. Further work exploring these issues will be important.
Also, although observational studies may offer greater external validity than RCTs, they are more susceptible to bias caused by participant characteristics. Group assignment is nonrandom, and those in the intervention arm are typically already adhering to the intervention when enrolled. This powerful healthy adherer effect may bias observational studies of interventions toward positive findings and may help explain why their findings are often contradicted by RCTs.50–52 The current findings suggest that accounting for personality could mitigate the healthy adherer effect and enhance the internal validity of observational studies. At minimum, routine inclusion of personality data in analytic models, similar to the routine inclusion of demographics, could characterize potential bias.
Our study had some limitations. The sample was composed of participants with common chronic conditions, plus functional impairment or depressive symptoms. Women were also slightly overrepresented compared with the general primary care population, in part because they had a higher prevalence of depression (1 of our 6 study diagnoses) relative to men.53 Patients FFM scores differed from national norms, probably as a result of these inclusion criteria. For instance, Neuroticism scores ranged from 0.20 to 0.36 SDs above national norms, and people with depression tend to measure high in neuroticism.54 Likewise, the lack of significant effects for Neuroticism and Extra-version could have been due to the range restriction in the levels of these factors related to study entry criteria, which would tend to underestimate the effects of personality on attrition. These observations suggest the FFM personality profile that we found predicted missing data could be specific to this RCT. Confirmatory analyses from other RCTs are needed, ideally involving a wide array of participant selection characteristics, interventions, and outcomes.
Another limitation was the relatively low rate of missing data from our RCT, which means the analytic models were likely overfitted. Additionally, predictors of missing data might vary as a function of the rate of missing data. For example, higher rates of missing data might be attributable primarily to problems with study implementation and follow-up, rather than patient characteristics. Thus, similar analyses should be repeated using data from RCTs with larger samples and more missing data. A final limitation was that a small number of study participants did not complete the personality inventory at baseline.
Our findings suggest personality-related missing data may affect the results of some RCTs. Clinical researchers must strive to reduce sources of bias to enhance the meaning and relevance of research.1 The current study provides a starting point for investigations to determine the degree to which personality bias may compromise the validity and applicability of RCTs and observational studies beyond the constraints imposed by their more widely acknowledged design limitations.
| FOOTNOTES |
|---|
Funding support: Funded in part by Agency for Healthcare Research and Quality grant number R01HS013603, and National Institute of Health grant numbers T32 MH073452 and K24MH072712.
Trial Registration: Homing in on Health: Study of a Home Delivered Chronic Disease Self Management Program. www.ClincalTrials.gov identifier NCT00263939.
Received for publication April 4, 2008. Revision received June 25, 2008. Accepted for publication July 29, 2008.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
R. S. Gotler and K. C. Stange A Way Forward for Health Care and Healers Ann. Fam. Med, May 1, 2009; 7(3): 273 - 274. [Full Text] [PDF] |
||||
![]() |
W. R. Phillips In This Issue: Practice, Research, and Reflection Ann. Fam. Med, March 1, 2009; 7(2): 98 - 99. [Full Text] [PDF] |
||||
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |