Abstract
PURPOSE Adolescent mothers are at risk for rapidly becoming pregnant again and for depression, school dropout, and poor parenting. We evaluated the impact of a community-based home-visiting program on these outcomes and on linking the adolescents with primary care.
METHODS Pregnant adolescents aged 12 to 18 years, predominantly with low incomes and of African American race, were recruited from urban prenatal care sites and randomly assigned to home visiting or usual care. Trained home visitors, recruited from local communities, were paired with each adolescent and provided services through the child’s second birthday. They delivered a parenting curriculum, encouraged contraceptive use, connected the teen with primary care, and promoted school continuation. Research assistants collected data via structured interviews at baseline and at 1 and 2 years of follow-up using validated instruments to measure parenting (Adult-Adolescent Parenting Inventory) and depression (Center for Epidemiologic Studies Depression). School status and repeat pregnancy were self-reported. We measured program impact over time with intention-to-treat analyses using generalized estimating equations (GEE).
RESULTS Of 122 eligible pregnant adolescents, 84 consented, completed baseline assessments, and were randomized to a home-visited group (n = 44) or a control group (n = 40). Eighty-three percent completed year 1 or year 2 follow-up assessments, or both. With GEE, controlling for baseline differences, follow-up parenting scores for home-visited teens were 5.5 points higher than those for control teens (95% confidence interval, 0.5–10.4 points; P = .03) and their adjusted odds of school continuation were 3.5 times greater (95% confidence interval, 1.1–11.8; P <.05). The program did not have any impact on repeat pregnancy, depression, or linkage with primary care.
CONCLUSIONS This community-based home-visiting program improved adolescent mothers’ parenting attitudes and school continuation, but it did not reduce their odds of repeat pregnancy or depression or achieve coordination with primary care. Coordinated care may require explicit mechanisms to promote communication between the community program and primary care.
- Pregnancy in adolescence
- parenting
- risk reduction behavior
- community services
- randomized controlled trials
- integration
- primary care
- health promotion
- vulnerable populations
- minority groups
- home visits
- health care delivery
- health services research
INTRODUCTION
Adolescent mothers experience rapid repeat pregnancy in the short term,1 depression,2 and school dropout,3,4 as well as a reduced probability of future economic independence.5 Compared with their adult counterparts, teenage mothers may interact with their children less positively and have unrealistic expectations of child behavior that increase the risk of abuse and neglect.6,7 Adolescent mothers and children growing up in disadvantaged communities afflicted by drugs, violence, and inadequate supports may be particularly vulnerable.8
Family physicians provide most of the adolescent medical care in the United States,9 but the typical office may find it challenging to address the multi-faceted needs of pregnant and parenting teenagers. Primary care clinicians may be better positioned to address these issues if they work in concert with community-based programs.10
Home visiting is a community-based strategy for delivering services that aims to improve outcomes for high-risk families through education and support.11 It can function as a mechanism for integrating health and other services.12 For adolescents who are hard to engage, at high risk, and living under adverse conditions, home visiting may be particularly beneficial.13,14
Studies of home visiting have raised questions about its practical importance and cost-effectiveness.14,15 A recent meta-analysis of 60 programs found wide variation in the effect sizes for outcomes, many of which were quite small.15 These variations in impact may be due to differences in the target population studied, program goals, design and implementation, outcomes measured, and variables that are difficult to quantify, such as the “fit” between staff and program participants.15
Although teenagers might be a group for whom home visiting may be effective,14 whether and to what extent these programs succeed in coordination with primary care have not been well studied. Such linkages may play a role in outcomes that are influenced by primary care, such as depression and repeat pregnancy.16–18
In 2000, we received funding to implement a community-based home-visiting program for pregnant and parenting teenagers. We evaluated the program experimentally to determine its impact on parenting attitudes and beliefs, repeat pregnancy, maternal depression, and school continuation. We also examined the program’s success in linking adolescents with primary care. We hypothesized that having a usual source of care would be associated with reduced rates of repeat pregnancy and maternal depression.
METHODS
Participant Population
Between February 2001 and January 2003, pregnant adolescents aged 12 to 18 years whose pregnancies were of least 24 weeks’ gestation were recruited from 3 urban, university-affiliated prenatal care sites in Baltimore, Md. Two sites were family medicine sites, and 1 was an obstetrician-gynecologist site. Adolescents attending these clinics were predominantly African American and economically disadvantaged. This study was approved by the Institutional Review Board of the University of Maryland School of Medicine.
Design
Program staff identified eligible adolescents from computer scheduling databases and approached them during a prenatal care visit and explained to them the program and study. After informed consent was obtained from adolescents and their parents or guardians, adolescents completed baseline structured interviews administered by research staff and were randomly assigned to a home-visited group or a usual care control group.
Home-Visiting Program
In the home-visited group, adolescent mothers received home visitation, mentoring, and case management from 1 of 3 African American women who were recruited from communities served by the program. Home visitors were required to have a high school degree and experience related to health care, child development, or social work. They were selected for their empathetic qualities, ability to relate to teens and families, communication skills, and knowledge of the community.
Home visitation started in the third trimester and was planned to occur biweekly for the first year of the child’s life and then monthly until the child’s second birthday. Each home visitor was assigned a caseload of up to 15 adolescents visited biweekly and up to 10 adolescents visited monthly. They received 2 days of initial training in the use of the curriculum, followed by ongoing training in depression, contraception, substance use, and domestic violence.
We defined a home visit as an in-person contact between the home visitor and adolescent. Two thirds of contacts occurred in adolescents’ homes, whereas the remainder occurred elsewhere in the community, often because of safety concerns related to drug trafficking in the home.
Home visitors were to deliver a parenting curriculum and an adolescent curriculum. The curricula were grounded in social cognitive theory and were developed by a child development psychologist and an anthropologist specifically for urban, African American adolescent mothers.19,20 The parenting curriculum sessions aimed to improve teens’ understanding of child development, teach and model good parenting attitudes and skills, and promote appropriate health care use. If the adolescent mother gave consent, the home visitor attempted to engage the baby’s father along with the mother in parenting sessions. The adolescent curriculum sessions provided skills-based, interactive instruction on safer sexual practices, prevention of repeat pregnancy, goal setting geared toward school completion, and training geared toward improving communication and negotiation with partners.
Additionally, home visitors sought to identify depression, partner violence, and school dropout. Adolescents were asked about psychosocial stressors and distress. Their mental health was discussed in biweekly multidisciplinary staff meetings. If depression was identified as a potential concern, the teen was referred to the program’s social worker for further evaluation and counseling, and to primary care and mental health services. Home visitors conducted ongoing assessment of the teen’s school status and actively worked to promote school continuation or reengagement (eg, meeting with school officials, parents).
Finally, home visitors sought to connect adolescents with primary care for management of their contraceptive needs. Adolescents selected their primary care site, which was often different from their prenatal site, based on insurance requirements, location, and preference.
Home visitors completed standardized forms to measure how actual service delivery conformed to program standards (eg, completion of curriculum sessions, linkages).
Baseline and Follow-up Data Collection
Research staff blinded to the adolescents’ group assignment conducted structured baseline interviews. The evaluation was separate from program activities; thus, individual-level data collected from research interviews (eg, standardized depression assessments) were not shared with program staff.
Outcome data were collected when the child turned 1 and 2 years old. We used instruments with established psychometric properties to measure parenting attitudes and beliefs, and depression. Contraceptive behaviors, sexual relationships, repeat pregnancies, school status, and relationship with the baby’s father were measured at each follow-up assessment. At the year 2 follow-up interview, we asked adolescents whether they had a “regular personal doctor.”21 Those responding “yes” were considered to be linked to primary care.
Measures
Parenting attitudes and beliefs were measured with Bavolek’s Adult-Adolescent Parenting Inventory (AAPI),22 which was designed to identify negative parenting attitudes and child-rearing practices associated with a high risk of adverse outcomes for the child. To assess condom and contraceptive use, adolescents were asked how often during the past 12 months they used condoms. Response choices were “never,” “sometimes,” “most times,” and “always.” They were also presented with a list of possible contraceptive methods and asked whether they had used the method. We grouped condom use into “always” vs “not always” and contraceptives into hormonal types (eg, medroxyprogesterone acetate) vs nonhormonal types (eg, spermicide). Repeat pregnancy and birth were assessed by self-report.
Depressive symptoms were measured using the Center for Epidemiologic Studies Depression (CES-D) scale,23 which contains 20 questions asking about symptoms experienced in the past week. Adolescents having a score of 21 points or higher were defined as having moderate to severe depressive symptoms.24 For school status, we used the adolescents’ self-reports of whether they were in school, were not in school, or had graduated by the year 2 follow-up interview, and whether they returned to school if, at baseline, they had dropped out.
We assessed maternal demographics and covariates that have been shown to be associated with parenting outcomes, repeat pregnancy, and depression.5,6,25,26 These variables included history of sexual abuse, exposure to domestic violence, and substance use.
Analyses
We used the intention-to-treat approach to analyze the effectiveness of the program.27 Regardless of the adolescents’ level of program participation (including no home visits and early dropout), we measured outcomes according to their originally assigned group. This method helps maintain the benefits of randomization and minimizes bias when participant attrition is related to outcomes of interest.
We used the χ2 Fisher exact test and Student t test to test for differences between the home-visited and control groups in baseline and follow-up measures. We controlled for baseline differences in the follow-up analyses. We checked for differential attrition both within and between the groups. There was no difference between groups in attrition, but we did observe greater loss to follow-up among adolescents reporting greater domestic violence (P <.05) and a trend toward greater attrition for those who were depressed at baseline (P = .09). We controlled for these associations in analyses.
Generalized estimating equations (GEE)28 were used to examine the impact of the home-visiting program on changes in adolescent mothers’ parenting attitudes and beliefs, contraceptive behaviors, repeat pregnancy, depressive symptoms, school continuation, and linkage to primary care, adjusting for baseline differences. We used GEE because it produces a summary estimate of the group effect averaged over the year 1 and year 2 follow-up assessments, taking into account the correlation of the repeated measurements. We examined using random effects modeling to adjust for within-person and home visitor–level correlations, but the findings were unchanged.
Studies of home visiting demonstrate that participants often have high rates of attrition and receive fewer services than specified by the program’s protocol.11,29 Consequently, we assessed adolescents’ total number of completed curriculum sessions and then determined whether they had a high level of exposure (≥75% of planned sessions) vs a low level of exposure (<75% of planned sessions). We repeated the GEE analyses comparing parenting scores of home-visited vs control adolescents, including exposure level in the model and controlling for significant baseline differences.
Finally, we examined whether program participants were more likely to report having a regular personal doctor and whether this variable was associated with contraceptive, repeat pregnancy, and depression outcomes.
We defined statistical significance as P <.05 and a statistical trend as .05< P <.10. Our sample size of 40 per group yielded a power of 0.80 to test for an effect size of 0.40 for continuous outcomes. Missing values accounted for less than 6% of all tested independent variables. Descriptive statistics and GEE models were computed with Stata 8.0 (Stata Corp, College Station, Tex).
RESULTS
We identified 122 eligible pregnant adolescents (Figure 1⇓). Of these, 32 (26%) declined to give informed consent and another 6 (5%) did not complete a baseline assessment. Eighty-four teens were randomized to receive home visits (n = 44) and usual care as a control (n = 40). Among those randomized, follow-up assessments were completed at 1 year by 62 teens (74%) and at 2 years by 63 teens (75%). Seventy (83%) completed either assessment, and 56 (67%) completed both assessments.
Baseline Characteristics
The home-visited and control groups were comparable on most measures at baseline, except that AAPI parenting scores were significantly higher in the home-visited group (Table 1⇓). The population was predominantly African American, had low socioeconomic status, and experienced challenges and stressors including sexual abuse (10%), physical fighting (31%), depressive symptoms (35%), and school dropout (30%).
Outcomes
The program had a positive impact on adolescent mothers’ parenting attitudes and beliefs. Compared with their control counterparts, home-visited adolescents had significantly improved changes over time in total AAPI scores and 2 of the subscales (Table 2⇓).
Among the home-visited group, adolescents received fewer curriculum sessions than intended; 39% in this group completed fewer than 75% of planned sessions. Home-visited teens who completed 75% or more of the parenting curriculum scored 8.3 points higher than control teens on the AAPI (P <.005) (Table 3⇓). On average, high-exposure recipients were older (16.8 vs 15.8 years, P <.05), but exposure level was not related to depression, domestic violence, or relationship with the baby’s father.
We observed a trend toward greater consistent condom use among home-visited adolescents, but no impact on use of hormonal contraception, repeat pregnancy or birth, or depressive symptoms (Table 4⇓). Thirty percent of teens had dropped out of school at baseline. Significantly more home-visited teens than control teens returned to school and graduated by 2 years postpartum (71% vs 44%, P <.05).
At the year 2 follow-up interview, 61% of home-visited adolescents vs 44% of control adolescents reported having a regular personal doctor (P = .25) (Table 5⇓). Teens who reported having a personal doctor were younger and more likely to be depressed at the year 2 follow-up interview. Controlling for age, baseline depressive symptoms, and domestic violence, having a personal doctor was associated with depressive symptoms at the 2-year assessment (adjusted odds ratio = 3.9; 95% confidence interval, 0.9–17.9; P = .08) and continuous insurance (adjusted odds ratio = 4.5; 95% confidence interval, 1.0–20.9; P = .06), but not with program participation.
DISCUSSION
Our paraprofessional home-visiting program significantly improved adolescent mothers’ parenting attitudes and beliefs and increased school continuation relative to usual care; however, the program was not effective in reducing the odds of repeat pregnancy or maternal depressive symptoms. We aimed to link teens with primary care and did observe a nonsignificant trend toward this outcome.
In contrast to findings from a meta-analysis of home-visiting programs that found small changes in parenting,15 our findings found medium to large effect sizes on parenting outcomes.30 Specifically, among home-visited teens overall, the standardized effect size for improved parenting attitudes was 0.49 and was even higher, 0.72, among adolescents who had a high level of exposure to the curriculum. These effect sizes are larger than that reported by Olds et al (effect size, 0.38)31 and may have been due to our sample’s younger mean age and our use of a previously evaluated parenting curriculum that was culturally and age appropriate.25 We furthermore emphasized staff training and monitoring to ensure that staff acquired and used skills to teach, promote, and model positive parenting faithfully.20
Similar to programs that specifically target teenage mothers,15 our program significantly influenced school reentry and graduation. This effect may have been due to the home visitors’ consistent messages and case management activities delivered in the context of their ongoing relationship with the teen. Disruptions in these relationships were rare; during the program’s 4-year lifetime, only 1 of the 3 home visitors left the program. Such continuity may enhance a trusting relationship and increase the impact of messages.32
On the other hand, this program did not improve use of hormonal contraception or reduce repeat pregnancy. Prior studies of home visitation have found a similar lack of impact on prevention of additional pregnancies.16,31 A possible explanation derives from research showing that knowledge of and access to contraceptive services alone do not reduce repeat pregnancy.33,34 Motivation to avoid pregnancy is influenced by many factors, including partner preferences for having more children.35–37 Although our program did provide adolescents with contraceptive information and counseling, and taught them about safer sexual practices and negotiation skills, it lacked an explicit mechanism to address motivation as the key to postponing childbearing.35,38,39 Additionally, the program lacked specified methods to share information between the home visitors and the primary care physician. Studies suggest that defined communication protocols may facilitate a more seamless and integrated care process.40
Despite the program’s focus on assessing adolescents for depression at baseline, providing therapy to those with depression, and recommending further treatment in primary care and mental health settings, the program did not have any impact on adolescent mothers’ depressive symptoms. One possible explanation is that the program did not train the home visitors to use a standardized depression screening tool for ongoing assessment. Consequently, the program may have failed to identify adolescent mothers with incident depression between delivery and 2 years.2 Beyond this factor, merely identifying depression without giving adolescents specific evidence-based treatment does not improve outcomes.41 Even if depressed teens were referred to their primary care doctor, the program lacked a well-developed system to coordinate information between the home visitor and the teen’s physician. Consequently, when the teen visited the physician, the physician may have failed to recognize her depression.42,43 Barriers in access to care are also likely to have played a part. During their pregnancy, more than 75% of the teenagers were covered by insurance (predominantly Medicaid), but fewer than 35% reported continuous insurance coverage during the 2-year study period. Although speculative, our experience suggests that complicated welfare reform policies may contribute to loss of coverage after delivery.44
Multiple studies have shown that using care managers to complement the primary care physicians’ role in the treatment of depression improves outcomes and is cost-effective.45–47 It is possible that appropriately trained home visitors could serve such a role. Although our program aimed to coordinate care, our lack of adequate explicit mechanisms to communicate with the primary care clinician was a missed opportunity for bidirectional flow of information that might reinforce each setting’s messages.48
This study raises questions about how to integrate community-based and primary care services for vulnerable teenage mothers. Studies have found that even within a single system of clinicians, communication is difficult49 and may be impractical, time-consuming, and economically unproductive for many clinicians.50 We believe that future trials should explore innovative methods for communicating important information (eg, the presence of depressive symptoms) between primary care clinicians and community programs. Successful linkages that promote and reinforce positive behavior change could prove more fruitful.
A major limitation of this study is its small sample size; however, our high follow-up rate and intention-to-treat analysis strengthen our findings of a positive program impact on parenting attitudes and school continuation for this group. Second, although we used a randomized design, our study groups were not balanced at baseline on our main parenting measure, the AAPI score. It is also possible that our parenting outcome findings might have been different had we measured parenting through direct observation rather than self-report. Finally, we did not assess the content of primary care received by these teens. Consequently, we are unable to determine whether primary care clinicians provided appropriate contraceptive services or recognized and treated depression in these adolescent mothers.
In recent years, federal dollars have been drastically reduced for programs that support services for vulnerable pregnant and parenting teenagers in favor of ineffective programs that support “abstinence only until marriage.”51,52 This trial reinforces prior studies showing the effectiveness of home visitation in improving important outcomes for economically disadvantaged adolescent mothers, and may be helpful in formulating evidence-based policy. It is possible that other important outcomes, such as repeat pregnancy and depression, could be altered with greater coordination of care. Community-based home-visiting programs and primary care practices may achieve greater benefits if they work together to develop and test explicit mechanisms and implementation systems that coordinate care for high-risk adolescents.
Footnotes
-
Conflicts of interest: none reported
-
Funding support: This work was supported by the Office of Adolescent Pregnancy Programs, Department of Health and Human Services, grant APHPA0002011. The principal investigator had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
This work was presented in part at the 31st Annual Meeting of the North American Primary Care Research Group, October 2003, Banff, Alberta.
- Received for publication March 23, 2006.
- Revision received June 8, 2006.
- Accepted for publication August 14, 2006.
- © 2007 Annals of Family Medicine, Inc.