Abstract
PURPOSE Primary infection with the human immunodeficiency virus (HIV) is a major factor in the HIV epidemic. Most patients become symptomatic and seek care, but seldom are they tested or is their condition diagnosed. The objectives of this study are to determine whether it is cost-effective to expand testing for primary HIV infection to a larger cohort of patients, and, if so, which diagnostic assay is most cost-effective.
METHODS We undertook a cost-effectiveness analysis of testing a hypothetical cohort of more than 3 million outpatients with fever and other viral symptoms regardless of HIV risk factors using 3 diagnostic assays: p24 antigen enzyme immunosorbent assay (EIA), HIV-1 RNA assay, and third-generation HIV-1 EIA. Antiretroviral therapy was started when the CD4 cell count decreased to 350/μL. Outcome measures were the incremental cost-effectiveness of the diagnostic assays, number of cases identified, cases avoided in sexual partners, and threshold prevalence. For sensitivity analyses, we used $50,000 as the threshold for cost-effectiveness.
RESULTS At the baseline prevalence of 0.66%, p24 antigen EIA testing was the most cost-effective option at a cost of $30,800 per quality-adjusted life-year gained when compared with no testing. There were 17,054 cases identified, and infection was avoided in 435 partners. Probabilistic sensitivity analysis, in which the estimates for all variables are varied simultaneously, determined that expanded testing with p24 antigen EIA compared with no testing had a 67% probability of being cost-effective at the baseline prevalence and a 71% probability at a prevalence of 1%.
CONCLUSIONS Expanded testing for primary HIV infection with p24 antigen EIA may be a sound expenditure of health care resources.
- HIV infections/prevention & control
- cost-benefit analysis
- mass screening
- delivery of health care
- health services research
INTRODUCTION
Primary human immunodeficiency virus (HIV) infection is a transient, symptomatic illness characterized by high HIV-1 RNA levels before an effective immune response develops.1 More than 90% of cases go undiagnosed even though up to 90% of patients have symptoms and seek medical care.2,3 Primary HIV infection plays a major role in the HIV epidemic.4
Diagnosing primary HIV infection allows for an important opportunity to interrupt HIV transmission, because persons in this stage of HIV infection can be sources of new infections.4,5 First, they are in a state of heightened infectivity because they have high levels of viremia, often with a molecule count exceeding 1,000,000/μL.1 Additionally, because affected persons are unaware of the diagnosis, they might not practice preventive sexual behavior. Many patients who learn of being HIV-infected adopt behaviors that can reduce the risk for transmitting HIV.6 In addition to the public health benefits of early diagnosis, patients can also benefit by being observed for immune function deterioration and given timely initiation of antiretroviral therapy based on clinical practice guideline recommendations.7
There are numerous reasons why 90% of cases of primary HIV infection are undiagnosed. Primarily, the symptom complex is similar to that of influenza and other nonspecific viral illnesses.1 Several studies have concluded that no symptom is sufficiently sensitive or specific to allow for targeted testing.8,9 Second, it is difficult to determine who has a high probability of primary HIV infection when evaluating risk factors alone.10 Some patients may be unaware of their risky behavior.11 Health care workers can further contribute to the problem by failing to ask about risk factors, or they might feel unqualified to manage issues associated with HIV infection.3
Confusion about which test to order can also contribute to the low detection rate of primary HIV infection. Sensitivity, specificity, and cost limit the available options. At the initial stages of infection, HIV-1 antibody tests are nonreactive, and the diagnosis of primary HIV infection is made by either the p24 core antigen test or HIV-1 RNA assays (viral load). The p24 core antigen test is more specific and less expensive than the HIV-1 RNA assays, but it is less sensitive in detecting cases. The HIV-1 RNA assays are highly sensitive, but they are more expensive and have decreased specificity, which can result in a higher false-positive rate when used in groups that have a low disease prevalence. Another option is the third-generation HIV-1 antibody test, which is able to detect immunoglobulin (Ig) M as well as IgG antibodies. The Panel on Clinical Practices for Treatment of HIV Infection through the US Department of Health and Human Services (DHHS) recommends testing with the HIV-1 RNA assay when acute infection is suspected and risk factors are present but advises against testing lower risk populations because of concerns about false-positive diagnoses.12 Given the low percentage of primary HIV infection diagnoses, however, it is unlikely that many clinicians follow these guidelines and do any testing.2
Because of the differences in characteristics and costs of the available diagnostic assays, a cost-effectiveness analysis of expanded testing of persons with viral symptoms at varying prevalence rates could be useful for policy development and guiding clinical practice. The objectives of this study were to perform an incremental cost-effectiveness analysis of expanded testing of persons with viral symptoms and at least 1 risk factor using these 3 diagnostic assays for primary HIV infection and to determine the lowest prevalence at which expanded testing is cost-effective.
METHODS
Study Design
The study was an incremental cost-effectiveness analysis of 3 tests for primary HIV infection using a decision analytical model. A strategy of no testing was used for baseline comparison, because little testing for this diagnosis is currently done. The analysis included the following outcome measures of expanded testing for primary HIV infection: (1) increased quality-adjusted life-years (QALYs) in the patient as a result of starting antiretroviral therapy before profound deterioration in immune function occurs; and (2) prevention of HIV infection in the patient’s sexual partners. Several potential outcome measures were not included: (1) benefits of immunizations (hepatitis A and B and Streptococcus pneumoniae), cervical cancer screening, and tuberculosis screening; (2) prevention of HIV infection in needle-sharing contacts of injection drug users; (3) avoidance of costly diagnostic workups and hospitalization for those with more severe primary HIV infection symptoms; and (4) benefits of detecting cases of chronic HIV infection. Starting antiretroviral treatment during the acute phase of HIV was not included because data showing a benefit for structured treatment interruptions in preserving natural immunity were lacking.13 The harms from expanded testing included in the analysis were (1) decreased quality of life caused by the anxiety resulting from a false-positive diagnosis, and (2) decreased quality of life associated with being aware of being HIV infected.
The time frame for the study was 39.9 years, the average life expectancy of the mean age (39.5 years) of the hypothetical cohort being tested.14,15 The analysis adopted a societal perspective, including all costs and health effects, except for work loss and transportation, which were considered negligible compared with laboratory testing, visit costs, and lifetime medical costs for treatment of HIV disease. The analysis also provided information from the perspective of a third party payer by determining the cost per case of primary HIV infection diagnosed. We conducted sensitivity analyses to determine the stability of the results using reasonable variations in the data and assumptions.
Target Population
A national estimate of the prevalence of primary HIV infection in symptomatic ambulatory patients regardless of risk factors is published in this issue of Annals.16 The estimated primary HIV infection prevalence for patients with a fever was 0.66% (95% confidence interval [CI], 0.53%–0.92%), for those with a rash it was 0.56% (95% CI, 0.35%–0.94%), and for those with a sore throat it was 0.13% (95% CI, 0.10%–0.19%). The highest of these rates (0.66%) was used as the baseline for the analysis. To make population projections about the number of cases diagnosed, number of infections avoided, and program costs, we assumed that 20,000, or 50% of the 40,00018,19 newly infected patients annually, developed symptoms and sought care. At the baseline prevalence of 0.66%, 3,030,303 patients would need to be tested in the model.
The prevalence of primary HIV infection has also been directly measured in a study of patients at an urban urgent care center who complained of viral symptoms and had at least 1 HIV risk factor.17 The prevalence in this study was 1% (95% CI, 0.1%–1.9%). This prevalence was used to explore how a wider range of values affected the analysis.
Diagnostic Tests
Three tests with considerably different characteristics are available: (1) HIV-1 RNA assay (by polymerase chain reaction, branched-chain DNA, or transcription-mediated amplification, which is 100% sensitive but has a false-positive rate of 2% and is more expensive; (2) p24 antigen enzyme immunosorbent assay (EIA), which is less sensitive but has a false-positive rate of almost 0% and a moderate cost; and (3) third-generation HIV-1 EIA, which is less sensitive and specific than the other 2 tests, but costs the least. This test, also known as an HIV-1 antigen sandwich or combitest,8,9 is capable of detecting both IgG and IgM antibodies. Standard HIV-1 antibody EIA tests detect only IgG antibody and are much less sensitive for primary HIV infection. A rapid test (Ora-Quick HIV rapid test) became available in late 2002 that could identify HIV-infected persons earlier and decrease the failure rate for return visits for test results. This test was not included in the analysis because we lacked data in the setting of primary HIV infection testing.
Study Model
The study model is a decision analytical model (Figure 1⇓) in which a hypothetical cohort of 3,030,303 million patients with fever and other viral symptoms consistent with primary HIV infection, regardless of risk factors, were tested by either the p24 antigen EIA, an HIV-1 RNA assay, a third-generation HIV-1 EIA, or not tested at all. In the model sufficient serum was collected initially so that a standard HIV-1 antibody test and, if needed, a confirmatory Western blot reflexively test could be done for those with positive initial tests. All patients were scheduled for a return visit in 14 days for test results and posttest counseling; a projected follow-up rate was 69%.20,21 Patients with a positive test had follow-up HIV clinical care arranged, including transportation, if necessary. After testing, patients were categorized through Bayesian revision according to test result: true positive, false positive, true negative, or false negative.
Event Pathways
Patients in the true-positive category who continued care were seen for an initial visit at 1 month, at which time the standard HIV antibody test and Western blot assay would be positive.22 At this visit, an initial battery of laboratory tests (Table 1⇓), as well as a CD4 cell count and a quantitative HIV-1 RNA assay, was ordered.28 The cost of genotype resistance testing was not included in the baseline laboratory work, but it was added, as reflected in the higher range of values used in the sensitivity analysis (Table 1⇓). Continued care entailed a return visit, a CD4 cell count determination, and a quantitative HIV-1RNA assay every 4 months.7 Surveillance visits continued for 6.2 years, the mean duration of time it takes from diagnosis for the CD4 cell count reach 350/μL.29 At this stage of infection, 3-drug antiretroviral therapy was given according to Department of Health and Human Services guidelines, and patients incurred lifetime medical costs and survival times based on estimates from a mathematical simulation model of HIV disease.7,23 Additionally, some patients in this pathway altered their sexual behavior and thus avoided infecting their sexual partner during the several weeks of primary HIV infection symptoms. Partners who avoided infection avoided incurring lifetime HIV medical costs and reduced quality of life. Future behavior changes outside the symptomatic primary HIV infection period were not included in the analysis. Patients that failed to return for follow-up had HIV infection diagnosed at a later stage and incurred reduced lifetime medical costs and survival times based on an extrapolation of data from previous estimates of stage of disease when diagnosed, lifetime medical costs after starting combination antiretroviral therapy, and QALYs of survival.14,23
Patients in the false-positive category were assumed to have intermediate results on Western blot assay. Patients in this pathway were observed for 3 months with 2 follow-up visits. Testing confirmed a negative result after 2 standard HIV antibody tests, 3 Western blot assays, and a quantitative HIV-1 RNA assay.
Patients in the true-negative category had a follow-up visit with an HIV counselor to be informed of the negative results.
Patients in the false-negative category also had a brief follow-up visit with an HIV counselor to be informed of the negative results. These patients had HIV infection subsequently diagnosed at a later stage and incurred the same lifetime medical costs and survival times as those patients in the true-positive category who were lost to follow-up.
Patients that were not tested reported symptoms at later stages of infection, as did those patients in the true-positive category who were lost to follow-up.
The primary outcome measures were the incremental cost per QALY gained, the number of cases of primary HIV infection identified, and the threshold prevalence at which expanded testing had a cost per QALY of less than $50,000, a value that is generally considered to be a cost-effectiveness threshold for a single patient. This analysis includes both patients and their partners; the ramifications of this approach are discussed below. Other outcomes were the number of cases of infection avoided through changes in sexual behavior, the number of false-positive diagnoses, the number of false-negative diagnoses, and the cost per case diagnosed. The model was programmed using decision analysis software (TreeAgePro [version 2004], TreeAge Software Inc, Williamstown, Mass).
Decreased Transmission Through Change in Sexual Behavior
From a public health perspective, determining which patients are in this phase of infection can decrease their high-risk behavior and have a substantial impact on subsequent transmission. In an unpublished study from the Centers for Disease Control and Prevention (CDC) of 1,363 HIV-infected men and women, among the 69% who were sexually active during the preceding 12 months, 78% to 96% used a condom at their most recent anal or vaginal intercourse with a known HIV-negative partner, and 52%–86% reported condom use with a partner of unknown serostatus.6 The analysis used lower rates of 50% for both estimates. To determine a rate of transmission, a study of 197 persons with documented primary HIV infection showed, through gene sequencing and contact tracing, that transmission occurred at the time of primary HIV infection in 30%.25 In keeping with a bias against expanded testing, the analysis decreased this rate by one half to 15%, because HIV can be transmitted during the presymptomatic phase of primary HIV infection.26
Data on Costs
The costs of conducting an HIV-testing program were obtained from a state-funded program in Massachusetts that offered HIV counseling, testing, and referral to 3,068 patients entering 1 of 4 hospital-associated urgent care centers.20 Included in this program were the cost of HIV counselors and intake nurses who arranged for telephone follow-up, visits to homeless shelters, and travel vouchers to bring positive patients into care. The costs of laboratory tests were obtained from the Medicare fee schedule for Lancaster, Pa, for 2002. Clinical visit costs were obtained from a national survey of physician’s office charges.30 Lifetime medical costs incurred after the initiation of 3-drug antiretroviral therapy at CD4 cell counts of 350/μL and lower were based an extrapolation of data from a computer-simulated model of HIV-infected persons.23 Costs were converted to 2002 dollars by the medical care component of the Consumer Price Index.31 Future costs were discounted at a rate of 3%.
Data on Health-Related Quality of Life
Quality of life for asymptomatic HIV infection was obtained from a national probability sample of HIV infected adults.27 Utility values for the mental anguish resulting from waiting for confirmatory tests of a positive screening test were derived from the Quality of Well-Being index.24 QALYs for patients starting 3-drug antiretroviral therapy at CD4 cell counts of 350/μL or less until time of death were based on an extrapolation of data from previous estimates of age and stage of disease presentation and QALYs of survival after initiation of combination antiretroviral therapy.14,23 Future gains in quality of life were discounted at a rate of 3%.
RESULTS
Base Case Analysis
The base case analysis results are displayed in Table 2⇓. Expanded testing with the p24 antigen EIA test had the lowest incremental cost-effectiveness ratio of the 3 expanded testing strategies. Under base case assumptions, the cost per QALY for the p24 antigen EIA was $30,800 compared with no testing. Testing with an HIV-1 RNA assay or the third-generation HIV-1 EIA was dominated, or evaluated as inferior, by the p24 EIA strategy.
The p24 antigen EIA strategy, because of the high specificity of the test, resulted in significantly fewer false-positive diagnoses: 1,127 compared with 90,257 and 59,169 for the third-generation EIA and HIV-1 RNA assay, respectively (Table 2⇑). The HIV-1 RNA assay, because of the high sensitivity of the test, identified 2,946 more cases of primary HIV infection and allowed for the avoidance of 66 more cases of infected partners compared with the p24 antigen EIA. Additionally, there were no false-negative cases with this option compared with 3,012 with the p24 antigen EIA option. The analysis also calculated costs from a third party payer perspective as testing cost per case identified. The p24 antigen EIA option had the lowest cost per case identified ($29,090).
Sensitivity Analyses
Threshold Analysis of Prevalence of Primary HIV Infection
To determine the lowest primary HIV infection prevalence at which expanded testing was cost-effective at the usual standard of $50,000 per QALY, we performed a 1-way sensitivity analysis (keeping all other variables constant) using the 95% CI range of the directly measured prevalence estimate (0.1%–1.9%).17 Expanded testing with the p24 antigen EIA exceeded this standard when compared with no testing at a prevalence of less than 0.35%. The incremental cost-effectiveness ratios for other prevalence rates reported in the literature,16,17 comparing expanded testing of primary HIV infection using the p24 antigen EIA with no testing, showed the following results: at a prevalence of 1% (urban patients with risk factors) costs were $23,000 per QALY; at a prevalence of 0.56% (patients with a rash and other viral symptoms) costs were $35,000 per QALY; at a prevalence of 0.13% (patients with a sore throat and other viral symptoms) costs were $129,000 per QALY.
Other 1-Way Sensitivity Analyses
The baseline results remained fairly stable when compared with other 1-way analyses using the variable ranges in Table 1⇑. The p24 antigen EIA remained the most cost-effective option, with the cost per QALY, ranging from $15,500 to $50,600 when compared with no testing. The HIV-1 RNA assay continued to be inferior or have a cost per QALY of greater than $100,000 compared with the p24 antigen EIA, and the third-generation HIV-1 EIA remained inferior. The results of the key variables that had the largest impact on the baseline results are shown in Table 3⇓.
Multiway Sensitivity Analyses
We performed a Monte Carlo simulation (probabilistic sensitivity analysis) in which the values for all the variables listed in Table 1⇑ were simultaneously varied.32 We entered each variable as a probability distribution based on reported 95% CIs, when available, or as a reasonable range as indicated in the third column in the table. The log-normal distribution was assumed for cost variables and the beta distribution for probability and utility variables.32 We randomly selected new values from within each of the probability distributions during each of 100,000 iterations and calculated 95% likelihood comparisons of the strategies.
The p24 antigen EIA testing strategy had a 19% probability of being dominant (more effective and less costly), a 48% probability of having an a cost per QALY of less than $50,000, and a 33% probability of having a cost per QALY of more than $50,000 compared with no testing. There was a 0% chance of it being less effective. The HIV-1 RNA assay, when compared with the p24 antigen EIA, had a 3% probability of being dominant or having a cost per QALY of less than $50,000, a 44% probability of having a cost per QALY of more than $50,000, and a 53% probability of being inferior (less effective and more costly). Figures 2⇓ and 3⇓ show how these comparison probabilities changed with varying the prevalence.
DISCUSSION
This study is the first to determine the cost-effectiveness of expanded testing for HIV infection in the acute phase. Using conservative assumptions, expanded testing of patients with fever, other viral symptoms, and at least 1 risk factor with the p24 antigen EIA had 67% probability of being superior or having a cost per QALY of less than $50,000 compared with no testing. Because of the high specificity of the p24 antigen EIA, false-positive diagnoses would be limited to 1,127 of the 3,030,303 persons tested in the model. Expanded testing would result in short-term avoidance of 435 infections in sexual partners. Although not modeled, early diagnosis of HIV infection could also allow for long-term decreased transmission, because patients would be aware of their communicable status for many more years. Also sexual partners who avoid infection would not transmit the infection to others. Consequently, expanded testing for primary HIV infection could have a strong impact on curtailing the HIV epidemic and contribute greatly to achieving the CDC goal of reducing the annual number of HIV infections by 50% per year by 2005.33
Several recent studies have addressed with varying results the issue of screening for HIV, not primary HIV infection, in the general population.34,35 One study found that 1-time screening of the general population with a prevalence of 0.1% would cost $113,000 per QALY, whereas another analysis found that screening populations with a prevalence as low as 0.05% had a cost per QALY of $50,000 when including costs and benefits for partners. It is difficult to compare these results with this analysis of expanded testing for primary HIV infection because of the different screening costs and benefits to partners.
Our analysis has several limitations. The estimates of lifetime medical costs after initiation of antiretroviral therapy were derived from a study that used 1998 dollars for cost estimates.23 Although these costs were adjusted to 2002 dollars using the medical care component of the consumer price index, it is possible that the cost of antiretroviral therapy has increased faster than that of other medical costs. Again, however, doubling these costs through sensitivity analysis did not appreciably alter the incremental cost-effectiveness ratios of the screening options, because without any expanded testing program, HIV infection would be diagnosed at a later stage and would incur similar costs when treatment was started (Table 3⇑).
The analysis was also limited by using test characteristics derived from previous studies that included patients who were recruited when they were outside the symptomatic phase of primary HIV infection.8,9 The sensitivity of the p24 antigen EIA, in particular, could have been underestimated in these studies. Our analysis was based on screening patients who sought care because of symptoms, which have an average duration of 14 days.2 In a previous study, 100% of 20 patients with primary HIV infection tested within 1 week of symptom onset had positive p24 antigen EIA results, but they had negative results 3 weeks after symptom onset.36 A higher sensitivity estimate for the p24 antigen EIA would have resulted not only in a more favorable incremental cost-effectiveness ratio compared with no testing but also more cases detected and fewer false-negative diagnoses. Additionally, newer tests, such as fourth-generation HIV-1 EIAs and p24 antigen signal-amplification-boosted EIA of heat-denatured plasma, are now available that may perform better in screening for primary HIV infection, but have yet to be evaluated.37,38
The baseline prevalence estimate was derived from an analysis of a national outpatient database of patients with fever and other symptoms and diagnoses consistent with primary HIV infection.16 That estimate was based on assumptions that may not reflect the actual number of patients with primary HIV infection seeking medical care. Until more accurate data are available on the prevalence of primary HIV infection in low-risk populations, caution should be exercised in developing expanded testing policy based on these results. This analysis, however, showed that expanded testing for primary HIV infection has a 60% probability of being cost-effective at a prevalence of 0.35%, or almost one half of the baseline rate.
Finally, cost-effectiveness analyses typically apply the $50,000 per QALY standard to individual patients. This analysis combined the QALYs of the patients being tested and their sexual partners who avoided infection because of the communicable nature of HIV infection to show the full impact of an expanded testing program. In 1-way sensitivity analysis it was shown that without preventing transmission to sexual partners, the p24 antigen EIA had a cost per QALY of $50,600 compared with no testing (Table 3⇑).
Using reasonable assumptions, the analysis has shown that expanded testing for primary HIV infection with the p24 antigen EIA has a high probability of being cost-effective. The cost-effectiveness of expanded testing for primary HIV infection in populations with a prevalence of 0.66% or greater compares favorably with accepted screening programs, such as colon cancer screening, annual Papanicolaou smears in HIV-infected women, and breast cancer screening.39–41 Expanded testing for primary HIV infection may be a sound expenditure of health care resources and could have an impact on curtailing the HIV epidemic in the United States.
Footnotes
-
Conflict of interest: none reported
- Received for publication March 23, 2004.
- Revision received December 8, 2004.
- Accepted for publication December 22, 2004.
- © 2005 Annals of Family Medicine, Inc.