Original Research

Diabetic foot ulcers (DFUs) are devastating, common, and costly. This burden is borne disproportionately by veterans who have high prevalence of type 2 diabetes mellitus (T2DM) and other precipitating risk factors.¹ The mortality of veterans following a DFU is sobering, and ulceration is recognized as a significant marker of disease severity.

A 2017 study by Brennan and colleagues reported a 19% mortality rate within 1 year, and only 29% survive past 5 years.² DFUs are often complicated by peripheral arterial disease (PAD) and diabetic immune dysfunction, contributing to chronic wounds and infection.^3,4 About 60% of all foot ulcers become infected, and > 20% of patients with a diabetic foot infection require amputation.^5,6

A 2010 retrospective study reports that > 3,400 veterans have a diabetes-related lower extremity amputation annually, vastly surpassing the rate of amputation secondary to trauma in the Veterans Health Administration (VHA).^7,8 The inpatient costs for each amputation exceeded $60,000 in fiscal year 2010, and these amputation-related costs represent only 1 component of the total expense to the VHA attributable to diabetic foot complications.⁷ A recent systematic review by Chan and colleagues estimated mean annual costs in the year following a foot ulcer to be $44,200 to the public payer.⁹ This implies that direct expenditures for treatment of DFUs within the VHA exceeds $3 billion annually.

Diabetic Foot Ulcer Prevention

Given the dramatic impact of diabetic foot complications to the veteran and the US health care system, the VHA has long recognized the importance of preventive care for those at risk. In 2017 US Department of Veterans Affairs (VA) and Department of Defense issued a clinical practice guideline for the management of T2DM that recommended prophylactic foot care for early identification of any deformity or skin breakdown.¹⁰ The guidelines note that a “person who has had a foot ulcer is at lifelong risk of further ulceration,” reflecting the high rate of recurrence among all patients, including veterans. Multiple studies suggest that as many as 40% of patients experience recidivism in the first year after healing from a wound.^11-16

The VA is well equipped to deliver quality preventive care because of its innovative and long-standing PAVE (Prevention of Amputations for Veterans Everywhere) program.¹⁷ PAVE provides screening, education, appropriate footwear, and stratified care guidelines for veterans at risk for diabetes-related foot complications (Table 1). The practices encouraged by PAVE are evidence-based and synergistic with the objectives of the VA’s patient aligned care team (PACT) delivery approach.¹⁸ The granular data collected through PAVE are used to guide best practices and provide benchmarks for diabetic foot outcomes.

Unfortunately, despite PAVE guidelines requiring annual specialist foot care for at-risk veterans, a 2013 report by the VA Office of the Inspector General (OIG) found that one-third of all patients had no documentation of this minimal requirement of preventive foot care.¹⁹ Although the VA has worked to address this issue, the data hint at the missed opportunities for prevention of complications and the challenges of ensuring that a large at-risk veteran population has systematic and routine screening with access to specialist foot care.

Given the large proportion of veterans at high risk of chronic wound formation and the challenges of ensuring that this cohort receives good preventive foot care, expanding telemedicine has been suggested. Telemedicine solutions have the potential to reduce the impact of chronic wounds on overburdened clinic resources, schedules, and local and federal budgets.²⁰ Interestingly, the only preventive practice for the diabetic foot that has been proven effective through multiple randomized controlled trials and national and international clinical guidance documents is once-daily foot temperature monitoring.^21-26 Daily monitoring has the potential to reduce the burden of DFUs to veterans, improve veteran access to needed preventive care, and reduce costs incurred by the VHA treating diabetic foot complications. Yet despite a recent national guidance document detailing its appropriate use in PAVE 3 veterans, it remains underutilized.²⁷

The purpose of this review is to: (1) discuss the evidence supporting once-daily remote temperature monitoring (RTM), a telemedicine approach critical to improving both veteran access to care and diabetic foot outcomes; (2) summarize a 2017 study that presented an advanced clinical understanding of RTM use among veterans; (3) provide previously unpublished data from this study comparing high-risk VA and non-VA cohorts, highlighting the opportunity for additional focus on foot ulcer prevention within the VA; and (4) report on recent VA utilization of a RTM technology based on this research, emphasizing lessons learned and best practices.

Remote Temperature Monitoring

The objective of daily foot temperature monitoring is to identify impending inflammatory foot conditions, such as DFUs, infection, and acute Charcot neuroarthropathy episodes. The patient and care team then act to resolve the cause of detected inflammation before clinical presentation (prevention) and begin treatment earlier than would otherwise be possible to avoid expensive complications, such as infection (early detection). Preventive therapies are low risk to the patient and inexpensive.

RTM is recommended by multiple clinical practice guidelines, including those of the International Working Group on the Diabetic Foot, the American College of Foot and Ankle Surgeons, and the Wound Healing Society.^24-26 Its use is supported by evidence from 3 National Institutes of Health-funded and well-designed randomized controlled trials, 1 of which was additionally supported by a VA Health Services Research and Development Service Merit Award.^21-23,28 Conducted between 2004 and 2007, these studies demonstrated the potential to reduce foot ulcer incidence by as much as 85% using a dermal thermometer to identify inflammation and prompt decreased ambulation. Investigators established a clinical monitoring protocol comparing the temperatures between 6 matched locations on the left and right feet. Persistent differences in contralateral temperatures exceeding 2.2°C (4.0°F) were used as a marker for elevated risk and to initiate preventive care. Based on the encouraging results from these studies, a 2017 effectiveness review prepared for the Agency for Healthcare Research and Quality concluded that “home monitoring of foot skin temperature is effective for reducing foot ulcer incidence and recurrence.”²⁹

Accuracy of RTM

A 2017 longitudinal study (NCT02647346) has provided novel data to advance understanding of RTM for the prediction and prevention of DFUs.³⁰ This study was the first to systematically analyze the accuracy of RTM over different monitoring thresholds. The results enable practitioners to deliver risk-stratified preventive care. Policy makers can use the data from this study to weigh the cost and benefits of RTM for population health.

The multicenter trials had 129 participants from 4 VA health care systems: VA Long Beach Healthcare System in California, Miami VA Healthcare System in Florida, Phoenix VA Healthcare System in Arizona, and VA West Los Angeles Healthcare System in California. Each participant was followed for 34 weeks under standard preventive foot care and was instructed to step on a telemedicine SmartMat (Podimetrics, Inc) RTM mat for 20 seconds daily. Participants and investigators were blinded to the temperature data so that the accuracy of temperature monitoring could be assessed. All participants had a history of T2DM and healed DFU. Principal exclusion criteria included unhealed plantar wound, history of proximal lower extremity amputation (ie, above ankle), active Charcot foot disease, and comorbidities that could potentially inhibit an inflammatory response, such as end-stage renal disease, active malignancy, and immunosuppressive diseases.

The investigators reported that RTM with the study mat detected 97% of nonacute plantar DFUs using the most commonly studied threshold (sustained 2.2°C temperature difference). The lead time averaged 37 days before clinical identification of the wound under standard care. Although the false-positive rate of 57% was high, corresponding to approximately 3.0 notifications per patient per year on average in the research setting, it is important to note that this study only considered the prediction of plantar DFUs. Thus, detection of foot inflammation secondary to other conditions, such as preulcerative lesion, dorsal wound, Charcot neuroarthropathy, or foot infection, were reported as a false positive per the study’s definitions. Further, Crisologo and Lavery noted in a translational medicine summary of this research, because the intervention is noninvasive and minimally impactful to the patient and the health care system, “the potential to arrest re-ulceration is worth the perceived inconvenience to the patient.”³¹

Secondary outcomes related to adherence and ease of use were encouraging. Eighty-eight percent of participants reported that the mat was “very easy to use,” the highest possible score, and 98% were able to set up the mat for home use without difficulty. At the end of the 34-week study, more than 74% of participants remained engaged in routine use of the mat under a per-protocol assessment of adherence. These results are especially impressive given the documented poor adherence of at-risk patients to routine use of therapeutic footwear, which has been reported to be as low as 15%.³²

New Research

The data collected during this study has led to new research and advancements in RTM. A recent publication by Gordon and colleagues investigated whether RTM is less accurate in cohorts with perceived challenges.³³ They include patients with recently healed wounds and those with a history of partial foot amputation. There was no difference in the accuracy or lead time for either cohort relative to the entire cohort, suggesting that RTM is appropriate for monitoring patients with recently healed DFUs or partial foot amputations.

In another recent study, the data were used to derive a novel approach to monitor a single at-risk foot.³⁴ The practice of RTM has traditionally required comparing temperatures between contralaterally matched plantar locations on the feet, thus limiting its use in patients with a history of major lower extremity amputation and patients being treated for a wound, which may be bandaged or in an off-loading cast or boot. Because the risk factors for DFUs exist in both limbs, these patients are at high risk for developing complications to the contralateral foot and may benefit from preventive once-daily foot temperature monitoring. The investigators empirically derived a novel monitoring approach for patients without a contralateral control. This approach was found to predict 91% of impending plantar DFUs on average 41 days before clinical presentation with a false positive rate of 54%.

Additional Focus on Prevention

Table 2 shows previously unpublished data from a subgroup analysis between veteran and nonveteran participants in the study.²⁵ These descriptive statistics reinforce some widely held assumptions regarding the high-risk veteran population and challenge others. For example, compared with the nonveteran participants, the veteran cohort unsurprisingly had a larger ratio of male participants (P < .01), had a higher rate of cigarette use (P < .01), and was more likely to live alone (although not at a statistically significant level). Veterans in the study had body mass index, rates of alcohol use, frequency of exercise, and glucose control comparable to that of nonveterans.

The potential impact of the PAVE program is clear in several of these comparisons. Although as few as 15% of patients use therapeutic shoes routinely, PAVE ensures that the majority of veterans receive them. Nearly 95% of veterans have therapeutic shoes compared with about 80% of nonveteran participants (P < .05). Veterans also had higher ankle-brachial index results (P < .05), although on average both cohorts were within normal clinical parameters. Veterans had a significantly longer duration since healing from the most recent wound, and fewer veteran participants had a wound that healed in the 3 months prior to the study. Despite this, during the study veterans had annualized DFU incidence equal to that of nonveterans. Furthermore, veterans also had significantly higher rates of amputation prior to participation. That these critical outcomes for veterans are no better than those observed in other care environments despite PAVE suggests that approaches recommended via PAVE alone are insufficient to significantly arrest DFU recurrence, and even more focus on prevention in the VA may be warranted.

From Research to Practice

Since the publication of the 2017 study, the VHA has been at the vanguard of translating the evidence and research underlying RTM into clinical practice. A clinical guidance document governing appropriate use of RTM with the study mat was recently published by the VA Prosthetic and Sensory Aids Service in collaboration with the National Podiatry Program office.²⁷ This guidance document recommends once-daily RTM for at-risk veterans designated PAVE level 3. It defines roles and responsibilities required for the successful implementation of a RTM program with the study device. The document additionally presents various clinical monitoring protocols for veterans, although the protocol and thresholds used are at the discretion of the prescribing clinician and should reflect the risk profile of the veteran in question.

A staged response to inflammation has proven popular, whereby an initial high-sensitivity threshold is chosen for monitoring. The initial response is telephone outreach by a designee supplied by the clinic or device manufacturer, typically a trained registered nurse, to the veteran to collect subjective history and instruct off-loading and reduced ambulation, with a target of 50% baseline reduction in step count. Should the inflammation persist despite off-loading, an examination may be necessary to identify and resolve its cause. For recalcitrant inflammation, more targeted pressure off-loading of the affected area may be accomplished with custom orthotics, accommodative insoles, removable cast walkers, and total contact casting. After 2 to 4 weeks without signs of inflammation, the cause is deemed to have been resolved and lowered the acute risk for developing further diabetic foot complications.

More than 600 veterans have been monitored for > 1,000 patient-years—13 VA medical centers are practicing RTM with the study mat as of this writing. The monitoring program has been integrated into many veteran daily routines as evidenced by > 70% retaining full engagement after having been monitored for > 1 year. The total number of alerts/patient-years across these veterans has been 1.4, significantly lower than the 3.0 alerts/patient-year observed in the study. This is potentially due to successful interventions in response to detected inflammation, resolving inflammation, and avoiding unnecessary alerts occurring in the research setting, which did not employ interventions that resolved inflammation episodes. In the past 6 months, 68% of all inflammation detected resolved via off-loading alone without requiring further clinical intervention. In the cases that required an examination, 76% of patients reported clinically meaningful preventive care (eg, preulcerative callus was debrided, a subungual hemorrhage was treated, a foot ulcer was identified).

Organizational Best Practices

Several best practices have been cultivated related to initiating a RTM program at a new site, for promoting the success of a RTM program, and provisioning excellent preventive care to support the RTM program. Although we advise adhering to the recommendations in the VA guidance document,²⁷ the authors have observed several additional organizational best practices that are not explicitly addressed.

Partnering with PACT. Collaboration between PAVE and PACT has the potential not only to improve outcomes for patients at risk for diabetic foot complications, but also can help identify appropriate high-risk veteran candidates for preventive care with RTM who may not be followed for routine care from a specialty provider, such as a podiatrist, as highlighted by the 2013 OIG report.

Prescreening eligible patients. Several programs have used PAVE data or appointment schedules to identify and target high-risk veterans proactively. This approach has several benefits. It simplifies clinical coordination and streamlines workflow for patient identification and onboarding. It also allows those veterans at highest risk to receive needed and recommended preventive care at their next scheduled appointment. Finally, if PAVE data are used to identify eligible patients, it has the added benefit of ensuring a baseline level of telemedicine preventive foot care for veterans who have become lost to follow-up and have not been seen recently for a routine foot examination.

Implementing foot monitoring during wound treatment. Recent research has expanded the reach of once-daily RTM with the mat to patients being treated for a wound to only 1 foot. This practice has 2 benefits: The patient is able to establish a preventive routine before healing, an important advantage because research strongly suggests that recurrence is most likely in the first months after healing. Second, 48% of patients with a history of DFUs will develop new wounds to the contralateral foot because risk factors, such as neuropathy and peripheral arterial disease, exist in both limbs.³⁵ Furthermore, ongoing treatment for a wound to 1 foot may result in gait deviation and elevated pressure to the sound foot, additionally predisposing the veteran to complications, resulting in a high rate of wounds occurring to the unwounded foot during treatment (0.2 DFU/DFU-year).³⁴ Thus, there is potential benefit in monitoring the sound foot while undergoing treatment for a wound; further, the patient will have immediate access to the device for prevention of recurrence once the wound has resolved.

Utilizing foot monitoring as an extension of telemedicine. Many VA facilities have large geographic catchment areas, making routine follow-up difficult for veterans living in rural areas. RTM serves as an extension of the patient’s daily self-examination and the clinician’s ability to monitor patients with objective information daily. The veterans using the system become more invested and feel as though they are taking an active role in their health care.

Investing in ongoing medical education. Multidisciplinary education sessions reviewing supporting clinical data and resultant clinical practice guidelines raise awareness for those providers and trainees unaware of preventive best practices for the diabetic foot, including those related to foot RTM. These sessions also are helpful for those familiar with foot temperature monitoring or who are responsible for administration of an ongoing program to remain current with contemporary best practices and to discuss improvements for patient care. Familiarity also can help address clinical inertia when benefits and evidence are clearly communicated with health care providers (HCPs).

Clinical Best Practices

Treating preulcerative lesions urgently and aggressively. Callus and other preulcerative lesions often cause progressive tissue damage and poor outcomes. When identified, these lesions should be promptly treated to ensure best outcomes.²⁴

Recognizing the limits of patient self-examinations. Comorbidities such as visual impairment and reduced joint mobility often preclude patients from completing rigorous self-examinations of the foot, which is especially critical while collecting subjective history from the patient during triage of inflammation. A caregiver or spouse can help inspect the foot during outreach and provide additional context.³⁶

Interpreting a benign foot on examination. Because RTM has been demonstrated to detect inflammation preceding a foot ulcer as many as 5 weeks before presentation to the clinic, some veterans may have few signs or symptoms of acute risk during examination. Often, the damage is to subcutaneous tissue resulting from repetitive microtrauma. Research suggests that clinical examination in these cases is often unreliable for identifying the earliest signs of risk, such as palpation to identify subtle temperature changes secondary to inflammation.³⁷ If a patient has refractory inflammation requiring examination and presents with an otherwise unremarkable foot, it is an opportunity to evaluate whether the patient’s shoewear remains appropriate or has worn out, to communicate the veteran’s ongoing elevated risk, and to educate on the importance of diligence in daily foot self-examinations, daily use of the foot temperature monitoring, and continued off-loading until the inflammation resolves.

Communicating the distinction between healing and remission. Although healing is the goal of wound care, patients should be educated that the underlying disease remains after epithelialization. In some cases, tissue deep to the skin has not completed remodeling, and the patient is at acute risk of recurrence. Remission is a powerful metaphor that better describes the patient’s ongoing risk to encourage continued healthy routines and diligent self-care.³⁸Considering the entirety of both feet for recurrence. Critical risk factors for diabetic foot complications, such as peripheral neuropathy and PAD, exist in both limbs, and patients with a history of wounds often develop new complications to different ipsilateral locations, or in as many as 48% of cases, to the contralateral foot.³⁵ For best outcomes, detected inflammation should be treated aggressively independent of whether the location coincides with an area of previous concern.

Encouraging adherence, routine, and empowerment. Advanced diabetes mellitus and neuropathy may impact a patient’s executive function, and multiple studies have reported that patients at risk for inflammatory foot diseases exhibit fatalism toward their foot care and outcomes.^39-41 Consistent education, encouragement, empowerment, and establishment of positive routines are needed to ensure high adherence with all preventive care regimens, including RTM.

Case Presentations

The following case series illustrates many of these clinical best practices and characterizes the potential benefits of RTM to veterans within the VA.

Case 1: Prevention After Healing

A veteran underwent a Chopart amputation and was recommended to use the mat after healing was perceived. Immediately on use of the study mat, the patient was found to have inflammation to the surgical incision (Figure 1). Clinical staff was alerted to the findings, and the patient was instructed to limit further walking and continue off-loading in his removable cast walker, per protocol. The inflammation of the operative foot quickly reduced, and the patient continued healing successfully, potentially avoiding incisional dehiscence and possible postoperative infection.

This case illustrates that patients’ wounds or surgical incisions may not be completely healed on epithelialization. In the immediate phase after closure, HCPs should consider additional protection to avoid complications. This case demonstrates that RTM can provide objective data to help guide care in that critical period.

Case 2: Identifying Preulcerative Lesions

An 88-year-old veteran had a chronic callus under the second metatarsal head. In addition to routine foot care and therapeutic shoes, he was followed with once-daily RTM. Inflammation was noted, and the veteran was seen in the podiatry clinic where debridement of the callus was performed. The difference in temperatures between feet detected by thermography prior to the clinic visits rapidly resolved after callus debridement, indicating that the underlying inflammation had subsided. RTM was used by the clinical staff to determine the appropriate time interval between clinic visits to avoid callus breakdown and subsequent ulceration.

Case 3: Extending the Clinic Into the Home

An 80-year-old veteran with T2DM and neuropathy was deemed a high-risk patient due to recurrent ulcerations to the left great toe. He was issued a RTM mat and was adherent with routine use. After nearly a year without hot-spot development, inflammation was noted (Figure 2).

Unfortunately, the patient had missed several routine foot care visits and likely that was the reason for the noted inflammation. The patient was called and became reengaged in regular visits for routine foot care. On debridement of his callus, a superficial, noninfected ulceration was discovered. Had remote monitoring not detected the inflammation and impending ulceration, the patient likely would not have been seen in the regular clinic and may have developed a wound infection, potentially resulting in a worse and more costly outcome.

Paradigm Shift to Prevention

Given the exceedingly high burden of diabetic foot complications in the VA, a paradigm shift is needed among HCPs from a culture of treatment to one of prevention. Bus and colleagues reported that in Europe, for every euro spent on ulcer prevention, 10 are spent on ulcer healing, and for every randomized clinical trial conducted on prevention, 10 are conducted on treatment.^42-44 Hicks and colleagues showed that the cost of curative care for DFUs is 5 to 30 times greater than the cost of preventive care.⁴⁵ For RTM in high-risk cohorts (ie, PAVE level 3), the number-needed-to-treat for DFU prevention may be as low as 6, assuming that a 70% reduction in incidence is possible, consistent with previous research. In the year following a DFU, costs exceed $44,000.⁹ Thus, it seems natural that future direction in diabetic foot care should emphasize prevention strategies.

Foot ulcers that become infected often lead to hospitalization and result in an increased burden to an already overburdened VA health care system. Research suggests that about two-thirds of all diabetic foot costs are attributable to inpatient management.⁴⁶ The impact of diabetic foot complications on hospital resource utilization is staggering. A 2017 study by Skrepnik analyzed the risk of hospitalization for various diseases.⁴⁷ The investigators found that the inpatient admission odds ratio (OR) for congestive heart failure was 2.6, surpassed only by DFUs (OR, 3.4) and diabetic foot infection (OR, 6.7). A 2019 point-prevalence study found that > 10% of hospital admissions have a foot-related condition as the primary or secondary reason, and the majority of these are due to foot diseases, such as ulcers, infections, and Charcot neuroarthropathy.⁴⁸

It is therefore incumbent on VA HCPs to avert wound recurrence in the interest of avoiding veteran hospitalizations and for administrators to encourage and incentivize best practices for managing the diabetic foot, with an emphasis on prevention therapies. In evaluating the financial impact of prevention with foot RTM, administrators should consider that the cost benefit is likely to be realized across the medical center, with budgets related to inpatient management likely to receive the largest returns.

Prevention has the potential to rein in costs as well as reduce strain on the hospital and clinic by preventing outcomes that require frequent visits for treatment or hospitalization. Wound treatment is very burdensome to the clinic; patients require frequent (in many cases, weekly) examinations, and chronic wounds often require hospitalization, necessitating rounding and additional coordination in care. Thus, preventing wounds or reducing their severity at presentation substantially reduces burden on the clinic, even after accounting for the modest clinical resources needed to administer preventative care. For example, a brief examination may be necessary if the inflammation detected by the study mat is secondary to a callus that must be debrided. However, if the patient was not seen until the callus had progressed to a wound, weekly follow-up and substantial clinical and budgetary resources may be required to heal the wound. Preventive care allows for substantially better patient outcomes, and the minimal time invested prevents the clinical burden of extensive wound treatment.

The success of preventive efforts relies on multidisciplinary management of this high-risk patient cohort. Often, it is the responsibility of the primary care provider to follow diabetic foot clinical reminders and appropriately refer to specialty care. Successful, open communication between PACT, PAVE, and the Podiatry Service has been shown to reduce poor outcomes, including lower extremity amputations. Traditionally, the model of preventive care has included podiatrist-driven interventions, including integrated routine foot care and comprehensive diabetic foot education. Collaboration between routine evaluation and prompt referral of at-risk patients for specialist foot care, therapeutic footwear recommendations, daily self-foot examinations, and in-home temperature monitoring are critically effective when performed consistently.

When trying to translate research science to effective clinical practice for preventing lower extremity complication, there are several important concepts. First, given the frequency of examination for patients being treated for a wound, provision of good preventive care, such as RTM, can reduce overall burden to resource-constrained clinics and improve access for patients needing to be seen. Additionally, preventive efforts extend clinical practice into the home and may reduce the need for in-clinic examinations and routine follow-up visits. Finally, there may be a sense of trust established between the clinician and patient with a positive record of adherence with preventive practices. This may translate into more productive communication and less frequent routine visits to better accommodate urgent visits and ensure podiatric care is accessible to veterans.

Conclusions

There is a significant opportunity to shift diabetic foot care from treatment to prevention, improving veteran outcomes and reducing resource utilization. RTM is an evidence-based and recommended but underused telemedicine solution that can catalyze this needed paradigm shift. The VA has been at the forefront of preventive foot care through the PAVE program and more recently through research and clinical application of RTM for veterans. However, as the data presented suggest, more can be done to improve veteran outcomes. More widespread adoption of evidence-based preventive technologies for the diabetic foot, such as RTM, has the potential to dramatically improve the quality of and access to care and reduce costs and burden on resource-constrained clinics.

Diabetic foot ulcers (DFUs) are devastating, common, and costly. This burden is borne disproportionately by veterans who have high prevalence of type 2 diabetes mellitus (T2DM) and other precipitating risk factors.¹ The mortality of veterans following a DFU is sobering, and ulceration is recognized as a significant marker of disease severity.

A 2017 study by Brennan and colleagues reported a 19% mortality rate within 1 year, and only 29% survive past 5 years.² DFUs are often complicated by peripheral arterial disease (PAD) and diabetic immune dysfunction, contributing to chronic wounds and infection.^3,4 About 60% of all foot ulcers become infected, and > 20% of patients with a diabetic foot infection require amputation.^5,6

A 2010 retrospective study reports that > 3,400 veterans have a diabetes-related lower extremity amputation annually, vastly surpassing the rate of amputation secondary to trauma in the Veterans Health Administration (VHA).^7,8 The inpatient costs for each amputation exceeded $60,000 in fiscal year 2010, and these amputation-related costs represent only 1 component of the total expense to the VHA attributable to diabetic foot complications.⁷ A recent systematic review by Chan and colleagues estimated mean annual costs in the year following a foot ulcer to be $44,200 to the public payer.⁹ This implies that direct expenditures for treatment of DFUs within the VHA exceeds $3 billion annually.

Diabetic Foot Ulcer Prevention

Given the dramatic impact of diabetic foot complications to the veteran and the US health care system, the VHA has long recognized the importance of preventive care for those at risk. In 2017 US Department of Veterans Affairs (VA) and Department of Defense issued a clinical practice guideline for the management of T2DM that recommended prophylactic foot care for early identification of any deformity or skin breakdown.¹⁰ The guidelines note that a “person who has had a foot ulcer is at lifelong risk of further ulceration,” reflecting the high rate of recurrence among all patients, including veterans. Multiple studies suggest that as many as 40% of patients experience recidivism in the first year after healing from a wound.^11-16

The VA is well equipped to deliver quality preventive care because of its innovative and long-standing PAVE (Prevention of Amputations for Veterans Everywhere) program.¹⁷ PAVE provides screening, education, appropriate footwear, and stratified care guidelines for veterans at risk for diabetes-related foot complications (Table 1). The practices encouraged by PAVE are evidence-based and synergistic with the objectives of the VA’s patient aligned care team (PACT) delivery approach.¹⁸ The granular data collected through PAVE are used to guide best practices and provide benchmarks for diabetic foot outcomes.

Unfortunately, despite PAVE guidelines requiring annual specialist foot care for at-risk veterans, a 2013 report by the VA Office of the Inspector General (OIG) found that one-third of all patients had no documentation of this minimal requirement of preventive foot care.¹⁹ Although the VA has worked to address this issue, the data hint at the missed opportunities for prevention of complications and the challenges of ensuring that a large at-risk veteran population has systematic and routine screening with access to specialist foot care.

Given the large proportion of veterans at high risk of chronic wound formation and the challenges of ensuring that this cohort receives good preventive foot care, expanding telemedicine has been suggested. Telemedicine solutions have the potential to reduce the impact of chronic wounds on overburdened clinic resources, schedules, and local and federal budgets.²⁰ Interestingly, the only preventive practice for the diabetic foot that has been proven effective through multiple randomized controlled trials and national and international clinical guidance documents is once-daily foot temperature monitoring.^21-26 Daily monitoring has the potential to reduce the burden of DFUs to veterans, improve veteran access to needed preventive care, and reduce costs incurred by the VHA treating diabetic foot complications. Yet despite a recent national guidance document detailing its appropriate use in PAVE 3 veterans, it remains underutilized.²⁷

The purpose of this review is to: (1) discuss the evidence supporting once-daily remote temperature monitoring (RTM), a telemedicine approach critical to improving both veteran access to care and diabetic foot outcomes; (2) summarize a 2017 study that presented an advanced clinical understanding of RTM use among veterans; (3) provide previously unpublished data from this study comparing high-risk VA and non-VA cohorts, highlighting the opportunity for additional focus on foot ulcer prevention within the VA; and (4) report on recent VA utilization of a RTM technology based on this research, emphasizing lessons learned and best practices.

Remote Temperature Monitoring

The objective of daily foot temperature monitoring is to identify impending inflammatory foot conditions, such as DFUs, infection, and acute Charcot neuroarthropathy episodes. The patient and care team then act to resolve the cause of detected inflammation before clinical presentation (prevention) and begin treatment earlier than would otherwise be possible to avoid expensive complications, such as infection (early detection). Preventive therapies are low risk to the patient and inexpensive.

RTM is recommended by multiple clinical practice guidelines, including those of the International Working Group on the Diabetic Foot, the American College of Foot and Ankle Surgeons, and the Wound Healing Society.^24-26 Its use is supported by evidence from 3 National Institutes of Health-funded and well-designed randomized controlled trials, 1 of which was additionally supported by a VA Health Services Research and Development Service Merit Award.^21-23,28 Conducted between 2004 and 2007, these studies demonstrated the potential to reduce foot ulcer incidence by as much as 85% using a dermal thermometer to identify inflammation and prompt decreased ambulation. Investigators established a clinical monitoring protocol comparing the temperatures between 6 matched locations on the left and right feet. Persistent differences in contralateral temperatures exceeding 2.2°C (4.0°F) were used as a marker for elevated risk and to initiate preventive care. Based on the encouraging results from these studies, a 2017 effectiveness review prepared for the Agency for Healthcare Research and Quality concluded that “home monitoring of foot skin temperature is effective for reducing foot ulcer incidence and recurrence.”²⁹

Accuracy of RTM

A 2017 longitudinal study (NCT02647346) has provided novel data to advance understanding of RTM for the prediction and prevention of DFUs.³⁰ This study was the first to systematically analyze the accuracy of RTM over different monitoring thresholds. The results enable practitioners to deliver risk-stratified preventive care. Policy makers can use the data from this study to weigh the cost and benefits of RTM for population health.

The multicenter trials had 129 participants from 4 VA health care systems: VA Long Beach Healthcare System in California, Miami VA Healthcare System in Florida, Phoenix VA Healthcare System in Arizona, and VA West Los Angeles Healthcare System in California. Each participant was followed for 34 weeks under standard preventive foot care and was instructed to step on a telemedicine SmartMat (Podimetrics, Inc) RTM mat for 20 seconds daily. Participants and investigators were blinded to the temperature data so that the accuracy of temperature monitoring could be assessed. All participants had a history of T2DM and healed DFU. Principal exclusion criteria included unhealed plantar wound, history of proximal lower extremity amputation (ie, above ankle), active Charcot foot disease, and comorbidities that could potentially inhibit an inflammatory response, such as end-stage renal disease, active malignancy, and immunosuppressive diseases.

The investigators reported that RTM with the study mat detected 97% of nonacute plantar DFUs using the most commonly studied threshold (sustained 2.2°C temperature difference). The lead time averaged 37 days before clinical identification of the wound under standard care. Although the false-positive rate of 57% was high, corresponding to approximately 3.0 notifications per patient per year on average in the research setting, it is important to note that this study only considered the prediction of plantar DFUs. Thus, detection of foot inflammation secondary to other conditions, such as preulcerative lesion, dorsal wound, Charcot neuroarthropathy, or foot infection, were reported as a false positive per the study’s definitions. Further, Crisologo and Lavery noted in a translational medicine summary of this research, because the intervention is noninvasive and minimally impactful to the patient and the health care system, “the potential to arrest re-ulceration is worth the perceived inconvenience to the patient.”³¹

Secondary outcomes related to adherence and ease of use were encouraging. Eighty-eight percent of participants reported that the mat was “very easy to use,” the highest possible score, and 98% were able to set up the mat for home use without difficulty. At the end of the 34-week study, more than 74% of participants remained engaged in routine use of the mat under a per-protocol assessment of adherence. These results are especially impressive given the documented poor adherence of at-risk patients to routine use of therapeutic footwear, which has been reported to be as low as 15%.³²

New Research

The data collected during this study has led to new research and advancements in RTM. A recent publication by Gordon and colleagues investigated whether RTM is less accurate in cohorts with perceived challenges.³³ They include patients with recently healed wounds and those with a history of partial foot amputation. There was no difference in the accuracy or lead time for either cohort relative to the entire cohort, suggesting that RTM is appropriate for monitoring patients with recently healed DFUs or partial foot amputations.

In another recent study, the data were used to derive a novel approach to monitor a single at-risk foot.³⁴ The practice of RTM has traditionally required comparing temperatures between contralaterally matched plantar locations on the feet, thus limiting its use in patients with a history of major lower extremity amputation and patients being treated for a wound, which may be bandaged or in an off-loading cast or boot. Because the risk factors for DFUs exist in both limbs, these patients are at high risk for developing complications to the contralateral foot and may benefit from preventive once-daily foot temperature monitoring. The investigators empirically derived a novel monitoring approach for patients without a contralateral control. This approach was found to predict 91% of impending plantar DFUs on average 41 days before clinical presentation with a false positive rate of 54%.

Additional Focus on Prevention

Table 2 shows previously unpublished data from a subgroup analysis between veteran and nonveteran participants in the study.²⁵ These descriptive statistics reinforce some widely held assumptions regarding the high-risk veteran population and challenge others. For example, compared with the nonveteran participants, the veteran cohort unsurprisingly had a larger ratio of male participants (P < .01), had a higher rate of cigarette use (P < .01), and was more likely to live alone (although not at a statistically significant level). Veterans in the study had body mass index, rates of alcohol use, frequency of exercise, and glucose control comparable to that of nonveterans.

The potential impact of the PAVE program is clear in several of these comparisons. Although as few as 15% of patients use therapeutic shoes routinely, PAVE ensures that the majority of veterans receive them. Nearly 95% of veterans have therapeutic shoes compared with about 80% of nonveteran participants (P < .05). Veterans also had higher ankle-brachial index results (P < .05), although on average both cohorts were within normal clinical parameters. Veterans had a significantly longer duration since healing from the most recent wound, and fewer veteran participants had a wound that healed in the 3 months prior to the study. Despite this, during the study veterans had annualized DFU incidence equal to that of nonveterans. Furthermore, veterans also had significantly higher rates of amputation prior to participation. That these critical outcomes for veterans are no better than those observed in other care environments despite PAVE suggests that approaches recommended via PAVE alone are insufficient to significantly arrest DFU recurrence, and even more focus on prevention in the VA may be warranted.

From Research to Practice

Since the publication of the 2017 study, the VHA has been at the vanguard of translating the evidence and research underlying RTM into clinical practice. A clinical guidance document governing appropriate use of RTM with the study mat was recently published by the VA Prosthetic and Sensory Aids Service in collaboration with the National Podiatry Program office.²⁷ This guidance document recommends once-daily RTM for at-risk veterans designated PAVE level 3. It defines roles and responsibilities required for the successful implementation of a RTM program with the study device. The document additionally presents various clinical monitoring protocols for veterans, although the protocol and thresholds used are at the discretion of the prescribing clinician and should reflect the risk profile of the veteran in question.

A staged response to inflammation has proven popular, whereby an initial high-sensitivity threshold is chosen for monitoring. The initial response is telephone outreach by a designee supplied by the clinic or device manufacturer, typically a trained registered nurse, to the veteran to collect subjective history and instruct off-loading and reduced ambulation, with a target of 50% baseline reduction in step count. Should the inflammation persist despite off-loading, an examination may be necessary to identify and resolve its cause. For recalcitrant inflammation, more targeted pressure off-loading of the affected area may be accomplished with custom orthotics, accommodative insoles, removable cast walkers, and total contact casting. After 2 to 4 weeks without signs of inflammation, the cause is deemed to have been resolved and lowered the acute risk for developing further diabetic foot complications.

More than 600 veterans have been monitored for > 1,000 patient-years—13 VA medical centers are practicing RTM with the study mat as of this writing. The monitoring program has been integrated into many veteran daily routines as evidenced by > 70% retaining full engagement after having been monitored for > 1 year. The total number of alerts/patient-years across these veterans has been 1.4, significantly lower than the 3.0 alerts/patient-year observed in the study. This is potentially due to successful interventions in response to detected inflammation, resolving inflammation, and avoiding unnecessary alerts occurring in the research setting, which did not employ interventions that resolved inflammation episodes. In the past 6 months, 68% of all inflammation detected resolved via off-loading alone without requiring further clinical intervention. In the cases that required an examination, 76% of patients reported clinically meaningful preventive care (eg, preulcerative callus was debrided, a subungual hemorrhage was treated, a foot ulcer was identified).

Organizational Best Practices

Several best practices have been cultivated related to initiating a RTM program at a new site, for promoting the success of a RTM program, and provisioning excellent preventive care to support the RTM program. Although we advise adhering to the recommendations in the VA guidance document,²⁷ the authors have observed several additional organizational best practices that are not explicitly addressed.

Partnering with PACT. Collaboration between PAVE and PACT has the potential not only to improve outcomes for patients at risk for diabetic foot complications, but also can help identify appropriate high-risk veteran candidates for preventive care with RTM who may not be followed for routine care from a specialty provider, such as a podiatrist, as highlighted by the 2013 OIG report.

Prescreening eligible patients. Several programs have used PAVE data or appointment schedules to identify and target high-risk veterans proactively. This approach has several benefits. It simplifies clinical coordination and streamlines workflow for patient identification and onboarding. It also allows those veterans at highest risk to receive needed and recommended preventive care at their next scheduled appointment. Finally, if PAVE data are used to identify eligible patients, it has the added benefit of ensuring a baseline level of telemedicine preventive foot care for veterans who have become lost to follow-up and have not been seen recently for a routine foot examination.

Implementing foot monitoring during wound treatment. Recent research has expanded the reach of once-daily RTM with the mat to patients being treated for a wound to only 1 foot. This practice has 2 benefits: The patient is able to establish a preventive routine before healing, an important advantage because research strongly suggests that recurrence is most likely in the first months after healing. Second, 48% of patients with a history of DFUs will develop new wounds to the contralateral foot because risk factors, such as neuropathy and peripheral arterial disease, exist in both limbs.³⁵ Furthermore, ongoing treatment for a wound to 1 foot may result in gait deviation and elevated pressure to the sound foot, additionally predisposing the veteran to complications, resulting in a high rate of wounds occurring to the unwounded foot during treatment (0.2 DFU/DFU-year).³⁴ Thus, there is potential benefit in monitoring the sound foot while undergoing treatment for a wound; further, the patient will have immediate access to the device for prevention of recurrence once the wound has resolved.

Utilizing foot monitoring as an extension of telemedicine. Many VA facilities have large geographic catchment areas, making routine follow-up difficult for veterans living in rural areas. RTM serves as an extension of the patient’s daily self-examination and the clinician’s ability to monitor patients with objective information daily. The veterans using the system become more invested and feel as though they are taking an active role in their health care.

Investing in ongoing medical education. Multidisciplinary education sessions reviewing supporting clinical data and resultant clinical practice guidelines raise awareness for those providers and trainees unaware of preventive best practices for the diabetic foot, including those related to foot RTM. These sessions also are helpful for those familiar with foot temperature monitoring or who are responsible for administration of an ongoing program to remain current with contemporary best practices and to discuss improvements for patient care. Familiarity also can help address clinical inertia when benefits and evidence are clearly communicated with health care providers (HCPs).

Clinical Best Practices

Treating preulcerative lesions urgently and aggressively. Callus and other preulcerative lesions often cause progressive tissue damage and poor outcomes. When identified, these lesions should be promptly treated to ensure best outcomes.²⁴

Recognizing the limits of patient self-examinations. Comorbidities such as visual impairment and reduced joint mobility often preclude patients from completing rigorous self-examinations of the foot, which is especially critical while collecting subjective history from the patient during triage of inflammation. A caregiver or spouse can help inspect the foot during outreach and provide additional context.³⁶

Interpreting a benign foot on examination. Because RTM has been demonstrated to detect inflammation preceding a foot ulcer as many as 5 weeks before presentation to the clinic, some veterans may have few signs or symptoms of acute risk during examination. Often, the damage is to subcutaneous tissue resulting from repetitive microtrauma. Research suggests that clinical examination in these cases is often unreliable for identifying the earliest signs of risk, such as palpation to identify subtle temperature changes secondary to inflammation.³⁷ If a patient has refractory inflammation requiring examination and presents with an otherwise unremarkable foot, it is an opportunity to evaluate whether the patient’s shoewear remains appropriate or has worn out, to communicate the veteran’s ongoing elevated risk, and to educate on the importance of diligence in daily foot self-examinations, daily use of the foot temperature monitoring, and continued off-loading until the inflammation resolves.

Communicating the distinction between healing and remission. Although healing is the goal of wound care, patients should be educated that the underlying disease remains after epithelialization. In some cases, tissue deep to the skin has not completed remodeling, and the patient is at acute risk of recurrence. Remission is a powerful metaphor that better describes the patient’s ongoing risk to encourage continued healthy routines and diligent self-care.³⁸Considering the entirety of both feet for recurrence. Critical risk factors for diabetic foot complications, such as peripheral neuropathy and PAD, exist in both limbs, and patients with a history of wounds often develop new complications to different ipsilateral locations, or in as many as 48% of cases, to the contralateral foot.³⁵ For best outcomes, detected inflammation should be treated aggressively independent of whether the location coincides with an area of previous concern.

Encouraging adherence, routine, and empowerment. Advanced diabetes mellitus and neuropathy may impact a patient’s executive function, and multiple studies have reported that patients at risk for inflammatory foot diseases exhibit fatalism toward their foot care and outcomes.^39-41 Consistent education, encouragement, empowerment, and establishment of positive routines are needed to ensure high adherence with all preventive care regimens, including RTM.

Case Presentations

The following case series illustrates many of these clinical best practices and characterizes the potential benefits of RTM to veterans within the VA.

Case 1: Prevention After Healing

A veteran underwent a Chopart amputation and was recommended to use the mat after healing was perceived. Immediately on use of the study mat, the patient was found to have inflammation to the surgical incision (Figure 1). Clinical staff was alerted to the findings, and the patient was instructed to limit further walking and continue off-loading in his removable cast walker, per protocol. The inflammation of the operative foot quickly reduced, and the patient continued healing successfully, potentially avoiding incisional dehiscence and possible postoperative infection.

This case illustrates that patients’ wounds or surgical incisions may not be completely healed on epithelialization. In the immediate phase after closure, HCPs should consider additional protection to avoid complications. This case demonstrates that RTM can provide objective data to help guide care in that critical period.

Case 2: Identifying Preulcerative Lesions

An 88-year-old veteran had a chronic callus under the second metatarsal head. In addition to routine foot care and therapeutic shoes, he was followed with once-daily RTM. Inflammation was noted, and the veteran was seen in the podiatry clinic where debridement of the callus was performed. The difference in temperatures between feet detected by thermography prior to the clinic visits rapidly resolved after callus debridement, indicating that the underlying inflammation had subsided. RTM was used by the clinical staff to determine the appropriate time interval between clinic visits to avoid callus breakdown and subsequent ulceration.

Case 3: Extending the Clinic Into the Home

An 80-year-old veteran with T2DM and neuropathy was deemed a high-risk patient due to recurrent ulcerations to the left great toe. He was issued a RTM mat and was adherent with routine use. After nearly a year without hot-spot development, inflammation was noted (Figure 2).

Unfortunately, the patient had missed several routine foot care visits and likely that was the reason for the noted inflammation. The patient was called and became reengaged in regular visits for routine foot care. On debridement of his callus, a superficial, noninfected ulceration was discovered. Had remote monitoring not detected the inflammation and impending ulceration, the patient likely would not have been seen in the regular clinic and may have developed a wound infection, potentially resulting in a worse and more costly outcome.

Paradigm Shift to Prevention

Given the exceedingly high burden of diabetic foot complications in the VA, a paradigm shift is needed among HCPs from a culture of treatment to one of prevention. Bus and colleagues reported that in Europe, for every euro spent on ulcer prevention, 10 are spent on ulcer healing, and for every randomized clinical trial conducted on prevention, 10 are conducted on treatment.^42-44 Hicks and colleagues showed that the cost of curative care for DFUs is 5 to 30 times greater than the cost of preventive care.⁴⁵ For RTM in high-risk cohorts (ie, PAVE level 3), the number-needed-to-treat for DFU prevention may be as low as 6, assuming that a 70% reduction in incidence is possible, consistent with previous research. In the year following a DFU, costs exceed $44,000.⁹ Thus, it seems natural that future direction in diabetic foot care should emphasize prevention strategies.

Foot ulcers that become infected often lead to hospitalization and result in an increased burden to an already overburdened VA health care system. Research suggests that about two-thirds of all diabetic foot costs are attributable to inpatient management.⁴⁶ The impact of diabetic foot complications on hospital resource utilization is staggering. A 2017 study by Skrepnik analyzed the risk of hospitalization for various diseases.⁴⁷ The investigators found that the inpatient admission odds ratio (OR) for congestive heart failure was 2.6, surpassed only by DFUs (OR, 3.4) and diabetic foot infection (OR, 6.7). A 2019 point-prevalence study found that > 10% of hospital admissions have a foot-related condition as the primary or secondary reason, and the majority of these are due to foot diseases, such as ulcers, infections, and Charcot neuroarthropathy.⁴⁸

It is therefore incumbent on VA HCPs to avert wound recurrence in the interest of avoiding veteran hospitalizations and for administrators to encourage and incentivize best practices for managing the diabetic foot, with an emphasis on prevention therapies. In evaluating the financial impact of prevention with foot RTM, administrators should consider that the cost benefit is likely to be realized across the medical center, with budgets related to inpatient management likely to receive the largest returns.

Prevention has the potential to rein in costs as well as reduce strain on the hospital and clinic by preventing outcomes that require frequent visits for treatment or hospitalization. Wound treatment is very burdensome to the clinic; patients require frequent (in many cases, weekly) examinations, and chronic wounds often require hospitalization, necessitating rounding and additional coordination in care. Thus, preventing wounds or reducing their severity at presentation substantially reduces burden on the clinic, even after accounting for the modest clinical resources needed to administer preventative care. For example, a brief examination may be necessary if the inflammation detected by the study mat is secondary to a callus that must be debrided. However, if the patient was not seen until the callus had progressed to a wound, weekly follow-up and substantial clinical and budgetary resources may be required to heal the wound. Preventive care allows for substantially better patient outcomes, and the minimal time invested prevents the clinical burden of extensive wound treatment.

The success of preventive efforts relies on multidisciplinary management of this high-risk patient cohort. Often, it is the responsibility of the primary care provider to follow diabetic foot clinical reminders and appropriately refer to specialty care. Successful, open communication between PACT, PAVE, and the Podiatry Service has been shown to reduce poor outcomes, including lower extremity amputations. Traditionally, the model of preventive care has included podiatrist-driven interventions, including integrated routine foot care and comprehensive diabetic foot education. Collaboration between routine evaluation and prompt referral of at-risk patients for specialist foot care, therapeutic footwear recommendations, daily self-foot examinations, and in-home temperature monitoring are critically effective when performed consistently.

When trying to translate research science to effective clinical practice for preventing lower extremity complication, there are several important concepts. First, given the frequency of examination for patients being treated for a wound, provision of good preventive care, such as RTM, can reduce overall burden to resource-constrained clinics and improve access for patients needing to be seen. Additionally, preventive efforts extend clinical practice into the home and may reduce the need for in-clinic examinations and routine follow-up visits. Finally, there may be a sense of trust established between the clinician and patient with a positive record of adherence with preventive practices. This may translate into more productive communication and less frequent routine visits to better accommodate urgent visits and ensure podiatric care is accessible to veterans.

Conclusions

There is a significant opportunity to shift diabetic foot care from treatment to prevention, improving veteran outcomes and reducing resource utilization. RTM is an evidence-based and recommended but underused telemedicine solution that can catalyze this needed paradigm shift. The VA has been at the forefront of preventive foot care through the PAVE program and more recently through research and clinical application of RTM for veterans. However, as the data presented suggest, more can be done to improve veteran outcomes. More widespread adoption of evidence-based preventive technologies for the diabetic foot, such as RTM, has the potential to dramatically improve the quality of and access to care and reduce costs and burden on resource-constrained clinics.

Diabetic foot ulcers (DFUs) are devastating, common, and costly. This burden is borne disproportionately by veterans who have high prevalence of type 2 diabetes mellitus (T2DM) and other precipitating risk factors.¹ The mortality of veterans following a DFU is sobering, and ulceration is recognized as a significant marker of disease severity.

A 2017 study by Brennan and colleagues reported a 19% mortality rate within 1 year, and only 29% survive past 5 years.² DFUs are often complicated by peripheral arterial disease (PAD) and diabetic immune dysfunction, contributing to chronic wounds and infection.^3,4 About 60% of all foot ulcers become infected, and > 20% of patients with a diabetic foot infection require amputation.^5,6

A 2010 retrospective study reports that > 3,400 veterans have a diabetes-related lower extremity amputation annually, vastly surpassing the rate of amputation secondary to trauma in the Veterans Health Administration (VHA).^7,8 The inpatient costs for each amputation exceeded $60,000 in fiscal year 2010, and these amputation-related costs represent only 1 component of the total expense to the VHA attributable to diabetic foot complications.⁷ A recent systematic review by Chan and colleagues estimated mean annual costs in the year following a foot ulcer to be $44,200 to the public payer.⁹ This implies that direct expenditures for treatment of DFUs within the VHA exceeds $3 billion annually.

Diabetic Foot Ulcer Prevention

Given the dramatic impact of diabetic foot complications to the veteran and the US health care system, the VHA has long recognized the importance of preventive care for those at risk. In 2017 US Department of Veterans Affairs (VA) and Department of Defense issued a clinical practice guideline for the management of T2DM that recommended prophylactic foot care for early identification of any deformity or skin breakdown.¹⁰ The guidelines note that a “person who has had a foot ulcer is at lifelong risk of further ulceration,” reflecting the high rate of recurrence among all patients, including veterans. Multiple studies suggest that as many as 40% of patients experience recidivism in the first year after healing from a wound.^11-16

The VA is well equipped to deliver quality preventive care because of its innovative and long-standing PAVE (Prevention of Amputations for Veterans Everywhere) program.¹⁷ PAVE provides screening, education, appropriate footwear, and stratified care guidelines for veterans at risk for diabetes-related foot complications (Table 1). The practices encouraged by PAVE are evidence-based and synergistic with the objectives of the VA’s patient aligned care team (PACT) delivery approach.¹⁸ The granular data collected through PAVE are used to guide best practices and provide benchmarks for diabetic foot outcomes.

Unfortunately, despite PAVE guidelines requiring annual specialist foot care for at-risk veterans, a 2013 report by the VA Office of the Inspector General (OIG) found that one-third of all patients had no documentation of this minimal requirement of preventive foot care.¹⁹ Although the VA has worked to address this issue, the data hint at the missed opportunities for prevention of complications and the challenges of ensuring that a large at-risk veteran population has systematic and routine screening with access to specialist foot care.

Given the large proportion of veterans at high risk of chronic wound formation and the challenges of ensuring that this cohort receives good preventive foot care, expanding telemedicine has been suggested. Telemedicine solutions have the potential to reduce the impact of chronic wounds on overburdened clinic resources, schedules, and local and federal budgets.²⁰ Interestingly, the only preventive practice for the diabetic foot that has been proven effective through multiple randomized controlled trials and national and international clinical guidance documents is once-daily foot temperature monitoring.^21-26 Daily monitoring has the potential to reduce the burden of DFUs to veterans, improve veteran access to needed preventive care, and reduce costs incurred by the VHA treating diabetic foot complications. Yet despite a recent national guidance document detailing its appropriate use in PAVE 3 veterans, it remains underutilized.²⁷

The purpose of this review is to: (1) discuss the evidence supporting once-daily remote temperature monitoring (RTM), a telemedicine approach critical to improving both veteran access to care and diabetic foot outcomes; (2) summarize a 2017 study that presented an advanced clinical understanding of RTM use among veterans; (3) provide previously unpublished data from this study comparing high-risk VA and non-VA cohorts, highlighting the opportunity for additional focus on foot ulcer prevention within the VA; and (4) report on recent VA utilization of a RTM technology based on this research, emphasizing lessons learned and best practices.

Remote Temperature Monitoring

The objective of daily foot temperature monitoring is to identify impending inflammatory foot conditions, such as DFUs, infection, and acute Charcot neuroarthropathy episodes. The patient and care team then act to resolve the cause of detected inflammation before clinical presentation (prevention) and begin treatment earlier than would otherwise be possible to avoid expensive complications, such as infection (early detection). Preventive therapies are low risk to the patient and inexpensive.

RTM is recommended by multiple clinical practice guidelines, including those of the International Working Group on the Diabetic Foot, the American College of Foot and Ankle Surgeons, and the Wound Healing Society.^24-26 Its use is supported by evidence from 3 National Institutes of Health-funded and well-designed randomized controlled trials, 1 of which was additionally supported by a VA Health Services Research and Development Service Merit Award.^21-23,28 Conducted between 2004 and 2007, these studies demonstrated the potential to reduce foot ulcer incidence by as much as 85% using a dermal thermometer to identify inflammation and prompt decreased ambulation. Investigators established a clinical monitoring protocol comparing the temperatures between 6 matched locations on the left and right feet. Persistent differences in contralateral temperatures exceeding 2.2°C (4.0°F) were used as a marker for elevated risk and to initiate preventive care. Based on the encouraging results from these studies, a 2017 effectiveness review prepared for the Agency for Healthcare Research and Quality concluded that “home monitoring of foot skin temperature is effective for reducing foot ulcer incidence and recurrence.”²⁹

Accuracy of RTM

A 2017 longitudinal study (NCT02647346) has provided novel data to advance understanding of RTM for the prediction and prevention of DFUs.³⁰ This study was the first to systematically analyze the accuracy of RTM over different monitoring thresholds. The results enable practitioners to deliver risk-stratified preventive care. Policy makers can use the data from this study to weigh the cost and benefits of RTM for population health.

The multicenter trials had 129 participants from 4 VA health care systems: VA Long Beach Healthcare System in California, Miami VA Healthcare System in Florida, Phoenix VA Healthcare System in Arizona, and VA West Los Angeles Healthcare System in California. Each participant was followed for 34 weeks under standard preventive foot care and was instructed to step on a telemedicine SmartMat (Podimetrics, Inc) RTM mat for 20 seconds daily. Participants and investigators were blinded to the temperature data so that the accuracy of temperature monitoring could be assessed. All participants had a history of T2DM and healed DFU. Principal exclusion criteria included unhealed plantar wound, history of proximal lower extremity amputation (ie, above ankle), active Charcot foot disease, and comorbidities that could potentially inhibit an inflammatory response, such as end-stage renal disease, active malignancy, and immunosuppressive diseases.

The investigators reported that RTM with the study mat detected 97% of nonacute plantar DFUs using the most commonly studied threshold (sustained 2.2°C temperature difference). The lead time averaged 37 days before clinical identification of the wound under standard care. Although the false-positive rate of 57% was high, corresponding to approximately 3.0 notifications per patient per year on average in the research setting, it is important to note that this study only considered the prediction of plantar DFUs. Thus, detection of foot inflammation secondary to other conditions, such as preulcerative lesion, dorsal wound, Charcot neuroarthropathy, or foot infection, were reported as a false positive per the study’s definitions. Further, Crisologo and Lavery noted in a translational medicine summary of this research, because the intervention is noninvasive and minimally impactful to the patient and the health care system, “the potential to arrest re-ulceration is worth the perceived inconvenience to the patient.”³¹

Secondary outcomes related to adherence and ease of use were encouraging. Eighty-eight percent of participants reported that the mat was “very easy to use,” the highest possible score, and 98% were able to set up the mat for home use without difficulty. At the end of the 34-week study, more than 74% of participants remained engaged in routine use of the mat under a per-protocol assessment of adherence. These results are especially impressive given the documented poor adherence of at-risk patients to routine use of therapeutic footwear, which has been reported to be as low as 15%.³²

New Research

The data collected during this study has led to new research and advancements in RTM. A recent publication by Gordon and colleagues investigated whether RTM is less accurate in cohorts with perceived challenges.³³ They include patients with recently healed wounds and those with a history of partial foot amputation. There was no difference in the accuracy or lead time for either cohort relative to the entire cohort, suggesting that RTM is appropriate for monitoring patients with recently healed DFUs or partial foot amputations.

In another recent study, the data were used to derive a novel approach to monitor a single at-risk foot.³⁴ The practice of RTM has traditionally required comparing temperatures between contralaterally matched plantar locations on the feet, thus limiting its use in patients with a history of major lower extremity amputation and patients being treated for a wound, which may be bandaged or in an off-loading cast or boot. Because the risk factors for DFUs exist in both limbs, these patients are at high risk for developing complications to the contralateral foot and may benefit from preventive once-daily foot temperature monitoring. The investigators empirically derived a novel monitoring approach for patients without a contralateral control. This approach was found to predict 91% of impending plantar DFUs on average 41 days before clinical presentation with a false positive rate of 54%.

Additional Focus on Prevention

Table 2 shows previously unpublished data from a subgroup analysis between veteran and nonveteran participants in the study.²⁵ These descriptive statistics reinforce some widely held assumptions regarding the high-risk veteran population and challenge others. For example, compared with the nonveteran participants, the veteran cohort unsurprisingly had a larger ratio of male participants (P < .01), had a higher rate of cigarette use (P < .01), and was more likely to live alone (although not at a statistically significant level). Veterans in the study had body mass index, rates of alcohol use, frequency of exercise, and glucose control comparable to that of nonveterans.

The potential impact of the PAVE program is clear in several of these comparisons. Although as few as 15% of patients use therapeutic shoes routinely, PAVE ensures that the majority of veterans receive them. Nearly 95% of veterans have therapeutic shoes compared with about 80% of nonveteran participants (P < .05). Veterans also had higher ankle-brachial index results (P < .05), although on average both cohorts were within normal clinical parameters. Veterans had a significantly longer duration since healing from the most recent wound, and fewer veteran participants had a wound that healed in the 3 months prior to the study. Despite this, during the study veterans had annualized DFU incidence equal to that of nonveterans. Furthermore, veterans also had significantly higher rates of amputation prior to participation. That these critical outcomes for veterans are no better than those observed in other care environments despite PAVE suggests that approaches recommended via PAVE alone are insufficient to significantly arrest DFU recurrence, and even more focus on prevention in the VA may be warranted.

From Research to Practice

Since the publication of the 2017 study, the VHA has been at the vanguard of translating the evidence and research underlying RTM into clinical practice. A clinical guidance document governing appropriate use of RTM with the study mat was recently published by the VA Prosthetic and Sensory Aids Service in collaboration with the National Podiatry Program office.²⁷ This guidance document recommends once-daily RTM for at-risk veterans designated PAVE level 3. It defines roles and responsibilities required for the successful implementation of a RTM program with the study device. The document additionally presents various clinical monitoring protocols for veterans, although the protocol and thresholds used are at the discretion of the prescribing clinician and should reflect the risk profile of the veteran in question.

A staged response to inflammation has proven popular, whereby an initial high-sensitivity threshold is chosen for monitoring. The initial response is telephone outreach by a designee supplied by the clinic or device manufacturer, typically a trained registered nurse, to the veteran to collect subjective history and instruct off-loading and reduced ambulation, with a target of 50% baseline reduction in step count. Should the inflammation persist despite off-loading, an examination may be necessary to identify and resolve its cause. For recalcitrant inflammation, more targeted pressure off-loading of the affected area may be accomplished with custom orthotics, accommodative insoles, removable cast walkers, and total contact casting. After 2 to 4 weeks without signs of inflammation, the cause is deemed to have been resolved and lowered the acute risk for developing further diabetic foot complications.

More than 600 veterans have been monitored for > 1,000 patient-years—13 VA medical centers are practicing RTM with the study mat as of this writing. The monitoring program has been integrated into many veteran daily routines as evidenced by > 70% retaining full engagement after having been monitored for > 1 year. The total number of alerts/patient-years across these veterans has been 1.4, significantly lower than the 3.0 alerts/patient-year observed in the study. This is potentially due to successful interventions in response to detected inflammation, resolving inflammation, and avoiding unnecessary alerts occurring in the research setting, which did not employ interventions that resolved inflammation episodes. In the past 6 months, 68% of all inflammation detected resolved via off-loading alone without requiring further clinical intervention. In the cases that required an examination, 76% of patients reported clinically meaningful preventive care (eg, preulcerative callus was debrided, a subungual hemorrhage was treated, a foot ulcer was identified).

Organizational Best Practices

Several best practices have been cultivated related to initiating a RTM program at a new site, for promoting the success of a RTM program, and provisioning excellent preventive care to support the RTM program. Although we advise adhering to the recommendations in the VA guidance document,²⁷ the authors have observed several additional organizational best practices that are not explicitly addressed.

Partnering with PACT. Collaboration between PAVE and PACT has the potential not only to improve outcomes for patients at risk for diabetic foot complications, but also can help identify appropriate high-risk veteran candidates for preventive care with RTM who may not be followed for routine care from a specialty provider, such as a podiatrist, as highlighted by the 2013 OIG report.

Prescreening eligible patients. Several programs have used PAVE data or appointment schedules to identify and target high-risk veterans proactively. This approach has several benefits. It simplifies clinical coordination and streamlines workflow for patient identification and onboarding. It also allows those veterans at highest risk to receive needed and recommended preventive care at their next scheduled appointment. Finally, if PAVE data are used to identify eligible patients, it has the added benefit of ensuring a baseline level of telemedicine preventive foot care for veterans who have become lost to follow-up and have not been seen recently for a routine foot examination.

Implementing foot monitoring during wound treatment. Recent research has expanded the reach of once-daily RTM with the mat to patients being treated for a wound to only 1 foot. This practice has 2 benefits: The patient is able to establish a preventive routine before healing, an important advantage because research strongly suggests that recurrence is most likely in the first months after healing. Second, 48% of patients with a history of DFUs will develop new wounds to the contralateral foot because risk factors, such as neuropathy and peripheral arterial disease, exist in both limbs.³⁵ Furthermore, ongoing treatment for a wound to 1 foot may result in gait deviation and elevated pressure to the sound foot, additionally predisposing the veteran to complications, resulting in a high rate of wounds occurring to the unwounded foot during treatment (0.2 DFU/DFU-year).³⁴ Thus, there is potential benefit in monitoring the sound foot while undergoing treatment for a wound; further, the patient will have immediate access to the device for prevention of recurrence once the wound has resolved.

Utilizing foot monitoring as an extension of telemedicine. Many VA facilities have large geographic catchment areas, making routine follow-up difficult for veterans living in rural areas. RTM serves as an extension of the patient’s daily self-examination and the clinician’s ability to monitor patients with objective information daily. The veterans using the system become more invested and feel as though they are taking an active role in their health care.

Investing in ongoing medical education. Multidisciplinary education sessions reviewing supporting clinical data and resultant clinical practice guidelines raise awareness for those providers and trainees unaware of preventive best practices for the diabetic foot, including those related to foot RTM. These sessions also are helpful for those familiar with foot temperature monitoring or who are responsible for administration of an ongoing program to remain current with contemporary best practices and to discuss improvements for patient care. Familiarity also can help address clinical inertia when benefits and evidence are clearly communicated with health care providers (HCPs).

Clinical Best Practices

Treating preulcerative lesions urgently and aggressively. Callus and other preulcerative lesions often cause progressive tissue damage and poor outcomes. When identified, these lesions should be promptly treated to ensure best outcomes.²⁴

Recognizing the limits of patient self-examinations. Comorbidities such as visual impairment and reduced joint mobility often preclude patients from completing rigorous self-examinations of the foot, which is especially critical while collecting subjective history from the patient during triage of inflammation. A caregiver or spouse can help inspect the foot during outreach and provide additional context.³⁶

Interpreting a benign foot on examination. Because RTM has been demonstrated to detect inflammation preceding a foot ulcer as many as 5 weeks before presentation to the clinic, some veterans may have few signs or symptoms of acute risk during examination. Often, the damage is to subcutaneous tissue resulting from repetitive microtrauma. Research suggests that clinical examination in these cases is often unreliable for identifying the earliest signs of risk, such as palpation to identify subtle temperature changes secondary to inflammation.³⁷ If a patient has refractory inflammation requiring examination and presents with an otherwise unremarkable foot, it is an opportunity to evaluate whether the patient’s shoewear remains appropriate or has worn out, to communicate the veteran’s ongoing elevated risk, and to educate on the importance of diligence in daily foot self-examinations, daily use of the foot temperature monitoring, and continued off-loading until the inflammation resolves.

Communicating the distinction between healing and remission. Although healing is the goal of wound care, patients should be educated that the underlying disease remains after epithelialization. In some cases, tissue deep to the skin has not completed remodeling, and the patient is at acute risk of recurrence. Remission is a powerful metaphor that better describes the patient’s ongoing risk to encourage continued healthy routines and diligent self-care.³⁸Considering the entirety of both feet for recurrence. Critical risk factors for diabetic foot complications, such as peripheral neuropathy and PAD, exist in both limbs, and patients with a history of wounds often develop new complications to different ipsilateral locations, or in as many as 48% of cases, to the contralateral foot.³⁵ For best outcomes, detected inflammation should be treated aggressively independent of whether the location coincides with an area of previous concern.

Encouraging adherence, routine, and empowerment. Advanced diabetes mellitus and neuropathy may impact a patient’s executive function, and multiple studies have reported that patients at risk for inflammatory foot diseases exhibit fatalism toward their foot care and outcomes.^39-41 Consistent education, encouragement, empowerment, and establishment of positive routines are needed to ensure high adherence with all preventive care regimens, including RTM.

Case Presentations

The following case series illustrates many of these clinical best practices and characterizes the potential benefits of RTM to veterans within the VA.

Case 1: Prevention After Healing

A veteran underwent a Chopart amputation and was recommended to use the mat after healing was perceived. Immediately on use of the study mat, the patient was found to have inflammation to the surgical incision (Figure 1). Clinical staff was alerted to the findings, and the patient was instructed to limit further walking and continue off-loading in his removable cast walker, per protocol. The inflammation of the operative foot quickly reduced, and the patient continued healing successfully, potentially avoiding incisional dehiscence and possible postoperative infection.

This case illustrates that patients’ wounds or surgical incisions may not be completely healed on epithelialization. In the immediate phase after closure, HCPs should consider additional protection to avoid complications. This case demonstrates that RTM can provide objective data to help guide care in that critical period.

Case 2: Identifying Preulcerative Lesions

An 88-year-old veteran had a chronic callus under the second metatarsal head. In addition to routine foot care and therapeutic shoes, he was followed with once-daily RTM. Inflammation was noted, and the veteran was seen in the podiatry clinic where debridement of the callus was performed. The difference in temperatures between feet detected by thermography prior to the clinic visits rapidly resolved after callus debridement, indicating that the underlying inflammation had subsided. RTM was used by the clinical staff to determine the appropriate time interval between clinic visits to avoid callus breakdown and subsequent ulceration.

Case 3: Extending the Clinic Into the Home

An 80-year-old veteran with T2DM and neuropathy was deemed a high-risk patient due to recurrent ulcerations to the left great toe. He was issued a RTM mat and was adherent with routine use. After nearly a year without hot-spot development, inflammation was noted (Figure 2).

Unfortunately, the patient had missed several routine foot care visits and likely that was the reason for the noted inflammation. The patient was called and became reengaged in regular visits for routine foot care. On debridement of his callus, a superficial, noninfected ulceration was discovered. Had remote monitoring not detected the inflammation and impending ulceration, the patient likely would not have been seen in the regular clinic and may have developed a wound infection, potentially resulting in a worse and more costly outcome.

Paradigm Shift to Prevention

Given the exceedingly high burden of diabetic foot complications in the VA, a paradigm shift is needed among HCPs from a culture of treatment to one of prevention. Bus and colleagues reported that in Europe, for every euro spent on ulcer prevention, 10 are spent on ulcer healing, and for every randomized clinical trial conducted on prevention, 10 are conducted on treatment.^42-44 Hicks and colleagues showed that the cost of curative care for DFUs is 5 to 30 times greater than the cost of preventive care.⁴⁵ For RTM in high-risk cohorts (ie, PAVE level 3), the number-needed-to-treat for DFU prevention may be as low as 6, assuming that a 70% reduction in incidence is possible, consistent with previous research. In the year following a DFU, costs exceed $44,000.⁹ Thus, it seems natural that future direction in diabetic foot care should emphasize prevention strategies.

Foot ulcers that become infected often lead to hospitalization and result in an increased burden to an already overburdened VA health care system. Research suggests that about two-thirds of all diabetic foot costs are attributable to inpatient management.⁴⁶ The impact of diabetic foot complications on hospital resource utilization is staggering. A 2017 study by Skrepnik analyzed the risk of hospitalization for various diseases.⁴⁷ The investigators found that the inpatient admission odds ratio (OR) for congestive heart failure was 2.6, surpassed only by DFUs (OR, 3.4) and diabetic foot infection (OR, 6.7). A 2019 point-prevalence study found that > 10% of hospital admissions have a foot-related condition as the primary or secondary reason, and the majority of these are due to foot diseases, such as ulcers, infections, and Charcot neuroarthropathy.⁴⁸

It is therefore incumbent on VA HCPs to avert wound recurrence in the interest of avoiding veteran hospitalizations and for administrators to encourage and incentivize best practices for managing the diabetic foot, with an emphasis on prevention therapies. In evaluating the financial impact of prevention with foot RTM, administrators should consider that the cost benefit is likely to be realized across the medical center, with budgets related to inpatient management likely to receive the largest returns.

Prevention has the potential to rein in costs as well as reduce strain on the hospital and clinic by preventing outcomes that require frequent visits for treatment or hospitalization. Wound treatment is very burdensome to the clinic; patients require frequent (in many cases, weekly) examinations, and chronic wounds often require hospitalization, necessitating rounding and additional coordination in care. Thus, preventing wounds or reducing their severity at presentation substantially reduces burden on the clinic, even after accounting for the modest clinical resources needed to administer preventative care. For example, a brief examination may be necessary if the inflammation detected by the study mat is secondary to a callus that must be debrided. However, if the patient was not seen until the callus had progressed to a wound, weekly follow-up and substantial clinical and budgetary resources may be required to heal the wound. Preventive care allows for substantially better patient outcomes, and the minimal time invested prevents the clinical burden of extensive wound treatment.

The success of preventive efforts relies on multidisciplinary management of this high-risk patient cohort. Often, it is the responsibility of the primary care provider to follow diabetic foot clinical reminders and appropriately refer to specialty care. Successful, open communication between PACT, PAVE, and the Podiatry Service has been shown to reduce poor outcomes, including lower extremity amputations. Traditionally, the model of preventive care has included podiatrist-driven interventions, including integrated routine foot care and comprehensive diabetic foot education. Collaboration between routine evaluation and prompt referral of at-risk patients for specialist foot care, therapeutic footwear recommendations, daily self-foot examinations, and in-home temperature monitoring are critically effective when performed consistently.

When trying to translate research science to effective clinical practice for preventing lower extremity complication, there are several important concepts. First, given the frequency of examination for patients being treated for a wound, provision of good preventive care, such as RTM, can reduce overall burden to resource-constrained clinics and improve access for patients needing to be seen. Additionally, preventive efforts extend clinical practice into the home and may reduce the need for in-clinic examinations and routine follow-up visits. Finally, there may be a sense of trust established between the clinician and patient with a positive record of adherence with preventive practices. This may translate into more productive communication and less frequent routine visits to better accommodate urgent visits and ensure podiatric care is accessible to veterans.

Conclusions

There is a significant opportunity to shift diabetic foot care from treatment to prevention, improving veteran outcomes and reducing resource utilization. RTM is an evidence-based and recommended but underused telemedicine solution that can catalyze this needed paradigm shift. The VA has been at the forefront of preventive foot care through the PAVE program and more recently through research and clinical application of RTM for veterans. However, as the data presented suggest, more can be done to improve veteran outcomes. More widespread adoption of evidence-based preventive technologies for the diabetic foot, such as RTM, has the potential to dramatically improve the quality of and access to care and reduce costs and burden on resource-constrained clinics.

To the Editor:

Nail biopsy is an important surgical procedure for diagnosis of nail pathology. YouTube has become a potential instrument for physicians and patients to learn about medical procedures.^1,2 However, the sources, content, and quality of the information available have not been fully studied or characterized. Our objective was to analyze the efficiency of information and quality of YouTube videos on nail biopsies. We hypothesized that the quality of patient education and physician training videos would be unrepresentative on YouTube.

The term nail biopsy was searched on January 29, 2019, and filtered by relevance and rating using the default YouTube algorithm. Data were collected from the top 40 hits for the search term and filter coupling. All videos were viewed and sorted for nail biopsy procedures, and then those videos were categorized as being produced by a physician or other health care provider. The US medical board status of each physician videographer was determined using the American Board of Medical Specialties database.³ DISCERN criteria for assessing consumer health care information⁴ were used to interpret the videos by researchers (S.I. and S.R.L.) in this study.

From the queried search term collection, only 10 videos (1,023,423 combined views) were analyzed in this study (eTable). Although the other resulting videos were tagged as nail biopsy, they were excluded due to irrelevant content (eg, patient blogs, PowerPoints, nail avulsions). The mean age of the videos was 4 years (range, 4 days to 11 years), with a mean video length of 3.30 minutes (range, 49 seconds to 9.03 minutes). Four of 10 videos were performed for longitudinal melanonychia, and 5 of 10 videos were performed for melanonychia, clinically consistent with subungual hematoma. Dermatologists, plastic surgeons, and podiatrists produced the majority of the nail biopsy videos. The overall mean DISCERN rating was 1.60/5.00 (range, 1–3), meaning that the quality of content on nail biopsies was poor. This low DISCERN score signifies poor consumer health information. Video 2 (published in 2015) received a DISCERN score of 2 and received almost 1 million views, which is likely because the specific channel has a well-established subscriber pool (4.9 million subscribers). The highest DISCERN score of 3, demonstrating a tangential shave biopsy, was given to video 4 (published in 2010) and only received about 17,400 views (56 subscribers). Additionally, many videos lacked important information about the procedure. For instance, only 3 of 10 videos demonstrated the anesthetic technique and only 5 videos showed repair methods.

To the Editor:

Nail biopsy is an important surgical procedure for diagnosis of nail pathology. YouTube has become a potential instrument for physicians and patients to learn about medical procedures.^1,2 However, the sources, content, and quality of the information available have not been fully studied or characterized. Our objective was to analyze the efficiency of information and quality of YouTube videos on nail biopsies. We hypothesized that the quality of patient education and physician training videos would be unrepresentative on YouTube.

The term nail biopsy was searched on January 29, 2019, and filtered by relevance and rating using the default YouTube algorithm. Data were collected from the top 40 hits for the search term and filter coupling. All videos were viewed and sorted for nail biopsy procedures, and then those videos were categorized as being produced by a physician or other health care provider. The US medical board status of each physician videographer was determined using the American Board of Medical Specialties database.³ DISCERN criteria for assessing consumer health care information⁴ were used to interpret the videos by researchers (S.I. and S.R.L.) in this study.

From the queried search term collection, only 10 videos (1,023,423 combined views) were analyzed in this study (eTable). Although the other resulting videos were tagged as nail biopsy, they were excluded due to irrelevant content (eg, patient blogs, PowerPoints, nail avulsions). The mean age of the videos was 4 years (range, 4 days to 11 years), with a mean video length of 3.30 minutes (range, 49 seconds to 9.03 minutes). Four of 10 videos were performed for longitudinal melanonychia, and 5 of 10 videos were performed for melanonychia, clinically consistent with subungual hematoma. Dermatologists, plastic surgeons, and podiatrists produced the majority of the nail biopsy videos. The overall mean DISCERN rating was 1.60/5.00 (range, 1–3), meaning that the quality of content on nail biopsies was poor. This low DISCERN score signifies poor consumer health information. Video 2 (published in 2015) received a DISCERN score of 2 and received almost 1 million views, which is likely because the specific channel has a well-established subscriber pool (4.9 million subscribers). The highest DISCERN score of 3, demonstrating a tangential shave biopsy, was given to video 4 (published in 2010) and only received about 17,400 views (56 subscribers). Additionally, many videos lacked important information about the procedure. For instance, only 3 of 10 videos demonstrated the anesthetic technique and only 5 videos showed repair methods.

To the Editor:

Nail biopsy is an important surgical procedure for diagnosis of nail pathology. YouTube has become a potential instrument for physicians and patients to learn about medical procedures.^1,2 However, the sources, content, and quality of the information available have not been fully studied or characterized. Our objective was to analyze the efficiency of information and quality of YouTube videos on nail biopsies. We hypothesized that the quality of patient education and physician training videos would be unrepresentative on YouTube.

The term nail biopsy was searched on January 29, 2019, and filtered by relevance and rating using the default YouTube algorithm. Data were collected from the top 40 hits for the search term and filter coupling. All videos were viewed and sorted for nail biopsy procedures, and then those videos were categorized as being produced by a physician or other health care provider. The US medical board status of each physician videographer was determined using the American Board of Medical Specialties database.³ DISCERN criteria for assessing consumer health care information⁴ were used to interpret the videos by researchers (S.I. and S.R.L.) in this study.

From the queried search term collection, only 10 videos (1,023,423 combined views) were analyzed in this study (eTable). Although the other resulting videos were tagged as nail biopsy, they were excluded due to irrelevant content (eg, patient blogs, PowerPoints, nail avulsions). The mean age of the videos was 4 years (range, 4 days to 11 years), with a mean video length of 3.30 minutes (range, 49 seconds to 9.03 minutes). Four of 10 videos were performed for longitudinal melanonychia, and 5 of 10 videos were performed for melanonychia, clinically consistent with subungual hematoma. Dermatologists, plastic surgeons, and podiatrists produced the majority of the nail biopsy videos. The overall mean DISCERN rating was 1.60/5.00 (range, 1–3), meaning that the quality of content on nail biopsies was poor. This low DISCERN score signifies poor consumer health information. Video 2 (published in 2015) received a DISCERN score of 2 and received almost 1 million views, which is likely because the specific channel has a well-established subscriber pool (4.9 million subscribers). The highest DISCERN score of 3, demonstrating a tangential shave biopsy, was given to video 4 (published in 2010) and only received about 17,400 views (56 subscribers). Additionally, many videos lacked important information about the procedure. For instance, only 3 of 10 videos demonstrated the anesthetic technique and only 5 videos showed repair methods.

Psoriasis is a common chronic inflammatory disease affecting a diverse patient population, yet epidemiological and clinical data related to psoriasis in patients with skin of color are sparse. The Hispanic ethnic group includes a broad range of skin types and cultures. Prevalence of psoriasis in a Hispanic population has been reported as lower than in a white population¹; however, these data may be influenced by the finding that Hispanic patients are less likely to see a dermatologist when they have skin problems.² In addition, socioeconomic disparities and cultural variations among racial/ethnic groups may contribute to differences in access to care and thresholds for seeking care,³ leading to a tendency for more severe disease in skin of color and Hispanic ethnic groups.^4,5 Greater impairments in health-related quality of life have been reported in patients with skin of color and Hispanic racial/ethnic groups compared to white patients, independent of psoriasis severity.^4,6 Postinflammatory pigment alteration at the sites of resolving lesions, a common clinical feature in skin of color, may contribute to the impact of psoriasis on quality of life in patients with skin of color. Psoriasis in darker skin types also can present diagnostic challenges due to overlapping features with other papulosquamous disorders and less conspicuous erythema.⁷

We present a post hoc analysis of the treatment of moderate to severe psoriasis with a novel fixed-combination halobetasol propionate (HP) 0.01%–tazarotene (TAZ) 0.045% lotion in a Hispanic patient population. Historically, clinical trials for psoriasis have enrolled low proportions of Hispanic patients and other patients with skin of color; in this analysis, the Hispanic population (115/418) represented 28% of the total study population and provided valuable insights.

Methods

Study Design
Two phase 3 randomized controlled trials were conducted to demonstrate the efficacy and safety of HP/TAZ lotion. Patients with a clinical diagnosis of moderate or severe localized psoriasis (N=418) were randomized to receive HP/TAZ lotion or vehicle (2:1 ratio) once daily for 8 weeks with a 4-week posttreatment follow-up.^8,9 A post hoc analysis was conducted on data of the self-identified Hispanic population.

Assessments
Efficacy assessments included treatment success (at least a 2-grade improvement from baseline in the investigator global assessment [IGA] and a score of clear or almost clear) and impact on individual signs of psoriasis (at least a 2-grade improvement in erythema, plaque elevation, and scaling) at the target lesion. In addition, reduction in body surface area (BSA) was recorded, and an IGA×BSA score was calculated by multiplying IGA by BSA at each timepoint for each individual patient. A clinically meaningful improvement in disease severity (percentage of patients achieving a 75% reduction in IGA×BSA [IGA×BSA-75]) also was calculated.

Information on reported and observed adverse events (AEs) was obtained at each visit. The safety population included 112 participants (76 in the HP/TAZ group and 36 in the vehicle group).

Statistical Analysis
The statistical and analytical plan is detailed elsewhere⁹ and relevant to this post hoc analysis. No statistical analysis was carried out to compare data in the Hispanic population with either the overall study population or the non-Hispanic population.

Results

Overall, 115 Hispanic patients (27.5%) were enrolled (eFigure). Patients had a mean (standard deviation [SD]) age of 46.7 (13.12) years, and more than two-thirds were male (n=80, 69.6%).

Overall completion rates (80.0%) for Hispanic patients were similar to those in the overall study population, though there were more discontinuations in the vehicle group. The main reasons for treatment discontinuation among Hispanic patients were participant request (n=8, 7.0%), lost to follow-up (n=8, 7.0%), and AEs (n=4, 3.5%). Hispanic patients in this study had more severe disease—18.3% (n=21) had an IGA score of 4 compared to 13.5% (n=41) of non-Hispanic patients—and more severe erythema (19.1% vs 9.6%), plaque elevation (20.0% vs 10.2%), and scaling (15.7% vs 12.9%) compared to the non-Hispanic populations (Table).

Efficacy of HP/TAZ lotion in Hispanic patients was similar to the overall study populations,⁹ though maintenance of effect posttreatment appeared to be better. The incidence of treatment-related AEs also was lower.

Halobetasol propionate 0.01%–TAZ 0.045% lotion demonstrated statistically significant superiority based on treatment success compared to vehicle as early as week 4 (P=.034). By week 8, 39.3% of participants treated with HP/TAZ lotion achieved treatment success compared to 9.3% of participants in the vehicle group (P=.002)(Figure 1). Treatment success was maintained over the 4-week posttreatment period, whereby 40.5% of the HP/TAZ-treated participants were treatment successes at week 12 compared to only 4.1% of participants in the vehicle group (P<.001).

For Hispanic participants overall, 34 participants reported AEs: 26 (34.2%) treated with HP/TAZ lotion and 8 (22.2%) treated with vehicle (eTable). There was 1 (1.3%) serious AE in the HP/TAZ group. Most of the AEs were mild or moderate, with approximately half being related to study treatment. The most common treatment-related AEs in Hispanic participants treated with HP/TAZ lotion were contact dermatitis (n=3, 3.9%) and skin atrophy (n=3, 3.9%) compared to contact dermatitis (n=14, 7.2%) and application-site pain (n=7, 3.6%) in the non-Hispanic population. Pruritus was the most common AE in Hispanic participants treated with vehicle.

Comment

The large number of Hispanic patients in the 2 phase 3 trials^8,9 allowed for this valuable subgroup analysis on the topical treatment of Hispanic patients with plaque psoriasis. Validation of observed differences in maintenance of effect and tolerability warrant further study. Prior clinical studies in psoriasis have tended to enroll a small proportion of Hispanic patients without any post hoc analysis. For example, in a pooled analysis of 4 phase 3 trials with secukinumab, Hispanic patients accounted for only 16% of the overall population.¹¹ In our analysis, the Hispanic cohort represented 28% of the overall study population of 2 phase 3 studies investigating the efficacy, safety, and tolerability of HP/TAZ lotion in patients with moderate to severe psoriasis.^8,9 In addition, proportionately more Hispanic patients had severe disease (IGA of 4) or severe signs and symptoms of psoriasis (erythema, plaque elevation, and scaling) than the non-Hispanic population. This finding supports other studies that have suggested Hispanic patients with psoriasis tend to have more severe disease but also may reflect thresholds for seeking care.^3-5

Halobetasol propionate 0.01%–TAZ 0.045% lotion was significantly more effective than vehicle for all efficacy assessments. In general, efficacy results with HP/TAZ lotion were similar to those reported in the overall phase 3 study populations over the 8-week treatment period. The only noticeable difference was in the posttreatment period. In the overall study population, efficacy was maintained over the 4-week posttreatment period in the HP/TAZ group. In the Hispanic subpopulation, there appeared to be continued improvement in the number of participants achieving treatment success (IGA and erythema), clinically meaningful success, and further reductions in BSA. Although there is a paucity of studies evaluating psoriasis therapies in Hispanic populations, data on etanercept and secukinumab have been published.^6,11

Onset of effect also is an important aspect of treatment. In patients with skin of color, including patients of Hispanic ethnicity and higher Fitzpatrick skin phototypes, early clearance of lesions may help limit the severity and duration of postinflammatory pigment alteration. Improvements in IGA×BSA scores were significant compared to vehicle from week 2 (P=.016), and a clinically meaningful improvement with HP/TAZ lotion (IGA×BSA-75) was seen by week 4 (P=.024).

Halobetasol propionate 0.01%–TAZ 0.045% lotion was well tolerated, both in the 2 phase 3 studies and in the post hoc analysis of the Hispanic subpopulation. The incidence of skin atrophy (n=3, 3.9%) was more common vs the non-Hispanic population (n=2, 1.0%). Other common AEs—contact dermatitis, pruritus, and application-site pain—were more common in the non-Hispanic population.

A limitation of our analysis was that it was a post hoc analysis of the Hispanic participants. The phase 3 studies were not designed to specifically study the impact of treatment on ethnicity/race, though the number of Hispanic participants enrolled in the 2 studies was relatively high. The absence of Fitzpatrick skin phototypes in this data set is another limitation of this study.

Conclusion

Halobetasol propionate 0.01%–TAZ 0.045% lotion was associated with significant, rapid, and sustained reductions in disease severity in a Hispanic population with moderate to severe psoriasis that continued to show improvement posttreatment with good tolerability and safety.



Acknowledgments
We thank Brian Bulley, MSc (Konic Limited, United Kingdom), for assistance with the preparation of the manuscript. Ortho Dermatologics funded Konic’s activities pertaining to this manuscript.

Psoriasis is a common chronic inflammatory disease affecting a diverse patient population, yet epidemiological and clinical data related to psoriasis in patients with skin of color are sparse. The Hispanic ethnic group includes a broad range of skin types and cultures. Prevalence of psoriasis in a Hispanic population has been reported as lower than in a white population¹; however, these data may be influenced by the finding that Hispanic patients are less likely to see a dermatologist when they have skin problems.² In addition, socioeconomic disparities and cultural variations among racial/ethnic groups may contribute to differences in access to care and thresholds for seeking care,³ leading to a tendency for more severe disease in skin of color and Hispanic ethnic groups.^4,5 Greater impairments in health-related quality of life have been reported in patients with skin of color and Hispanic racial/ethnic groups compared to white patients, independent of psoriasis severity.^4,6 Postinflammatory pigment alteration at the sites of resolving lesions, a common clinical feature in skin of color, may contribute to the impact of psoriasis on quality of life in patients with skin of color. Psoriasis in darker skin types also can present diagnostic challenges due to overlapping features with other papulosquamous disorders and less conspicuous erythema.⁷

We present a post hoc analysis of the treatment of moderate to severe psoriasis with a novel fixed-combination halobetasol propionate (HP) 0.01%–tazarotene (TAZ) 0.045% lotion in a Hispanic patient population. Historically, clinical trials for psoriasis have enrolled low proportions of Hispanic patients and other patients with skin of color; in this analysis, the Hispanic population (115/418) represented 28% of the total study population and provided valuable insights.

Methods

Study Design
Two phase 3 randomized controlled trials were conducted to demonstrate the efficacy and safety of HP/TAZ lotion. Patients with a clinical diagnosis of moderate or severe localized psoriasis (N=418) were randomized to receive HP/TAZ lotion or vehicle (2:1 ratio) once daily for 8 weeks with a 4-week posttreatment follow-up.^8,9 A post hoc analysis was conducted on data of the self-identified Hispanic population.

Assessments
Efficacy assessments included treatment success (at least a 2-grade improvement from baseline in the investigator global assessment [IGA] and a score of clear or almost clear) and impact on individual signs of psoriasis (at least a 2-grade improvement in erythema, plaque elevation, and scaling) at the target lesion. In addition, reduction in body surface area (BSA) was recorded, and an IGA×BSA score was calculated by multiplying IGA by BSA at each timepoint for each individual patient. A clinically meaningful improvement in disease severity (percentage of patients achieving a 75% reduction in IGA×BSA [IGA×BSA-75]) also was calculated.

Information on reported and observed adverse events (AEs) was obtained at each visit. The safety population included 112 participants (76 in the HP/TAZ group and 36 in the vehicle group).

Statistical Analysis
The statistical and analytical plan is detailed elsewhere⁹ and relevant to this post hoc analysis. No statistical analysis was carried out to compare data in the Hispanic population with either the overall study population or the non-Hispanic population.

Results

Overall, 115 Hispanic patients (27.5%) were enrolled (eFigure). Patients had a mean (standard deviation [SD]) age of 46.7 (13.12) years, and more than two-thirds were male (n=80, 69.6%).

Overall completion rates (80.0%) for Hispanic patients were similar to those in the overall study population, though there were more discontinuations in the vehicle group. The main reasons for treatment discontinuation among Hispanic patients were participant request (n=8, 7.0%), lost to follow-up (n=8, 7.0%), and AEs (n=4, 3.5%). Hispanic patients in this study had more severe disease—18.3% (n=21) had an IGA score of 4 compared to 13.5% (n=41) of non-Hispanic patients—and more severe erythema (19.1% vs 9.6%), plaque elevation (20.0% vs 10.2%), and scaling (15.7% vs 12.9%) compared to the non-Hispanic populations (Table).

Efficacy of HP/TAZ lotion in Hispanic patients was similar to the overall study populations,⁹ though maintenance of effect posttreatment appeared to be better. The incidence of treatment-related AEs also was lower.

Halobetasol propionate 0.01%–TAZ 0.045% lotion demonstrated statistically significant superiority based on treatment success compared to vehicle as early as week 4 (P=.034). By week 8, 39.3% of participants treated with HP/TAZ lotion achieved treatment success compared to 9.3% of participants in the vehicle group (P=.002)(Figure 1). Treatment success was maintained over the 4-week posttreatment period, whereby 40.5% of the HP/TAZ-treated participants were treatment successes at week 12 compared to only 4.1% of participants in the vehicle group (P<.001).

For Hispanic participants overall, 34 participants reported AEs: 26 (34.2%) treated with HP/TAZ lotion and 8 (22.2%) treated with vehicle (eTable). There was 1 (1.3%) serious AE in the HP/TAZ group. Most of the AEs were mild or moderate, with approximately half being related to study treatment. The most common treatment-related AEs in Hispanic participants treated with HP/TAZ lotion were contact dermatitis (n=3, 3.9%) and skin atrophy (n=3, 3.9%) compared to contact dermatitis (n=14, 7.2%) and application-site pain (n=7, 3.6%) in the non-Hispanic population. Pruritus was the most common AE in Hispanic participants treated with vehicle.

Comment

The large number of Hispanic patients in the 2 phase 3 trials^8,9 allowed for this valuable subgroup analysis on the topical treatment of Hispanic patients with plaque psoriasis. Validation of observed differences in maintenance of effect and tolerability warrant further study. Prior clinical studies in psoriasis have tended to enroll a small proportion of Hispanic patients without any post hoc analysis. For example, in a pooled analysis of 4 phase 3 trials with secukinumab, Hispanic patients accounted for only 16% of the overall population.¹¹ In our analysis, the Hispanic cohort represented 28% of the overall study population of 2 phase 3 studies investigating the efficacy, safety, and tolerability of HP/TAZ lotion in patients with moderate to severe psoriasis.^8,9 In addition, proportionately more Hispanic patients had severe disease (IGA of 4) or severe signs and symptoms of psoriasis (erythema, plaque elevation, and scaling) than the non-Hispanic population. This finding supports other studies that have suggested Hispanic patients with psoriasis tend to have more severe disease but also may reflect thresholds for seeking care.^3-5

Halobetasol propionate 0.01%–TAZ 0.045% lotion was significantly more effective than vehicle for all efficacy assessments. In general, efficacy results with HP/TAZ lotion were similar to those reported in the overall phase 3 study populations over the 8-week treatment period. The only noticeable difference was in the posttreatment period. In the overall study population, efficacy was maintained over the 4-week posttreatment period in the HP/TAZ group. In the Hispanic subpopulation, there appeared to be continued improvement in the number of participants achieving treatment success (IGA and erythema), clinically meaningful success, and further reductions in BSA. Although there is a paucity of studies evaluating psoriasis therapies in Hispanic populations, data on etanercept and secukinumab have been published.^6,11

Onset of effect also is an important aspect of treatment. In patients with skin of color, including patients of Hispanic ethnicity and higher Fitzpatrick skin phototypes, early clearance of lesions may help limit the severity and duration of postinflammatory pigment alteration. Improvements in IGA×BSA scores were significant compared to vehicle from week 2 (P=.016), and a clinically meaningful improvement with HP/TAZ lotion (IGA×BSA-75) was seen by week 4 (P=.024).

Halobetasol propionate 0.01%–TAZ 0.045% lotion was well tolerated, both in the 2 phase 3 studies and in the post hoc analysis of the Hispanic subpopulation. The incidence of skin atrophy (n=3, 3.9%) was more common vs the non-Hispanic population (n=2, 1.0%). Other common AEs—contact dermatitis, pruritus, and application-site pain—were more common in the non-Hispanic population.

A limitation of our analysis was that it was a post hoc analysis of the Hispanic participants. The phase 3 studies were not designed to specifically study the impact of treatment on ethnicity/race, though the number of Hispanic participants enrolled in the 2 studies was relatively high. The absence of Fitzpatrick skin phototypes in this data set is another limitation of this study.

Conclusion

Halobetasol propionate 0.01%–TAZ 0.045% lotion was associated with significant, rapid, and sustained reductions in disease severity in a Hispanic population with moderate to severe psoriasis that continued to show improvement posttreatment with good tolerability and safety.



Acknowledgments
We thank Brian Bulley, MSc (Konic Limited, United Kingdom), for assistance with the preparation of the manuscript. Ortho Dermatologics funded Konic’s activities pertaining to this manuscript.

Psoriasis is a common chronic inflammatory disease affecting a diverse patient population, yet epidemiological and clinical data related to psoriasis in patients with skin of color are sparse. The Hispanic ethnic group includes a broad range of skin types and cultures. Prevalence of psoriasis in a Hispanic population has been reported as lower than in a white population¹; however, these data may be influenced by the finding that Hispanic patients are less likely to see a dermatologist when they have skin problems.² In addition, socioeconomic disparities and cultural variations among racial/ethnic groups may contribute to differences in access to care and thresholds for seeking care,³ leading to a tendency for more severe disease in skin of color and Hispanic ethnic groups.^4,5 Greater impairments in health-related quality of life have been reported in patients with skin of color and Hispanic racial/ethnic groups compared to white patients, independent of psoriasis severity.^4,6 Postinflammatory pigment alteration at the sites of resolving lesions, a common clinical feature in skin of color, may contribute to the impact of psoriasis on quality of life in patients with skin of color. Psoriasis in darker skin types also can present diagnostic challenges due to overlapping features with other papulosquamous disorders and less conspicuous erythema.⁷

We present a post hoc analysis of the treatment of moderate to severe psoriasis with a novel fixed-combination halobetasol propionate (HP) 0.01%–tazarotene (TAZ) 0.045% lotion in a Hispanic patient population. Historically, clinical trials for psoriasis have enrolled low proportions of Hispanic patients and other patients with skin of color; in this analysis, the Hispanic population (115/418) represented 28% of the total study population and provided valuable insights.

Methods

Study Design
Two phase 3 randomized controlled trials were conducted to demonstrate the efficacy and safety of HP/TAZ lotion. Patients with a clinical diagnosis of moderate or severe localized psoriasis (N=418) were randomized to receive HP/TAZ lotion or vehicle (2:1 ratio) once daily for 8 weeks with a 4-week posttreatment follow-up.^8,9 A post hoc analysis was conducted on data of the self-identified Hispanic population.

Assessments
Efficacy assessments included treatment success (at least a 2-grade improvement from baseline in the investigator global assessment [IGA] and a score of clear or almost clear) and impact on individual signs of psoriasis (at least a 2-grade improvement in erythema, plaque elevation, and scaling) at the target lesion. In addition, reduction in body surface area (BSA) was recorded, and an IGA×BSA score was calculated by multiplying IGA by BSA at each timepoint for each individual patient. A clinically meaningful improvement in disease severity (percentage of patients achieving a 75% reduction in IGA×BSA [IGA×BSA-75]) also was calculated.

Information on reported and observed adverse events (AEs) was obtained at each visit. The safety population included 112 participants (76 in the HP/TAZ group and 36 in the vehicle group).

Statistical Analysis
The statistical and analytical plan is detailed elsewhere⁹ and relevant to this post hoc analysis. No statistical analysis was carried out to compare data in the Hispanic population with either the overall study population or the non-Hispanic population.

Results

Overall, 115 Hispanic patients (27.5%) were enrolled (eFigure). Patients had a mean (standard deviation [SD]) age of 46.7 (13.12) years, and more than two-thirds were male (n=80, 69.6%).

Overall completion rates (80.0%) for Hispanic patients were similar to those in the overall study population, though there were more discontinuations in the vehicle group. The main reasons for treatment discontinuation among Hispanic patients were participant request (n=8, 7.0%), lost to follow-up (n=8, 7.0%), and AEs (n=4, 3.5%). Hispanic patients in this study had more severe disease—18.3% (n=21) had an IGA score of 4 compared to 13.5% (n=41) of non-Hispanic patients—and more severe erythema (19.1% vs 9.6%), plaque elevation (20.0% vs 10.2%), and scaling (15.7% vs 12.9%) compared to the non-Hispanic populations (Table).

Efficacy of HP/TAZ lotion in Hispanic patients was similar to the overall study populations,⁹ though maintenance of effect posttreatment appeared to be better. The incidence of treatment-related AEs also was lower.

Halobetasol propionate 0.01%–TAZ 0.045% lotion demonstrated statistically significant superiority based on treatment success compared to vehicle as early as week 4 (P=.034). By week 8, 39.3% of participants treated with HP/TAZ lotion achieved treatment success compared to 9.3% of participants in the vehicle group (P=.002)(Figure 1). Treatment success was maintained over the 4-week posttreatment period, whereby 40.5% of the HP/TAZ-treated participants were treatment successes at week 12 compared to only 4.1% of participants in the vehicle group (P<.001).

For Hispanic participants overall, 34 participants reported AEs: 26 (34.2%) treated with HP/TAZ lotion and 8 (22.2%) treated with vehicle (eTable). There was 1 (1.3%) serious AE in the HP/TAZ group. Most of the AEs were mild or moderate, with approximately half being related to study treatment. The most common treatment-related AEs in Hispanic participants treated with HP/TAZ lotion were contact dermatitis (n=3, 3.9%) and skin atrophy (n=3, 3.9%) compared to contact dermatitis (n=14, 7.2%) and application-site pain (n=7, 3.6%) in the non-Hispanic population. Pruritus was the most common AE in Hispanic participants treated with vehicle.

Comment

The large number of Hispanic patients in the 2 phase 3 trials^8,9 allowed for this valuable subgroup analysis on the topical treatment of Hispanic patients with plaque psoriasis. Validation of observed differences in maintenance of effect and tolerability warrant further study. Prior clinical studies in psoriasis have tended to enroll a small proportion of Hispanic patients without any post hoc analysis. For example, in a pooled analysis of 4 phase 3 trials with secukinumab, Hispanic patients accounted for only 16% of the overall population.¹¹ In our analysis, the Hispanic cohort represented 28% of the overall study population of 2 phase 3 studies investigating the efficacy, safety, and tolerability of HP/TAZ lotion in patients with moderate to severe psoriasis.^8,9 In addition, proportionately more Hispanic patients had severe disease (IGA of 4) or severe signs and symptoms of psoriasis (erythema, plaque elevation, and scaling) than the non-Hispanic population. This finding supports other studies that have suggested Hispanic patients with psoriasis tend to have more severe disease but also may reflect thresholds for seeking care.^3-5

Halobetasol propionate 0.01%–TAZ 0.045% lotion was significantly more effective than vehicle for all efficacy assessments. In general, efficacy results with HP/TAZ lotion were similar to those reported in the overall phase 3 study populations over the 8-week treatment period. The only noticeable difference was in the posttreatment period. In the overall study population, efficacy was maintained over the 4-week posttreatment period in the HP/TAZ group. In the Hispanic subpopulation, there appeared to be continued improvement in the number of participants achieving treatment success (IGA and erythema), clinically meaningful success, and further reductions in BSA. Although there is a paucity of studies evaluating psoriasis therapies in Hispanic populations, data on etanercept and secukinumab have been published.^6,11

Onset of effect also is an important aspect of treatment. In patients with skin of color, including patients of Hispanic ethnicity and higher Fitzpatrick skin phototypes, early clearance of lesions may help limit the severity and duration of postinflammatory pigment alteration. Improvements in IGA×BSA scores were significant compared to vehicle from week 2 (P=.016), and a clinically meaningful improvement with HP/TAZ lotion (IGA×BSA-75) was seen by week 4 (P=.024).

Halobetasol propionate 0.01%–TAZ 0.045% lotion was well tolerated, both in the 2 phase 3 studies and in the post hoc analysis of the Hispanic subpopulation. The incidence of skin atrophy (n=3, 3.9%) was more common vs the non-Hispanic population (n=2, 1.0%). Other common AEs—contact dermatitis, pruritus, and application-site pain—were more common in the non-Hispanic population.

A limitation of our analysis was that it was a post hoc analysis of the Hispanic participants. The phase 3 studies were not designed to specifically study the impact of treatment on ethnicity/race, though the number of Hispanic participants enrolled in the 2 studies was relatively high. The absence of Fitzpatrick skin phototypes in this data set is another limitation of this study.

Conclusion

Halobetasol propionate 0.01%–TAZ 0.045% lotion was associated with significant, rapid, and sustained reductions in disease severity in a Hispanic population with moderate to severe psoriasis that continued to show improvement posttreatment with good tolerability and safety.



Acknowledgments
We thank Brian Bulley, MSc (Konic Limited, United Kingdom), for assistance with the preparation of the manuscript. Ortho Dermatologics funded Konic’s activities pertaining to this manuscript.

Porphyria cutanea tarda (PCT) is the most common type of porphyria. The accumulation of porphyrin in various organ systems results from a deficiency of uroporphyrinogen decarboxylase (UROD).^1-3 Chronic hepatitis C virus (HCV) causes a hepatic decrease in hepcidin production, resulting in increased iron absorption. Iron loading and increased oxidative stress in the liver leads to nonporphyrin inhibition of UROD production and to oxidation of porphyrinogens to porphyrins.⁴ This in turn leads to accumulation of uroporphyrins and carboxylated metabolites that can be detected in urine.⁴

Signs of PCT include blisters, vesicles, and possibly milia developing on sun-exposed areas of the skin, such as the face, forearms, and dorsal hands.⁴ Case reports have demonstrated a resolution of PCT in patients with chronic HCV with treatment with direct-acting antivirals (DAAs), such as ledipasvir/sofosbuvir.^1,3 However, here we present 2 cases of patients who developed blistering diseases during treatment of chronic HCV with ledipasvir/sofosbuvir. Neither demonstrated complete resolution of symptoms during the treatment regimen.

Cases

Patient 1

A 63-year-old white male with a history of chronic HCV (genotype 1a), bipolar disorder, hyperlipidemia, tobacco dependence, and cirrhosis (F4 by elastography) presented with minimally to moderately painful blisters on his bilateral dorsal hands that had developed around weeks 8 to 9 of treatment with ledipasvir/sofosbuvir. The patient reported that no new blisters had appeared following completion of 12 weeks of treatment and that his current blisters were in various stages of healing. He reported alcohol use of 1 to 2 twelve-ounce beers daily and no history of dioxin exposure. His medications included doxepin, hydralazine, hydrochlorothiazide, quetiapine, folic acid, and thiamine. His hepatitis C viral load was 440,000 IU/mL prior to treatment. Tests for hepatitis B surface antigen and HIV antibodies were negative. His iron level was 135 µg/dL, total iron-binding capacity (TIBC) was 323 µg/dL, and ferritin was 299.0 ng/mL. His HFEgene was negative for mutations. Following 4 weeks of treatment with ledipasvir/sofosbuvir, a hepatitis C viral load was not detected.

A physical examination on presentation revealed erosions with overlying hemorrhagic crusts on the bilateral dorsal hands (Figure). 

At the 4-month follow-up, the patient reported no new blister formations. A physical examination revealed well-healed scars and several clustered milia on bilateral dorsal hands with no active vesicles or bullae noted.

Patient 2

An African American male aged 63 years presented with a 1-month history of moderately painful blisters on his bilateral dorsal hands during treatment of chronic HCV (genotype 1a) with ledipasvir/sofosbuvir. His medical history included gout, tobacco and alcohol addiction, osteoarthritis, and hepatic fibrosis (F3 by elastography). The patient’s medications included allopurinol, lisinopril, and hydrochlorothiazide. He reported no history of dioxin exposure. On the day of presentation, he was on week 9 of the 12-week treatment ledipasvir/sofosbuvir regimen. Laboratory results included an initial HCV viral load of 1,618,605 IU/mL. Tests for hepatitis B surface antigen and HIV antibodies were negative. His iron was 191 µg/dL, TIBC 388 µg/dL, and ferritin 459.0 ng/mL. After 4 weeks of treatment, the patient’s hepatitis C viral load was undetectable.

A physical examination revealed several resolving erosions to his bilateral dorsal hands, some of which had overlying crusting along with one small hemorrhagic vesicle on the right dorsal hand. A punch biopsy of the hemorrhagic vesicle was performed and demonstrated a cell-poor subepidermal blister with festooning of the dermal papilla. A direct immunofluorescence study showed immunoglobulin (Ig) G fluorescence along the dermal-epidermal junction and within vessel walls in the superficial dermis. Weak IgM and C3 fluorescence also was noted within vessel walls in the superficial dermis. All of the patient findings and history were consistent with PCT, although pseudo-PCT also was a consideration. A 24-hour urine sample yielded negative results for porphobilinogen. Urine porphyrin test results were not available, leading to a presumptive histological diagnosis of PCT.

The patient completed 11 of the prescribed 12 weeks of ledipasvir/sofosbuvir. The blisters resolved shortly thereafter.

Discussion

PCT has a well-established association with chronic HCV infection.⁴ We present 2 cases of a blistering disease clinically and histologically compatible with PCT that developed in patients only after initiation of treatment for chronic HCV with ledipasvir/sofosbuvir. One case was confirmed as PCT on the basis of compatible histopathologic findings and a urine porphyrin assay that showed elevated levels of uroporphyrins and carboxylated metabolites. The second case was clinically and histologically suggestive of PCT but not confirmed by urine porphyrin testing. In both patients, after 8 to 9 weeks of a 12-week course of antiviral therapy, the blistering lesions were noted but appeared to be resolving, and no new lesions were noted after discontinuation of therapy. It appeared that the antiviral treatment temporally triggered the initiation of the blistering skin disease, and as the chronic HCV infection cleared after treatment, the blistering lesions also began to resolve.

Mechanistically, it is known that the virally-induced hepatic damage leads to inhibition of uroporphyrinogen decarboxylase, and the subsequent oxidation of porphyrinogens to porphyrins. Cofactors such as HIV infection also may contribute to development of PCT.⁵

De novo PCT has been documented during therapy using interferon and ribavirin.⁶ The hemolytic anemia and increased hepatic iron were implicated as potential etiologies.⁶ Patients with HCV and PCT treated with the newer direct-acting antiviral therapies have been described to have experienced improvement in PCT symptoms.³

Although there were rare reports of deterioration in renal and liver function,⁷ reactivation of HBV infection,⁸ and Stevens-Johnson syndrome⁹ with antiviral therapy, these complications were not observed in these patients. Both patients also had successful resolution of HCV infection, and by completion of the antiviral therapy, the blistering also resolved.

Conclusion

PCT is an extrahepatic manifestation of HCV infection. Health care providers should be aware of the association of chronic HCV infection with PCT. The findings of PCT should not result in the delay or discontinuation of antiviral therapy.

Porphyria cutanea tarda (PCT) is the most common type of porphyria. The accumulation of porphyrin in various organ systems results from a deficiency of uroporphyrinogen decarboxylase (UROD).^1-3 Chronic hepatitis C virus (HCV) causes a hepatic decrease in hepcidin production, resulting in increased iron absorption. Iron loading and increased oxidative stress in the liver leads to nonporphyrin inhibition of UROD production and to oxidation of porphyrinogens to porphyrins.⁴ This in turn leads to accumulation of uroporphyrins and carboxylated metabolites that can be detected in urine.⁴

Signs of PCT include blisters, vesicles, and possibly milia developing on sun-exposed areas of the skin, such as the face, forearms, and dorsal hands.⁴ Case reports have demonstrated a resolution of PCT in patients with chronic HCV with treatment with direct-acting antivirals (DAAs), such as ledipasvir/sofosbuvir.^1,3 However, here we present 2 cases of patients who developed blistering diseases during treatment of chronic HCV with ledipasvir/sofosbuvir. Neither demonstrated complete resolution of symptoms during the treatment regimen.

Cases

Patient 1

A 63-year-old white male with a history of chronic HCV (genotype 1a), bipolar disorder, hyperlipidemia, tobacco dependence, and cirrhosis (F4 by elastography) presented with minimally to moderately painful blisters on his bilateral dorsal hands that had developed around weeks 8 to 9 of treatment with ledipasvir/sofosbuvir. The patient reported that no new blisters had appeared following completion of 12 weeks of treatment and that his current blisters were in various stages of healing. He reported alcohol use of 1 to 2 twelve-ounce beers daily and no history of dioxin exposure. His medications included doxepin, hydralazine, hydrochlorothiazide, quetiapine, folic acid, and thiamine. His hepatitis C viral load was 440,000 IU/mL prior to treatment. Tests for hepatitis B surface antigen and HIV antibodies were negative. His iron level was 135 µg/dL, total iron-binding capacity (TIBC) was 323 µg/dL, and ferritin was 299.0 ng/mL. His HFEgene was negative for mutations. Following 4 weeks of treatment with ledipasvir/sofosbuvir, a hepatitis C viral load was not detected.

A physical examination on presentation revealed erosions with overlying hemorrhagic crusts on the bilateral dorsal hands (Figure). 

At the 4-month follow-up, the patient reported no new blister formations. A physical examination revealed well-healed scars and several clustered milia on bilateral dorsal hands with no active vesicles or bullae noted.

Patient 2

An African American male aged 63 years presented with a 1-month history of moderately painful blisters on his bilateral dorsal hands during treatment of chronic HCV (genotype 1a) with ledipasvir/sofosbuvir. His medical history included gout, tobacco and alcohol addiction, osteoarthritis, and hepatic fibrosis (F3 by elastography). The patient’s medications included allopurinol, lisinopril, and hydrochlorothiazide. He reported no history of dioxin exposure. On the day of presentation, he was on week 9 of the 12-week treatment ledipasvir/sofosbuvir regimen. Laboratory results included an initial HCV viral load of 1,618,605 IU/mL. Tests for hepatitis B surface antigen and HIV antibodies were negative. His iron was 191 µg/dL, TIBC 388 µg/dL, and ferritin 459.0 ng/mL. After 4 weeks of treatment, the patient’s hepatitis C viral load was undetectable.

A physical examination revealed several resolving erosions to his bilateral dorsal hands, some of which had overlying crusting along with one small hemorrhagic vesicle on the right dorsal hand. A punch biopsy of the hemorrhagic vesicle was performed and demonstrated a cell-poor subepidermal blister with festooning of the dermal papilla. A direct immunofluorescence study showed immunoglobulin (Ig) G fluorescence along the dermal-epidermal junction and within vessel walls in the superficial dermis. Weak IgM and C3 fluorescence also was noted within vessel walls in the superficial dermis. All of the patient findings and history were consistent with PCT, although pseudo-PCT also was a consideration. A 24-hour urine sample yielded negative results for porphobilinogen. Urine porphyrin test results were not available, leading to a presumptive histological diagnosis of PCT.

The patient completed 11 of the prescribed 12 weeks of ledipasvir/sofosbuvir. The blisters resolved shortly thereafter.

Discussion

PCT has a well-established association with chronic HCV infection.⁴ We present 2 cases of a blistering disease clinically and histologically compatible with PCT that developed in patients only after initiation of treatment for chronic HCV with ledipasvir/sofosbuvir. One case was confirmed as PCT on the basis of compatible histopathologic findings and a urine porphyrin assay that showed elevated levels of uroporphyrins and carboxylated metabolites. The second case was clinically and histologically suggestive of PCT but not confirmed by urine porphyrin testing. In both patients, after 8 to 9 weeks of a 12-week course of antiviral therapy, the blistering lesions were noted but appeared to be resolving, and no new lesions were noted after discontinuation of therapy. It appeared that the antiviral treatment temporally triggered the initiation of the blistering skin disease, and as the chronic HCV infection cleared after treatment, the blistering lesions also began to resolve.

Mechanistically, it is known that the virally-induced hepatic damage leads to inhibition of uroporphyrinogen decarboxylase, and the subsequent oxidation of porphyrinogens to porphyrins. Cofactors such as HIV infection also may contribute to development of PCT.⁵

De novo PCT has been documented during therapy using interferon and ribavirin.⁶ The hemolytic anemia and increased hepatic iron were implicated as potential etiologies.⁶ Patients with HCV and PCT treated with the newer direct-acting antiviral therapies have been described to have experienced improvement in PCT symptoms.³

Although there were rare reports of deterioration in renal and liver function,⁷ reactivation of HBV infection,⁸ and Stevens-Johnson syndrome⁹ with antiviral therapy, these complications were not observed in these patients. Both patients also had successful resolution of HCV infection, and by completion of the antiviral therapy, the blistering also resolved.

Conclusion

PCT is an extrahepatic manifestation of HCV infection. Health care providers should be aware of the association of chronic HCV infection with PCT. The findings of PCT should not result in the delay or discontinuation of antiviral therapy.

Porphyria cutanea tarda (PCT) is the most common type of porphyria. The accumulation of porphyrin in various organ systems results from a deficiency of uroporphyrinogen decarboxylase (UROD).^1-3 Chronic hepatitis C virus (HCV) causes a hepatic decrease in hepcidin production, resulting in increased iron absorption. Iron loading and increased oxidative stress in the liver leads to nonporphyrin inhibition of UROD production and to oxidation of porphyrinogens to porphyrins.⁴ This in turn leads to accumulation of uroporphyrins and carboxylated metabolites that can be detected in urine.⁴

Signs of PCT include blisters, vesicles, and possibly milia developing on sun-exposed areas of the skin, such as the face, forearms, and dorsal hands.⁴ Case reports have demonstrated a resolution of PCT in patients with chronic HCV with treatment with direct-acting antivirals (DAAs), such as ledipasvir/sofosbuvir.^1,3 However, here we present 2 cases of patients who developed blistering diseases during treatment of chronic HCV with ledipasvir/sofosbuvir. Neither demonstrated complete resolution of symptoms during the treatment regimen.

Cases

Patient 1

A 63-year-old white male with a history of chronic HCV (genotype 1a), bipolar disorder, hyperlipidemia, tobacco dependence, and cirrhosis (F4 by elastography) presented with minimally to moderately painful blisters on his bilateral dorsal hands that had developed around weeks 8 to 9 of treatment with ledipasvir/sofosbuvir. The patient reported that no new blisters had appeared following completion of 12 weeks of treatment and that his current blisters were in various stages of healing. He reported alcohol use of 1 to 2 twelve-ounce beers daily and no history of dioxin exposure. His medications included doxepin, hydralazine, hydrochlorothiazide, quetiapine, folic acid, and thiamine. His hepatitis C viral load was 440,000 IU/mL prior to treatment. Tests for hepatitis B surface antigen and HIV antibodies were negative. His iron level was 135 µg/dL, total iron-binding capacity (TIBC) was 323 µg/dL, and ferritin was 299.0 ng/mL. His HFEgene was negative for mutations. Following 4 weeks of treatment with ledipasvir/sofosbuvir, a hepatitis C viral load was not detected.

A physical examination on presentation revealed erosions with overlying hemorrhagic crusts on the bilateral dorsal hands (Figure). 

At the 4-month follow-up, the patient reported no new blister formations. A physical examination revealed well-healed scars and several clustered milia on bilateral dorsal hands with no active vesicles or bullae noted.

Patient 2

An African American male aged 63 years presented with a 1-month history of moderately painful blisters on his bilateral dorsal hands during treatment of chronic HCV (genotype 1a) with ledipasvir/sofosbuvir. His medical history included gout, tobacco and alcohol addiction, osteoarthritis, and hepatic fibrosis (F3 by elastography). The patient’s medications included allopurinol, lisinopril, and hydrochlorothiazide. He reported no history of dioxin exposure. On the day of presentation, he was on week 9 of the 12-week treatment ledipasvir/sofosbuvir regimen. Laboratory results included an initial HCV viral load of 1,618,605 IU/mL. Tests for hepatitis B surface antigen and HIV antibodies were negative. His iron was 191 µg/dL, TIBC 388 µg/dL, and ferritin 459.0 ng/mL. After 4 weeks of treatment, the patient’s hepatitis C viral load was undetectable.

A physical examination revealed several resolving erosions to his bilateral dorsal hands, some of which had overlying crusting along with one small hemorrhagic vesicle on the right dorsal hand. A punch biopsy of the hemorrhagic vesicle was performed and demonstrated a cell-poor subepidermal blister with festooning of the dermal papilla. A direct immunofluorescence study showed immunoglobulin (Ig) G fluorescence along the dermal-epidermal junction and within vessel walls in the superficial dermis. Weak IgM and C3 fluorescence also was noted within vessel walls in the superficial dermis. All of the patient findings and history were consistent with PCT, although pseudo-PCT also was a consideration. A 24-hour urine sample yielded negative results for porphobilinogen. Urine porphyrin test results were not available, leading to a presumptive histological diagnosis of PCT.

The patient completed 11 of the prescribed 12 weeks of ledipasvir/sofosbuvir. The blisters resolved shortly thereafter.

Discussion

PCT has a well-established association with chronic HCV infection.⁴ We present 2 cases of a blistering disease clinically and histologically compatible with PCT that developed in patients only after initiation of treatment for chronic HCV with ledipasvir/sofosbuvir. One case was confirmed as PCT on the basis of compatible histopathologic findings and a urine porphyrin assay that showed elevated levels of uroporphyrins and carboxylated metabolites. The second case was clinically and histologically suggestive of PCT but not confirmed by urine porphyrin testing. In both patients, after 8 to 9 weeks of a 12-week course of antiviral therapy, the blistering lesions were noted but appeared to be resolving, and no new lesions were noted after discontinuation of therapy. It appeared that the antiviral treatment temporally triggered the initiation of the blistering skin disease, and as the chronic HCV infection cleared after treatment, the blistering lesions also began to resolve.

Mechanistically, it is known that the virally-induced hepatic damage leads to inhibition of uroporphyrinogen decarboxylase, and the subsequent oxidation of porphyrinogens to porphyrins. Cofactors such as HIV infection also may contribute to development of PCT.⁵

De novo PCT has been documented during therapy using interferon and ribavirin.⁶ The hemolytic anemia and increased hepatic iron were implicated as potential etiologies.⁶ Patients with HCV and PCT treated with the newer direct-acting antiviral therapies have been described to have experienced improvement in PCT symptoms.³

Although there were rare reports of deterioration in renal and liver function,⁷ reactivation of HBV infection,⁸ and Stevens-Johnson syndrome⁹ with antiviral therapy, these complications were not observed in these patients. Both patients also had successful resolution of HCV infection, and by completion of the antiviral therapy, the blistering also resolved.

Conclusion

PCT is an extrahepatic manifestation of HCV infection. Health care providers should be aware of the association of chronic HCV infection with PCT. The findings of PCT should not result in the delay or discontinuation of antiviral therapy.

Sepsis is a major public health concern: 10% of patients with sepsis die, and mortality quadruples with progression to septic shock.¹ Systemic inflammatory response syndrome (SIRS) criteria, originally published in 1992, are commonly used to detect sepsis, but as early as 2001, these criteria were recognized as lacking specificity.² Nonetheless, the use of SIRS criteria has persisted in practice. Sepsis was redefined in Sepsis-3 (2016) to guide earlier and more appropriate identification and treatment, which has been shown to greatly improve patient outcomes.^1,3 Key recommendations in Sepsis 3 included eliminating SIRS criteria, defining organ dysfunction by the Sequential Organ Failure Assessment (SOFA) score, and introducing the quick SOFA (qSOFA) score.¹

The qSOFA combines 3 clinical variables to provide a rapid, simple bedside score that measures the likelihood of poor outcomes, such as admission to an intensive care unit (ICU) or mortality in adults with suspected infection.^1,3 The qSOFA score is intended to aid healthcare professionals in more timely stratification of those patients who need escalated care to prevent deterioration.¹ The assessment also has been explored as a screening tool for sepsis in clinical practice; however, limited data exists concerning the comparative utility of qSOFA and SIRS in this capacity, and study results are inconsistent.^4-6

The most important attribute of a screening tool is high sensitivity, but high specificity also is desired. The qSOFA could supplant SIRS as a screening tool for sepsis if it maintained similarly high sensitivity but achieved superior specificity. Therefore, our primary objective for this study was to determine the effectiveness of qSOFA as a screening assessment for sepsis in the setting of a general inpatient medicine service by contrasting the sensitivity and specificity of qSOFA with SIRS in predicting sepsis, using a retrospective chart review design.

Methods

Administrative data from the Department of Veterans Affairs (VA) Corporate Data Warehouse were accessed via the VA Informatics and Computing Infrastructure (VINCI) and used to identify VA inpatient admissions and obtain the laboratory and vital sign data necessary to calculate SIRS, qSOFA, and SOFA scores. The data were supplemented by manual review of VA health records to obtain information that was not readily available in administrative records, including septic shock outcomes and laboratory and vital sign data obtained in the ICU. This study was approved by the institutional review board at the University of Iowa and the research and development committee at the Iowa City VA Medical Center (ICVAMC).

Patients

The study population included veterans admitted to the nonsurgical medicine unit at ICVAMC between August 1, 2014 and August 1, 2016 who were transferred to an ICU after admission; direct ICU admissions were not included as the qSOFA has been shown in studies to be more beneficial and offer better predictive validity outside the ICU. Excluding these direct admissions prevented any potential skewing of the data. To control for possible selection bias, veterans also were excluded if they transferred from another facility, were admitted under observation status, or if they had been admitted within the prior 30 days. These patients may have been more critically ill than those who presented directly to our facility and any prior treatment could affect the clinical status of the patient and assessment for sepsis at the time of presentation to the VA. Veterans were further required to have evidence of suspected infection based on manual review of the health record, which was determined by receipt of an antibiotic relevant to the empiric treatment of sepsis within 48 hours of admission.

Sepsis and Septic Shock Assessment Tools

As outlined in the Sepsis-3 guidelines, sepsis was defined as suspected or confirmed infection with an acute change in the SOFA score of ≥ 2 points, which is assumed to be 0 in those not known to have preexisting dysfunction.¹ The SOFA score includes variables from the respiratory, coagulation, hepatic, cardiovascular, renal, and central nervous systems.¹ Septic shock was defined as vasopressor administration and a serum lactic acid level > 2 mmol/L occurring up to 24 hours apart and within 3 days of the first antibiotic dose administered.

The SIRS assessment includes 4 clinical variables (temperature, heart rate, respiratory rate, and white blood cell count) while qSOFA is comprised of 3 variables (respiratory rate, systolic blood pressure, and altered mental status).¹ With both assessments, a score ≥ 2 is considered positive, which indicates increased risk for sepsis in patients with suspected infection.¹ In keeping with existing studies, qSOFA and SIRS assessments were scored using maximum values found within 48 hours before and 24 hours after the first administered antibiotic dose.³

Outcomes

The primary outcome variable was the presence of sepsis in adults with evidence of infection within 48 hours of admission. Secondary outcome measures included 30-day mortality and septic shock.

Performance between the SIRS and qSOFA assessments was contrasted using sensitivity, specificity, and positive and negative predictive value measurements. Associations of qSOFA and SIRS with septic shock and 30-day mortality were evaluated using a 2-tailed Fisher’s exact test with a threshold of α = 0.05 to determine statistical significance.

Results

The study sample of 481 veterans had a mean age of 67.4 years, 94% were male, and 91.1% were white (Table 1). 

Scores for qSOFA, but not SIRS, were significantly associated with septic shock (Fisher’s exact test; qSOFA: P = .009; SIRS: P = .58) (Table 3). 

Discussion

High sensitivity is critical for a sepsis screening tool. To be clinically useful, it has been suggested that biomarkers predicting poor outcomes for sepsis should have a sensitivity of > 80%.⁴ Although qSOFA demonstrated greater specificity than SIRS in our study (83.6% vs 25.7%), qSOFA showed lower sensitivity (44.7% vs 80.0%), which resulted in a greater potential for false negatives; 55.3% of those with sepsis would go undetected. Therefore, our study does not support qSOFA as a better screening assessment than SIRS for sepsis in the veteran population.

Most studies concur with our findings of low sensitivity and high specificity of qSOFA. In a systematic review and meta-analysis, Serafim and colleagues identified 10 studies published after Sepsis-3 that reported sensitivity or specificity of qSOFA and SIRS for sepsis diagnosis.⁵ Seven of the 10 studies reported sensitivities and favored SIRS in the diagnosis of sepsis (Relative risk: 1.32; 95% CI: 0.40-2.24; P < .0001; I² = 100%). The authors noted that substantial heterogeneity among studies, including differences in study design, sample size, and criteria for determination of infection, was an important limitation. In addition, most studies that contrast qSOFA and SIRS center on prognostic value in predicting mortality, rather than as a screening test for a diagnosis of sepsis.

We concluded SIRS was more sensitive and thus superior to qSOFA when used as a screening tool for sepsis but conceded that more prospective and homogenous investigations were necessary. To our knowledge, only 1 published study has deviated from this conclusion and reported comparable sensitivity between SIRS (92%) and qSOFA (90%).⁶ Our study adds to existing literature as it is the first conducted in a veteran population. Additionally, we performed our investigation in a general medicine population with methods similar to existing literature, including the key study validating clinical criteria for sepsis by Seymour and colleagues.³

Limitations

This study is not without limitations, including potential misclassification of cases if essential data points were not available during data collection via health record review or the data points were not representative of a true change from baseline (eg, the Glasgow Coma Scale score for altered mental status in the qSOFA or the SOFA score for organ dysfunction). Generalizability of the results also may be limited due to our retrospective, single-center design and characteristics typical of a veteran population (eg, older, white males). Additionally, many veterans were excluded from the study if they transferred from another facility. These veterans may have been more critically ill than those who presented directly to our facility, which possibly introduced selection bias.

Conclusion

Our findings do not support use of the qSOFA as a suitable replacement for SIRS as a sepsis screening tool among patients with suspected infection in the general medicine inpatient setting. The clinical concern with SIRS is that unfavorable specificity leads to unnecessary antibiotic exposure among patients who are falsely positive. While qSOFA has demonstrated higher specificity, its use would cause many sepsis cases to go undetected due to the technique’s low sensitivity. Frequent false negative qSOFA results could thus serve to impede, rather than enhance, early recognition and intervention for sepsis.

The ideal sepsis screening tool is rapid and possesses high sensitivity and specificity to promptly identify and manage sepsis and avert unfavorable outcomes such as septic shock and death. While the SIRS criteria do not satisfy these ideal features, its measurement characteristics are more suitable for the application of sepsis screening than the qSOFA and should thus remain the standard tool in this setting. Future prospectively designed studies with more uniform methodologies are necessary to ascertain the most effective approach to identify sepsis for which novel screening approaches with more clinically suitable measurement properties are greatly needed.

Acknowledgements
This research was supported by the Iowa City VA Health Care System, Department of Pharmacy Services. Additional support was provided by the Health Services Research and Development Service, Department of Veterans Affairs.

Sepsis is a major public health concern: 10% of patients with sepsis die, and mortality quadruples with progression to septic shock.¹ Systemic inflammatory response syndrome (SIRS) criteria, originally published in 1992, are commonly used to detect sepsis, but as early as 2001, these criteria were recognized as lacking specificity.² Nonetheless, the use of SIRS criteria has persisted in practice. Sepsis was redefined in Sepsis-3 (2016) to guide earlier and more appropriate identification and treatment, which has been shown to greatly improve patient outcomes.^1,3 Key recommendations in Sepsis 3 included eliminating SIRS criteria, defining organ dysfunction by the Sequential Organ Failure Assessment (SOFA) score, and introducing the quick SOFA (qSOFA) score.¹

The qSOFA combines 3 clinical variables to provide a rapid, simple bedside score that measures the likelihood of poor outcomes, such as admission to an intensive care unit (ICU) or mortality in adults with suspected infection.^1,3 The qSOFA score is intended to aid healthcare professionals in more timely stratification of those patients who need escalated care to prevent deterioration.¹ The assessment also has been explored as a screening tool for sepsis in clinical practice; however, limited data exists concerning the comparative utility of qSOFA and SIRS in this capacity, and study results are inconsistent.^4-6

The most important attribute of a screening tool is high sensitivity, but high specificity also is desired. The qSOFA could supplant SIRS as a screening tool for sepsis if it maintained similarly high sensitivity but achieved superior specificity. Therefore, our primary objective for this study was to determine the effectiveness of qSOFA as a screening assessment for sepsis in the setting of a general inpatient medicine service by contrasting the sensitivity and specificity of qSOFA with SIRS in predicting sepsis, using a retrospective chart review design.

Methods

Administrative data from the Department of Veterans Affairs (VA) Corporate Data Warehouse were accessed via the VA Informatics and Computing Infrastructure (VINCI) and used to identify VA inpatient admissions and obtain the laboratory and vital sign data necessary to calculate SIRS, qSOFA, and SOFA scores. The data were supplemented by manual review of VA health records to obtain information that was not readily available in administrative records, including septic shock outcomes and laboratory and vital sign data obtained in the ICU. This study was approved by the institutional review board at the University of Iowa and the research and development committee at the Iowa City VA Medical Center (ICVAMC).

Patients

The study population included veterans admitted to the nonsurgical medicine unit at ICVAMC between August 1, 2014 and August 1, 2016 who were transferred to an ICU after admission; direct ICU admissions were not included as the qSOFA has been shown in studies to be more beneficial and offer better predictive validity outside the ICU. Excluding these direct admissions prevented any potential skewing of the data. To control for possible selection bias, veterans also were excluded if they transferred from another facility, were admitted under observation status, or if they had been admitted within the prior 30 days. These patients may have been more critically ill than those who presented directly to our facility and any prior treatment could affect the clinical status of the patient and assessment for sepsis at the time of presentation to the VA. Veterans were further required to have evidence of suspected infection based on manual review of the health record, which was determined by receipt of an antibiotic relevant to the empiric treatment of sepsis within 48 hours of admission.

Sepsis and Septic Shock Assessment Tools

As outlined in the Sepsis-3 guidelines, sepsis was defined as suspected or confirmed infection with an acute change in the SOFA score of ≥ 2 points, which is assumed to be 0 in those not known to have preexisting dysfunction.¹ The SOFA score includes variables from the respiratory, coagulation, hepatic, cardiovascular, renal, and central nervous systems.¹ Septic shock was defined as vasopressor administration and a serum lactic acid level > 2 mmol/L occurring up to 24 hours apart and within 3 days of the first antibiotic dose administered.

The SIRS assessment includes 4 clinical variables (temperature, heart rate, respiratory rate, and white blood cell count) while qSOFA is comprised of 3 variables (respiratory rate, systolic blood pressure, and altered mental status).¹ With both assessments, a score ≥ 2 is considered positive, which indicates increased risk for sepsis in patients with suspected infection.¹ In keeping with existing studies, qSOFA and SIRS assessments were scored using maximum values found within 48 hours before and 24 hours after the first administered antibiotic dose.³

Outcomes

The primary outcome variable was the presence of sepsis in adults with evidence of infection within 48 hours of admission. Secondary outcome measures included 30-day mortality and septic shock.

Performance between the SIRS and qSOFA assessments was contrasted using sensitivity, specificity, and positive and negative predictive value measurements. Associations of qSOFA and SIRS with septic shock and 30-day mortality were evaluated using a 2-tailed Fisher’s exact test with a threshold of α = 0.05 to determine statistical significance.

Results

The study sample of 481 veterans had a mean age of 67.4 years, 94% were male, and 91.1% were white (Table 1). 

Scores for qSOFA, but not SIRS, were significantly associated with septic shock (Fisher’s exact test; qSOFA: P = .009; SIRS: P = .58) (Table 3). 

Discussion

High sensitivity is critical for a sepsis screening tool. To be clinically useful, it has been suggested that biomarkers predicting poor outcomes for sepsis should have a sensitivity of > 80%.⁴ Although qSOFA demonstrated greater specificity than SIRS in our study (83.6% vs 25.7%), qSOFA showed lower sensitivity (44.7% vs 80.0%), which resulted in a greater potential for false negatives; 55.3% of those with sepsis would go undetected. Therefore, our study does not support qSOFA as a better screening assessment than SIRS for sepsis in the veteran population.

Most studies concur with our findings of low sensitivity and high specificity of qSOFA. In a systematic review and meta-analysis, Serafim and colleagues identified 10 studies published after Sepsis-3 that reported sensitivity or specificity of qSOFA and SIRS for sepsis diagnosis.⁵ Seven of the 10 studies reported sensitivities and favored SIRS in the diagnosis of sepsis (Relative risk: 1.32; 95% CI: 0.40-2.24; P < .0001; I² = 100%). The authors noted that substantial heterogeneity among studies, including differences in study design, sample size, and criteria for determination of infection, was an important limitation. In addition, most studies that contrast qSOFA and SIRS center on prognostic value in predicting mortality, rather than as a screening test for a diagnosis of sepsis.

We concluded SIRS was more sensitive and thus superior to qSOFA when used as a screening tool for sepsis but conceded that more prospective and homogenous investigations were necessary. To our knowledge, only 1 published study has deviated from this conclusion and reported comparable sensitivity between SIRS (92%) and qSOFA (90%).⁶ Our study adds to existing literature as it is the first conducted in a veteran population. Additionally, we performed our investigation in a general medicine population with methods similar to existing literature, including the key study validating clinical criteria for sepsis by Seymour and colleagues.³

Limitations

This study is not without limitations, including potential misclassification of cases if essential data points were not available during data collection via health record review or the data points were not representative of a true change from baseline (eg, the Glasgow Coma Scale score for altered mental status in the qSOFA or the SOFA score for organ dysfunction). Generalizability of the results also may be limited due to our retrospective, single-center design and characteristics typical of a veteran population (eg, older, white males). Additionally, many veterans were excluded from the study if they transferred from another facility. These veterans may have been more critically ill than those who presented directly to our facility, which possibly introduced selection bias.

Conclusion

Our findings do not support use of the qSOFA as a suitable replacement for SIRS as a sepsis screening tool among patients with suspected infection in the general medicine inpatient setting. The clinical concern with SIRS is that unfavorable specificity leads to unnecessary antibiotic exposure among patients who are falsely positive. While qSOFA has demonstrated higher specificity, its use would cause many sepsis cases to go undetected due to the technique’s low sensitivity. Frequent false negative qSOFA results could thus serve to impede, rather than enhance, early recognition and intervention for sepsis.

The ideal sepsis screening tool is rapid and possesses high sensitivity and specificity to promptly identify and manage sepsis and avert unfavorable outcomes such as septic shock and death. While the SIRS criteria do not satisfy these ideal features, its measurement characteristics are more suitable for the application of sepsis screening than the qSOFA and should thus remain the standard tool in this setting. Future prospectively designed studies with more uniform methodologies are necessary to ascertain the most effective approach to identify sepsis for which novel screening approaches with more clinically suitable measurement properties are greatly needed.

Acknowledgements
This research was supported by the Iowa City VA Health Care System, Department of Pharmacy Services. Additional support was provided by the Health Services Research and Development Service, Department of Veterans Affairs.

Sepsis is a major public health concern: 10% of patients with sepsis die, and mortality quadruples with progression to septic shock.¹ Systemic inflammatory response syndrome (SIRS) criteria, originally published in 1992, are commonly used to detect sepsis, but as early as 2001, these criteria were recognized as lacking specificity.² Nonetheless, the use of SIRS criteria has persisted in practice. Sepsis was redefined in Sepsis-3 (2016) to guide earlier and more appropriate identification and treatment, which has been shown to greatly improve patient outcomes.^1,3 Key recommendations in Sepsis 3 included eliminating SIRS criteria, defining organ dysfunction by the Sequential Organ Failure Assessment (SOFA) score, and introducing the quick SOFA (qSOFA) score.¹

The qSOFA combines 3 clinical variables to provide a rapid, simple bedside score that measures the likelihood of poor outcomes, such as admission to an intensive care unit (ICU) or mortality in adults with suspected infection.^1,3 The qSOFA score is intended to aid healthcare professionals in more timely stratification of those patients who need escalated care to prevent deterioration.¹ The assessment also has been explored as a screening tool for sepsis in clinical practice; however, limited data exists concerning the comparative utility of qSOFA and SIRS in this capacity, and study results are inconsistent.^4-6

The most important attribute of a screening tool is high sensitivity, but high specificity also is desired. The qSOFA could supplant SIRS as a screening tool for sepsis if it maintained similarly high sensitivity but achieved superior specificity. Therefore, our primary objective for this study was to determine the effectiveness of qSOFA as a screening assessment for sepsis in the setting of a general inpatient medicine service by contrasting the sensitivity and specificity of qSOFA with SIRS in predicting sepsis, using a retrospective chart review design.

Methods

Administrative data from the Department of Veterans Affairs (VA) Corporate Data Warehouse were accessed via the VA Informatics and Computing Infrastructure (VINCI) and used to identify VA inpatient admissions and obtain the laboratory and vital sign data necessary to calculate SIRS, qSOFA, and SOFA scores. The data were supplemented by manual review of VA health records to obtain information that was not readily available in administrative records, including septic shock outcomes and laboratory and vital sign data obtained in the ICU. This study was approved by the institutional review board at the University of Iowa and the research and development committee at the Iowa City VA Medical Center (ICVAMC).

Patients

The study population included veterans admitted to the nonsurgical medicine unit at ICVAMC between August 1, 2014 and August 1, 2016 who were transferred to an ICU after admission; direct ICU admissions were not included as the qSOFA has been shown in studies to be more beneficial and offer better predictive validity outside the ICU. Excluding these direct admissions prevented any potential skewing of the data. To control for possible selection bias, veterans also were excluded if they transferred from another facility, were admitted under observation status, or if they had been admitted within the prior 30 days. These patients may have been more critically ill than those who presented directly to our facility and any prior treatment could affect the clinical status of the patient and assessment for sepsis at the time of presentation to the VA. Veterans were further required to have evidence of suspected infection based on manual review of the health record, which was determined by receipt of an antibiotic relevant to the empiric treatment of sepsis within 48 hours of admission.

Sepsis and Septic Shock Assessment Tools

As outlined in the Sepsis-3 guidelines, sepsis was defined as suspected or confirmed infection with an acute change in the SOFA score of ≥ 2 points, which is assumed to be 0 in those not known to have preexisting dysfunction.¹ The SOFA score includes variables from the respiratory, coagulation, hepatic, cardiovascular, renal, and central nervous systems.¹ Septic shock was defined as vasopressor administration and a serum lactic acid level > 2 mmol/L occurring up to 24 hours apart and within 3 days of the first antibiotic dose administered.

The SIRS assessment includes 4 clinical variables (temperature, heart rate, respiratory rate, and white blood cell count) while qSOFA is comprised of 3 variables (respiratory rate, systolic blood pressure, and altered mental status).¹ With both assessments, a score ≥ 2 is considered positive, which indicates increased risk for sepsis in patients with suspected infection.¹ In keeping with existing studies, qSOFA and SIRS assessments were scored using maximum values found within 48 hours before and 24 hours after the first administered antibiotic dose.³

Outcomes

The primary outcome variable was the presence of sepsis in adults with evidence of infection within 48 hours of admission. Secondary outcome measures included 30-day mortality and septic shock.

Performance between the SIRS and qSOFA assessments was contrasted using sensitivity, specificity, and positive and negative predictive value measurements. Associations of qSOFA and SIRS with septic shock and 30-day mortality were evaluated using a 2-tailed Fisher’s exact test with a threshold of α = 0.05 to determine statistical significance.

Results

The study sample of 481 veterans had a mean age of 67.4 years, 94% were male, and 91.1% were white (Table 1). 

Scores for qSOFA, but not SIRS, were significantly associated with septic shock (Fisher’s exact test; qSOFA: P = .009; SIRS: P = .58) (Table 3). 

Discussion

High sensitivity is critical for a sepsis screening tool. To be clinically useful, it has been suggested that biomarkers predicting poor outcomes for sepsis should have a sensitivity of > 80%.⁴ Although qSOFA demonstrated greater specificity than SIRS in our study (83.6% vs 25.7%), qSOFA showed lower sensitivity (44.7% vs 80.0%), which resulted in a greater potential for false negatives; 55.3% of those with sepsis would go undetected. Therefore, our study does not support qSOFA as a better screening assessment than SIRS for sepsis in the veteran population.

Most studies concur with our findings of low sensitivity and high specificity of qSOFA. In a systematic review and meta-analysis, Serafim and colleagues identified 10 studies published after Sepsis-3 that reported sensitivity or specificity of qSOFA and SIRS for sepsis diagnosis.⁵ Seven of the 10 studies reported sensitivities and favored SIRS in the diagnosis of sepsis (Relative risk: 1.32; 95% CI: 0.40-2.24; P < .0001; I² = 100%). The authors noted that substantial heterogeneity among studies, including differences in study design, sample size, and criteria for determination of infection, was an important limitation. In addition, most studies that contrast qSOFA and SIRS center on prognostic value in predicting mortality, rather than as a screening test for a diagnosis of sepsis.

We concluded SIRS was more sensitive and thus superior to qSOFA when used as a screening tool for sepsis but conceded that more prospective and homogenous investigations were necessary. To our knowledge, only 1 published study has deviated from this conclusion and reported comparable sensitivity between SIRS (92%) and qSOFA (90%).⁶ Our study adds to existing literature as it is the first conducted in a veteran population. Additionally, we performed our investigation in a general medicine population with methods similar to existing literature, including the key study validating clinical criteria for sepsis by Seymour and colleagues.³

Limitations

This study is not without limitations, including potential misclassification of cases if essential data points were not available during data collection via health record review or the data points were not representative of a true change from baseline (eg, the Glasgow Coma Scale score for altered mental status in the qSOFA or the SOFA score for organ dysfunction). Generalizability of the results also may be limited due to our retrospective, single-center design and characteristics typical of a veteran population (eg, older, white males). Additionally, many veterans were excluded from the study if they transferred from another facility. These veterans may have been more critically ill than those who presented directly to our facility, which possibly introduced selection bias.

Conclusion

Our findings do not support use of the qSOFA as a suitable replacement for SIRS as a sepsis screening tool among patients with suspected infection in the general medicine inpatient setting. The clinical concern with SIRS is that unfavorable specificity leads to unnecessary antibiotic exposure among patients who are falsely positive. While qSOFA has demonstrated higher specificity, its use would cause many sepsis cases to go undetected due to the technique’s low sensitivity. Frequent false negative qSOFA results could thus serve to impede, rather than enhance, early recognition and intervention for sepsis.

The ideal sepsis screening tool is rapid and possesses high sensitivity and specificity to promptly identify and manage sepsis and avert unfavorable outcomes such as septic shock and death. While the SIRS criteria do not satisfy these ideal features, its measurement characteristics are more suitable for the application of sepsis screening than the qSOFA and should thus remain the standard tool in this setting. Future prospectively designed studies with more uniform methodologies are necessary to ascertain the most effective approach to identify sepsis for which novel screening approaches with more clinically suitable measurement properties are greatly needed.

Acknowledgements
This research was supported by the Iowa City VA Health Care System, Department of Pharmacy Services. Additional support was provided by the Health Services Research and Development Service, Department of Veterans Affairs.

Population studies show high prevalence of chronic hepatitis C virus (HCV) infection among veterans, especially Vietnam War era veterans.^1,2 The development of safe and efficacious direct-acting antiviral (DAA) medications to treat HCV infection made the majority of those infected eligible for treatment. However, the large number of veterans needing DAA treatment stressed the resources of the US Department of Veterans Affairs (VA) health care system. This occurred while Congress was focused on reducing wait times for veterans receiving care at the VA.

Congress passed the Veterans Access, Choice, and Accountability Act (Choice) on August 7, 2014, leading to the creation of the Veterans Choice Program. Legislators felt there were inappropriate delays in care at the VA, and the Choice program was meant to address this problem and provide an “apples-to-apples comparison [of the VA] with non-VA hospitals.”³

Congress acknowledged the importance of curing HCV in the veteran population and allocated $1.5 billion for fiscal year (FY) 2016 for DAAs. The VA Central Office (VACO) carefully monitored these resources. The first policy memorandum from VACO for HCV care, issued on May 21, 2015, recommended that the sickest patients who will benefit from the treatment “receive priority over those who are less ill.”^4,5 Those who met criteria for advanced liver disease were prioritized for treatment at the VA, while those who did not meet criteria were given the option of receiving treatment through Choice, or waiting for a change in policy.⁶ Over time, revisions to the guidelines relaxed the criteria for VA treatment eligibility, and on February 24, 2016, all restrictions on HCV treatment at the VA were lifted.^7,8

The aim of this study was to provide a comparison of VA and non-VA care, specifically to determine whether care provided through Choice was timelier and more cost effective than care provided by the VA, and whether there was a quality difference. The high prevalence among veterans, well-established standards of care, and finite treatment course with clear indicators of success and failure makes HCV treatment an ideal disease with which to make this comparison.

Methods

We retrospectively analyzed the VA electronic health records of all veterans seen in the VA Loma Linda Healthcare System (VALLHCS) Hepatology clinic for chronic HCV infection during FY 2016 who were referred to Choice for HCV treatment. One hundred veterans met these criteria, encompassing the Choice population; 71 were seen at least once by a non-VA (Choice) health care provider (HCP) and 61 completed a treatment regimen through Choice. Treatment completion was defined as cessation of medication after the planned duration of therapy, or early termination of medication without resumption by that HCP. The Choice population was matched to an equal number of veterans who received HCV treatment from VALLHCS HCPs.

Data collected included age, gender, HCV genotype, determinants of liver fibrosis, and treatment success (defined as sustained virologic response at 12 weeks after the last dose of medication [SVR12]). Determinants of liver fibrosis included documented cirrhosis or complications of cirrhosis, Fibrosis-4 score (Fib-4), and platelet count.

Treatment failures were categorized as nonresponse (defined as detectable HCV viral load at the end of treatment), relapse (defined as an undetectable HCV viral load at the end of treatment with a subsequent positive test), and early termination (defined as a failure to complete the planned treatment regimen). Documented patient nonadherence, medical comorbidities that affected the treatment protocol, mental health diagnoses, and active social issues (defined as active or history of heavy alcohol use, active or history of illicit drug use, lack of social support, and homelessness) were noted.

Timeliness of delivery of care was measured in days. For the VA group, the wait time was defined as the date the consult for HCV treatment was placed to the date of the initial appointment with the HCV treatment provider. For the Choice group, the wait time was defined as the date the referral to the Choice program was made to the date of the initial appointment with the Choice HCP. Treatment regimens were evaluated for appropriateness based on guidelines from VACO and the American Association for the Study of Liver Diseases.^9-11

Tests performed by Choice providers were evaluated for whether they were relevant to HCV care and whether similar data already were available from VALLHCS. Tests that were not indicated were identified as unnecessary costs incurred by the Choice program, as were tests that had to be repeated at the VA because of a lack of documentation from the Choice provider. All medications given inappropriately were considered added costs. Medicare reimbursement rates for the most applicable Current Procedural Terminology (CPT) code and VA national contract pricing for medications were used for calculations. This study was approved by the VALLHCS institutional review board.

Statistical Analysis

IBM (Armonk, NY) Statistical Package for Social Sciences software was used to evaluate for differences in Fib-4, platelet count, prevalence of cirrhosis, prevalence of medical comorbidities, prevalence of mental health comorbidities, prevalence of the social issues defined in the Methods section, time from referral to time of appointment date, and SVR12 rate between the VA and Choice groups.

Exclusions

There were 15 veterans in the VA group who had a wait time of > 100 days. Of these, 5 (33%) were initially Choice referrals, but due to negative interactions with the Choice provider, the veterans returned to VALLHCS for care. Two of the 15 (13%) did not keep appointments and were lost to follow up. Six of the 15 (40%) had medical comorbidities that required more immediate attention, so HCV treatment initiation was deliberately moved back. The final 2 veterans scheduled their appointments unusually far apart, artificially increasing their wait time. Given that these were unique situations and some of the veterans received care from both Choice and VA providers, a decision was made to exclude these individuals from the study.

It has been shown that platelet count correlates with degree of liver fibrosis, a concept that is the basis for the Fib-4 scoring system.¹² Studies have shown that platelet count is a survival predictor in those with cirrhosis, and thrombocytopenia is a negative predictor of HCV treatment success using peginterferon and ribavirin.^13,14 Therefore, the VA memorandum automatically assigned the sickest individuals to the VA for HCV treatment. The goal of this study was to compare the impact of factors other than stage of fibrosis on HCV treatment success, which is why the 12 veterans with platelet count < 100,000 in the VA group were excluded. There were no veterans with platelet count < 100,000 in the Choice group.

When comparing SVR12 rates between the VA and Choice groups, every veteran treated at VALLHCS in FY 2016 was included, increasing the number in the VA group from 100 to 320 and therefore the power of this comparison.

Results

A summary of the statistical analysis can be found in Table 1. The genotype distribution was consistent with epidemiological studies, including those specific to veterans.^15,16 There were statistically significant differences (P < .001) in mean Fib-4 and mean platelet count. The VA group had a higher Fib-4 and lower platelet count. Seventy-four percent of the VA population was defined as cirrhotic, while only 3% of the Choice population met similar criteria (P < .001). The VA and Choice groups were similar in terms of age, gender, and genotype distribution (Table 2).

The VA group was found to have a higher prevalence of comorbidities that affected HCV treatment. These conditions included but were not limited to: chronic kidney disease that precluded the use of certain medications, any condition that required medication with a known interaction with DAAs (ie, proton pump inhibitors, statins, and amiodarone), and cirrhosis if it impacted the treatment regimen. The difference in the prevalence of mental health comorbidities was not significant (P = .39), but there was a higher prevalence of social issues among the VA group (P = .002).

The mean wait time from referral to appointment was 28.6 days for the VA group and 42.3 days for the Choice group (P < .001), indicating that a Choice referral took longer to complete than a referral within the VA for HCV treatment. Thirty of the 71 (42%) veterans seen by a Choice provider accrued extraneous cost, with a mean additional cost of $8,561.40 per veteran. In the Choice group, 61 veterans completed a treatment regimen with the Choice HCP. Fifty-five veterans completed treatment and had available SVR12 data (6 were lost to follow up without SVR12 testing) and 50 (91%) had confirmed SVR12. The charts of the 5 treatment failures were reviewed to discern the cause for failure. Two cases involved early termination of therapy, 3 involved relapse and 2 failed to comply with medication instructions. There was 1 case of the Choice HCP not addressing simultaneous use of ledipasvir and a proton pump inhibitor, potentially causing an interaction, and 1 case where both the VA and Choice providers failed to recognize indicators of cirrhosis, which impacted the regimen used.

In the VALLHCS group, records of 320 veterans who completed treatment and had SVR12 testing were reviewed. While the Choice memorandum was active, veterans selected to be treated at VALLHCS had advanced liver fibrosis or cirrhosis, medical and mental health comorbidities that increased the risk of treatment complications or were considered to have difficulty adhering to the medication regimen. For this group, 296 (93%) had confirmed SVR12. Eighteen of the 24 (75%) treatment failures were complicated by nonadherence, including all 13 cases of early termination. One patient died from complications of decompensated cirrhosis before completing treatment, and 1 did not receive HCV medications during a hospital admission due to poor coordination of care between the VA inpatient and outpatient pharmacy services, leading to multiple missed doses.

The difference in SVR12 rates (ie, treatment failure rates), between the VA and Choice groups was not statistically significant (P = .61). None of the specific reasons for treatment failure had a statistically significant difference between groups. A treatment failure analysis is shown in Table 3, and Table 4 indicates the breakdown of treatment regimens.

Discussion

The Veterans Health Administration (VHA) is the largest integrated health care system in the US, consisting of 152 medical centers and > 1,700 sites of care. The VA has the potential to meet the health care needs of 21.6 million veterans. About 9 million veterans are enrolled in the VA system and 5.9 million received health care through VHA.¹⁷ However, every medical service cannot realistically be made available at every facility, and some veterans have difficulty gaining access to VHA care; distance and wait times have been well-publicized issues that need further exploration.^18,19 The Choice program is an attempt to meet gaps in VA coverage using non-VA HCPs.

HCV infection is a specific diagnosis with national treatment guidelines and well-studied treatments; it can be cured, with an evidence-based definition of cure. The VACO policy memorandum to refer less sick veterans to Choice while treating sicker veterans at the VA provided the opportunity to directly compare the quality of the 2 programs. The SVR12 rates of VALLHCS and Choice providers were comparable to the national average at the time, and while the difference in SVR12 rate was not significant, VALLHCS treated a significantly higher number of patients with cirrhosis because of the referral criteria.²⁰

The significant difference in medical comorbidities between the VA and Choice groups was not surprising, partly because of the referral criteria. Cirrhosis can impact the treatment regimen, especially in regard to use of ribavirin. Since the presence of mental health comorbidities did not affect selection into the Choice group, it makes sense that there was no significant difference in prevalence between the groups.

VACO allowed veterans with HCV treatment plans that VA HCPs felt were too complicated for the Choice program to be treated by VHA HCPs.⁹ VALLHCS exercised this right for veterans at risk for nonadherence, because in HCV treatment, nonadherence leads to treatment failure and development of drug resistant virus strains. Therefore, veterans who would have difficulty traveling to VALLHCS to pick up medications, those who lacked means of communication (such as those who were homeless), and those who had active substance abuse were treated at the VA, where closer monitoring and immediate access to a wide range of services was possible. Studies have confirmed the impact of these types of issues on HCV treatment adherence and success.²¹ This explains the higher prevalence of social issues in the VA group.

For an internal referral for HCV treatment at VALLHCS, the hepatology provider submits a consult request to the HCV treatment provider, who works in the same office, making direct communication simple. The main administrative limiting factor to minimizing wait times is the number of HCPs, which is dependent on hiring allowances.

When a veteran is referred to Choice, the VA provider places a consult for non-VA care, which the VA Office of Community Care processes by compiling relevant documents and sending the package to Triwest Healthcare Alliance, a private insurance processor contracted with the VA. Triwest selects the Choice provider, often without any input from the VA, and arranges the veteran’s initial appointment.²² Geographic distance to the veteran’s address is the main selection criteria for Triwest. Documents sent between the Choice and VA HCPs go through the Office of Community Care and Triwest. This significantly increases the potential for delays and failed communication. Triwest had a comprehensive list of providers deemed to be qualified to treat HCV within the geographic catchment of VALLHCS. This list was reviewed, and all veterans referred to Choice had HCPs near their home address; therefore, availability of Choice HCPs was not an issue.

The VA can provide guidance on management of the veteran in the form of bundle packages containing a list of services for which the Choice provider is authorized to provide, and ones the Choice provider is not authorized to provide. Some Choice HCPs ordered tests that were not authorized for HCV treatment such as esophagogastroduodenoscopy, colonoscopy, and liver biopsy. In all, 17 of 71 (24%) veterans seen by Choice HCPs had tests performed or ordered that VA HCPs would not have obtained for the purpose of HCV treatment (Table 5).

In order to prevent veterans from receiving unnecessary tests, a VALLHCS hepatologist asked to be notified by VA administrators overseeing Choice referrals whenever a secondary authorization request (SAR) was submitted by a Choice HCP. This strategy is not standard VA practice, therefore at many VA sites these requested tests would have been performed by the Choice HCP, which is why SARs were factored into cost analysis.

SVR12 test results that were drawn too early and had to be repeated at VALLHCS were a cost unique to the Choice program. Duplicate tests, particularly imaging studies and blood work, were extraneous costs. The largest extraneous costs were treatment regimens prescribed by Choice HCPs that did not follow standard of care and required VA provider intervention. Thirty of the 71 (42%) veterans seen by a Choice provider accrued a mean $8,561.40 in extra costs. As a result, the Choice program cost VHA $250,000 more to provide care for 30 veterans (enough to pay for a physician’s annual salary).

Some inappropriate treatment regimens were the result of Choice HCP error, such as 1 case in which a veteran was inadvertently switched from ledipasvir/sofosbuvir to ombitasvir/paritaprevir/ritonavir/dasabuvir after week 4. The veteran had to start therapy over but still achieved SVR12. Other cases saw veterans receive regimens for which they had clear contraindications, such as creatinine clearance < 30 mL/min/1.73m² for sofosbuvir or a positive resistance panel for specific medications. Eleven of 62 (18%) veterans who were started on HCV treatment by a Choice HCP received a regimen not consistent with VA guidelines—an alarming result.

Follow up for veterans referred to Choice was extremely labor intensive, and assessment of personnel requirements in a Choice-based VA system must take this into consideration. The Choice HCP has no obligation to communicate with the VA HCP. At the time of chart review, 57 of 71 (80%) Choice veterans had inadequate documentation to make a confident assessment of the treatment outcome. Multiple calls to the offices of the Choice HCP were needed to acquire records, and veterans had to be tracked down for additional tests. Veterans often would complete treatment and stop following up with the Choice provider before SVR12 confirmation. The VA hepatology provider reviewing Choice referrals served as clinician, case manager, and clerk in order to get veterans to an appropriate end point in their hepatitis C treatment, with mostly unmeasured hours of work.

Limitations

The study population size was limited by the number of veterans able to complete treatment through Choice. The parameters in the VACO policy memos automatically selected the VA and Choice groups but made them clinically distinct populations. New treatment medications were released during the study period, which impacted management strategy. Occasionally, VA and non-VA HCPs preferred different treatment regimens, leading to variation in the distribution of regimens used despite similar genotype distribution (Tables 2 and 4). In addition, a retrospective study is at risk for recall bias. A prospective study randomizing veterans to the Choice and VA groups is an important future endeavor. Comparing veteran satisfaction for Choice and VA services is also crucial.

Conclusions

This study demonstrates that the VA was able to provide more cost-effective and more timely care for HCV treatment to a relatively sicker population with no reduction in treatment success when compared with non-VA HCPs through the Choice program. While the Choice program can help veterans receive services they may otherwise not have access to and reduce travel time, the current system introduces inefficiencies that delay care and decrease cost-effectiveness. The Choice HCP selection process is based on proximity rather than quality, which may place the veteran at risk for receiving substandard care. Large-scale quality of care studies that compare efficiency measures, clinical outcomes, patient demographics, travel distance, cost efficacy and patient satisfaction for veterans receiving similar services at a VA facility and through Choice should be performed to ensure that veterans receive the best care available.

Population studies show high prevalence of chronic hepatitis C virus (HCV) infection among veterans, especially Vietnam War era veterans.^1,2 The development of safe and efficacious direct-acting antiviral (DAA) medications to treat HCV infection made the majority of those infected eligible for treatment. However, the large number of veterans needing DAA treatment stressed the resources of the US Department of Veterans Affairs (VA) health care system. This occurred while Congress was focused on reducing wait times for veterans receiving care at the VA.

Congress passed the Veterans Access, Choice, and Accountability Act (Choice) on August 7, 2014, leading to the creation of the Veterans Choice Program. Legislators felt there were inappropriate delays in care at the VA, and the Choice program was meant to address this problem and provide an “apples-to-apples comparison [of the VA] with non-VA hospitals.”³

Congress acknowledged the importance of curing HCV in the veteran population and allocated $1.5 billion for fiscal year (FY) 2016 for DAAs. The VA Central Office (VACO) carefully monitored these resources. The first policy memorandum from VACO for HCV care, issued on May 21, 2015, recommended that the sickest patients who will benefit from the treatment “receive priority over those who are less ill.”^4,5 Those who met criteria for advanced liver disease were prioritized for treatment at the VA, while those who did not meet criteria were given the option of receiving treatment through Choice, or waiting for a change in policy.⁶ Over time, revisions to the guidelines relaxed the criteria for VA treatment eligibility, and on February 24, 2016, all restrictions on HCV treatment at the VA were lifted.^7,8

The aim of this study was to provide a comparison of VA and non-VA care, specifically to determine whether care provided through Choice was timelier and more cost effective than care provided by the VA, and whether there was a quality difference. The high prevalence among veterans, well-established standards of care, and finite treatment course with clear indicators of success and failure makes HCV treatment an ideal disease with which to make this comparison.

Methods

We retrospectively analyzed the VA electronic health records of all veterans seen in the VA Loma Linda Healthcare System (VALLHCS) Hepatology clinic for chronic HCV infection during FY 2016 who were referred to Choice for HCV treatment. One hundred veterans met these criteria, encompassing the Choice population; 71 were seen at least once by a non-VA (Choice) health care provider (HCP) and 61 completed a treatment regimen through Choice. Treatment completion was defined as cessation of medication after the planned duration of therapy, or early termination of medication without resumption by that HCP. The Choice population was matched to an equal number of veterans who received HCV treatment from VALLHCS HCPs.

Data collected included age, gender, HCV genotype, determinants of liver fibrosis, and treatment success (defined as sustained virologic response at 12 weeks after the last dose of medication [SVR12]). Determinants of liver fibrosis included documented cirrhosis or complications of cirrhosis, Fibrosis-4 score (Fib-4), and platelet count.

Treatment failures were categorized as nonresponse (defined as detectable HCV viral load at the end of treatment), relapse (defined as an undetectable HCV viral load at the end of treatment with a subsequent positive test), and early termination (defined as a failure to complete the planned treatment regimen). Documented patient nonadherence, medical comorbidities that affected the treatment protocol, mental health diagnoses, and active social issues (defined as active or history of heavy alcohol use, active or history of illicit drug use, lack of social support, and homelessness) were noted.

Timeliness of delivery of care was measured in days. For the VA group, the wait time was defined as the date the consult for HCV treatment was placed to the date of the initial appointment with the HCV treatment provider. For the Choice group, the wait time was defined as the date the referral to the Choice program was made to the date of the initial appointment with the Choice HCP. Treatment regimens were evaluated for appropriateness based on guidelines from VACO and the American Association for the Study of Liver Diseases.^9-11

Tests performed by Choice providers were evaluated for whether they were relevant to HCV care and whether similar data already were available from VALLHCS. Tests that were not indicated were identified as unnecessary costs incurred by the Choice program, as were tests that had to be repeated at the VA because of a lack of documentation from the Choice provider. All medications given inappropriately were considered added costs. Medicare reimbursement rates for the most applicable Current Procedural Terminology (CPT) code and VA national contract pricing for medications were used for calculations. This study was approved by the VALLHCS institutional review board.

Statistical Analysis

IBM (Armonk, NY) Statistical Package for Social Sciences software was used to evaluate for differences in Fib-4, platelet count, prevalence of cirrhosis, prevalence of medical comorbidities, prevalence of mental health comorbidities, prevalence of the social issues defined in the Methods section, time from referral to time of appointment date, and SVR12 rate between the VA and Choice groups.

Exclusions

There were 15 veterans in the VA group who had a wait time of > 100 days. Of these, 5 (33%) were initially Choice referrals, but due to negative interactions with the Choice provider, the veterans returned to VALLHCS for care. Two of the 15 (13%) did not keep appointments and were lost to follow up. Six of the 15 (40%) had medical comorbidities that required more immediate attention, so HCV treatment initiation was deliberately moved back. The final 2 veterans scheduled their appointments unusually far apart, artificially increasing their wait time. Given that these were unique situations and some of the veterans received care from both Choice and VA providers, a decision was made to exclude these individuals from the study.

It has been shown that platelet count correlates with degree of liver fibrosis, a concept that is the basis for the Fib-4 scoring system.¹² Studies have shown that platelet count is a survival predictor in those with cirrhosis, and thrombocytopenia is a negative predictor of HCV treatment success using peginterferon and ribavirin.^13,14 Therefore, the VA memorandum automatically assigned the sickest individuals to the VA for HCV treatment. The goal of this study was to compare the impact of factors other than stage of fibrosis on HCV treatment success, which is why the 12 veterans with platelet count < 100,000 in the VA group were excluded. There were no veterans with platelet count < 100,000 in the Choice group.

When comparing SVR12 rates between the VA and Choice groups, every veteran treated at VALLHCS in FY 2016 was included, increasing the number in the VA group from 100 to 320 and therefore the power of this comparison.

Results

A summary of the statistical analysis can be found in Table 1. The genotype distribution was consistent with epidemiological studies, including those specific to veterans.^15,16 There were statistically significant differences (P < .001) in mean Fib-4 and mean platelet count. The VA group had a higher Fib-4 and lower platelet count. Seventy-four percent of the VA population was defined as cirrhotic, while only 3% of the Choice population met similar criteria (P < .001). The VA and Choice groups were similar in terms of age, gender, and genotype distribution (Table 2).

The VA group was found to have a higher prevalence of comorbidities that affected HCV treatment. These conditions included but were not limited to: chronic kidney disease that precluded the use of certain medications, any condition that required medication with a known interaction with DAAs (ie, proton pump inhibitors, statins, and amiodarone), and cirrhosis if it impacted the treatment regimen. The difference in the prevalence of mental health comorbidities was not significant (P = .39), but there was a higher prevalence of social issues among the VA group (P = .002).

The mean wait time from referral to appointment was 28.6 days for the VA group and 42.3 days for the Choice group (P < .001), indicating that a Choice referral took longer to complete than a referral within the VA for HCV treatment. Thirty of the 71 (42%) veterans seen by a Choice provider accrued extraneous cost, with a mean additional cost of $8,561.40 per veteran. In the Choice group, 61 veterans completed a treatment regimen with the Choice HCP. Fifty-five veterans completed treatment and had available SVR12 data (6 were lost to follow up without SVR12 testing) and 50 (91%) had confirmed SVR12. The charts of the 5 treatment failures were reviewed to discern the cause for failure. Two cases involved early termination of therapy, 3 involved relapse and 2 failed to comply with medication instructions. There was 1 case of the Choice HCP not addressing simultaneous use of ledipasvir and a proton pump inhibitor, potentially causing an interaction, and 1 case where both the VA and Choice providers failed to recognize indicators of cirrhosis, which impacted the regimen used.

In the VALLHCS group, records of 320 veterans who completed treatment and had SVR12 testing were reviewed. While the Choice memorandum was active, veterans selected to be treated at VALLHCS had advanced liver fibrosis or cirrhosis, medical and mental health comorbidities that increased the risk of treatment complications or were considered to have difficulty adhering to the medication regimen. For this group, 296 (93%) had confirmed SVR12. Eighteen of the 24 (75%) treatment failures were complicated by nonadherence, including all 13 cases of early termination. One patient died from complications of decompensated cirrhosis before completing treatment, and 1 did not receive HCV medications during a hospital admission due to poor coordination of care between the VA inpatient and outpatient pharmacy services, leading to multiple missed doses.

The difference in SVR12 rates (ie, treatment failure rates), between the VA and Choice groups was not statistically significant (P = .61). None of the specific reasons for treatment failure had a statistically significant difference between groups. A treatment failure analysis is shown in Table 3, and Table 4 indicates the breakdown of treatment regimens.

Discussion

The Veterans Health Administration (VHA) is the largest integrated health care system in the US, consisting of 152 medical centers and > 1,700 sites of care. The VA has the potential to meet the health care needs of 21.6 million veterans. About 9 million veterans are enrolled in the VA system and 5.9 million received health care through VHA.¹⁷ However, every medical service cannot realistically be made available at every facility, and some veterans have difficulty gaining access to VHA care; distance and wait times have been well-publicized issues that need further exploration.^18,19 The Choice program is an attempt to meet gaps in VA coverage using non-VA HCPs.

HCV infection is a specific diagnosis with national treatment guidelines and well-studied treatments; it can be cured, with an evidence-based definition of cure. The VACO policy memorandum to refer less sick veterans to Choice while treating sicker veterans at the VA provided the opportunity to directly compare the quality of the 2 programs. The SVR12 rates of VALLHCS and Choice providers were comparable to the national average at the time, and while the difference in SVR12 rate was not significant, VALLHCS treated a significantly higher number of patients with cirrhosis because of the referral criteria.²⁰

The significant difference in medical comorbidities between the VA and Choice groups was not surprising, partly because of the referral criteria. Cirrhosis can impact the treatment regimen, especially in regard to use of ribavirin. Since the presence of mental health comorbidities did not affect selection into the Choice group, it makes sense that there was no significant difference in prevalence between the groups.

VACO allowed veterans with HCV treatment plans that VA HCPs felt were too complicated for the Choice program to be treated by VHA HCPs.⁹ VALLHCS exercised this right for veterans at risk for nonadherence, because in HCV treatment, nonadherence leads to treatment failure and development of drug resistant virus strains. Therefore, veterans who would have difficulty traveling to VALLHCS to pick up medications, those who lacked means of communication (such as those who were homeless), and those who had active substance abuse were treated at the VA, where closer monitoring and immediate access to a wide range of services was possible. Studies have confirmed the impact of these types of issues on HCV treatment adherence and success.²¹ This explains the higher prevalence of social issues in the VA group.

For an internal referral for HCV treatment at VALLHCS, the hepatology provider submits a consult request to the HCV treatment provider, who works in the same office, making direct communication simple. The main administrative limiting factor to minimizing wait times is the number of HCPs, which is dependent on hiring allowances.

When a veteran is referred to Choice, the VA provider places a consult for non-VA care, which the VA Office of Community Care processes by compiling relevant documents and sending the package to Triwest Healthcare Alliance, a private insurance processor contracted with the VA. Triwest selects the Choice provider, often without any input from the VA, and arranges the veteran’s initial appointment.²² Geographic distance to the veteran’s address is the main selection criteria for Triwest. Documents sent between the Choice and VA HCPs go through the Office of Community Care and Triwest. This significantly increases the potential for delays and failed communication. Triwest had a comprehensive list of providers deemed to be qualified to treat HCV within the geographic catchment of VALLHCS. This list was reviewed, and all veterans referred to Choice had HCPs near their home address; therefore, availability of Choice HCPs was not an issue.

The VA can provide guidance on management of the veteran in the form of bundle packages containing a list of services for which the Choice provider is authorized to provide, and ones the Choice provider is not authorized to provide. Some Choice HCPs ordered tests that were not authorized for HCV treatment such as esophagogastroduodenoscopy, colonoscopy, and liver biopsy. In all, 17 of 71 (24%) veterans seen by Choice HCPs had tests performed or ordered that VA HCPs would not have obtained for the purpose of HCV treatment (Table 5).

In order to prevent veterans from receiving unnecessary tests, a VALLHCS hepatologist asked to be notified by VA administrators overseeing Choice referrals whenever a secondary authorization request (SAR) was submitted by a Choice HCP. This strategy is not standard VA practice, therefore at many VA sites these requested tests would have been performed by the Choice HCP, which is why SARs were factored into cost analysis.

SVR12 test results that were drawn too early and had to be repeated at VALLHCS were a cost unique to the Choice program. Duplicate tests, particularly imaging studies and blood work, were extraneous costs. The largest extraneous costs were treatment regimens prescribed by Choice HCPs that did not follow standard of care and required VA provider intervention. Thirty of the 71 (42%) veterans seen by a Choice provider accrued a mean $8,561.40 in extra costs. As a result, the Choice program cost VHA $250,000 more to provide care for 30 veterans (enough to pay for a physician’s annual salary).

Some inappropriate treatment regimens were the result of Choice HCP error, such as 1 case in which a veteran was inadvertently switched from ledipasvir/sofosbuvir to ombitasvir/paritaprevir/ritonavir/dasabuvir after week 4. The veteran had to start therapy over but still achieved SVR12. Other cases saw veterans receive regimens for which they had clear contraindications, such as creatinine clearance < 30 mL/min/1.73m² for sofosbuvir or a positive resistance panel for specific medications. Eleven of 62 (18%) veterans who were started on HCV treatment by a Choice HCP received a regimen not consistent with VA guidelines—an alarming result.

Follow up for veterans referred to Choice was extremely labor intensive, and assessment of personnel requirements in a Choice-based VA system must take this into consideration. The Choice HCP has no obligation to communicate with the VA HCP. At the time of chart review, 57 of 71 (80%) Choice veterans had inadequate documentation to make a confident assessment of the treatment outcome. Multiple calls to the offices of the Choice HCP were needed to acquire records, and veterans had to be tracked down for additional tests. Veterans often would complete treatment and stop following up with the Choice provider before SVR12 confirmation. The VA hepatology provider reviewing Choice referrals served as clinician, case manager, and clerk in order to get veterans to an appropriate end point in their hepatitis C treatment, with mostly unmeasured hours of work.

Limitations

The study population size was limited by the number of veterans able to complete treatment through Choice. The parameters in the VACO policy memos automatically selected the VA and Choice groups but made them clinically distinct populations. New treatment medications were released during the study period, which impacted management strategy. Occasionally, VA and non-VA HCPs preferred different treatment regimens, leading to variation in the distribution of regimens used despite similar genotype distribution (Tables 2 and 4). In addition, a retrospective study is at risk for recall bias. A prospective study randomizing veterans to the Choice and VA groups is an important future endeavor. Comparing veteran satisfaction for Choice and VA services is also crucial.

Conclusions

This study demonstrates that the VA was able to provide more cost-effective and more timely care for HCV treatment to a relatively sicker population with no reduction in treatment success when compared with non-VA HCPs through the Choice program. While the Choice program can help veterans receive services they may otherwise not have access to and reduce travel time, the current system introduces inefficiencies that delay care and decrease cost-effectiveness. The Choice HCP selection process is based on proximity rather than quality, which may place the veteran at risk for receiving substandard care. Large-scale quality of care studies that compare efficiency measures, clinical outcomes, patient demographics, travel distance, cost efficacy and patient satisfaction for veterans receiving similar services at a VA facility and through Choice should be performed to ensure that veterans receive the best care available.

Population studies show high prevalence of chronic hepatitis C virus (HCV) infection among veterans, especially Vietnam War era veterans.^1,2 The development of safe and efficacious direct-acting antiviral (DAA) medications to treat HCV infection made the majority of those infected eligible for treatment. However, the large number of veterans needing DAA treatment stressed the resources of the US Department of Veterans Affairs (VA) health care system. This occurred while Congress was focused on reducing wait times for veterans receiving care at the VA.

Congress passed the Veterans Access, Choice, and Accountability Act (Choice) on August 7, 2014, leading to the creation of the Veterans Choice Program. Legislators felt there were inappropriate delays in care at the VA, and the Choice program was meant to address this problem and provide an “apples-to-apples comparison [of the VA] with non-VA hospitals.”³

Congress acknowledged the importance of curing HCV in the veteran population and allocated $1.5 billion for fiscal year (FY) 2016 for DAAs. The VA Central Office (VACO) carefully monitored these resources. The first policy memorandum from VACO for HCV care, issued on May 21, 2015, recommended that the sickest patients who will benefit from the treatment “receive priority over those who are less ill.”^4,5 Those who met criteria for advanced liver disease were prioritized for treatment at the VA, while those who did not meet criteria were given the option of receiving treatment through Choice, or waiting for a change in policy.⁶ Over time, revisions to the guidelines relaxed the criteria for VA treatment eligibility, and on February 24, 2016, all restrictions on HCV treatment at the VA were lifted.^7,8

The aim of this study was to provide a comparison of VA and non-VA care, specifically to determine whether care provided through Choice was timelier and more cost effective than care provided by the VA, and whether there was a quality difference. The high prevalence among veterans, well-established standards of care, and finite treatment course with clear indicators of success and failure makes HCV treatment an ideal disease with which to make this comparison.

Methods

We retrospectively analyzed the VA electronic health records of all veterans seen in the VA Loma Linda Healthcare System (VALLHCS) Hepatology clinic for chronic HCV infection during FY 2016 who were referred to Choice for HCV treatment. One hundred veterans met these criteria, encompassing the Choice population; 71 were seen at least once by a non-VA (Choice) health care provider (HCP) and 61 completed a treatment regimen through Choice. Treatment completion was defined as cessation of medication after the planned duration of therapy, or early termination of medication without resumption by that HCP. The Choice population was matched to an equal number of veterans who received HCV treatment from VALLHCS HCPs.

Data collected included age, gender, HCV genotype, determinants of liver fibrosis, and treatment success (defined as sustained virologic response at 12 weeks after the last dose of medication [SVR12]). Determinants of liver fibrosis included documented cirrhosis or complications of cirrhosis, Fibrosis-4 score (Fib-4), and platelet count.

Treatment failures were categorized as nonresponse (defined as detectable HCV viral load at the end of treatment), relapse (defined as an undetectable HCV viral load at the end of treatment with a subsequent positive test), and early termination (defined as a failure to complete the planned treatment regimen). Documented patient nonadherence, medical comorbidities that affected the treatment protocol, mental health diagnoses, and active social issues (defined as active or history of heavy alcohol use, active or history of illicit drug use, lack of social support, and homelessness) were noted.

Timeliness of delivery of care was measured in days. For the VA group, the wait time was defined as the date the consult for HCV treatment was placed to the date of the initial appointment with the HCV treatment provider. For the Choice group, the wait time was defined as the date the referral to the Choice program was made to the date of the initial appointment with the Choice HCP. Treatment regimens were evaluated for appropriateness based on guidelines from VACO and the American Association for the Study of Liver Diseases.^9-11

Tests performed by Choice providers were evaluated for whether they were relevant to HCV care and whether similar data already were available from VALLHCS. Tests that were not indicated were identified as unnecessary costs incurred by the Choice program, as were tests that had to be repeated at the VA because of a lack of documentation from the Choice provider. All medications given inappropriately were considered added costs. Medicare reimbursement rates for the most applicable Current Procedural Terminology (CPT) code and VA national contract pricing for medications were used for calculations. This study was approved by the VALLHCS institutional review board.

Statistical Analysis

IBM (Armonk, NY) Statistical Package for Social Sciences software was used to evaluate for differences in Fib-4, platelet count, prevalence of cirrhosis, prevalence of medical comorbidities, prevalence of mental health comorbidities, prevalence of the social issues defined in the Methods section, time from referral to time of appointment date, and SVR12 rate between the VA and Choice groups.

Exclusions

There were 15 veterans in the VA group who had a wait time of > 100 days. Of these, 5 (33%) were initially Choice referrals, but due to negative interactions with the Choice provider, the veterans returned to VALLHCS for care. Two of the 15 (13%) did not keep appointments and were lost to follow up. Six of the 15 (40%) had medical comorbidities that required more immediate attention, so HCV treatment initiation was deliberately moved back. The final 2 veterans scheduled their appointments unusually far apart, artificially increasing their wait time. Given that these were unique situations and some of the veterans received care from both Choice and VA providers, a decision was made to exclude these individuals from the study.

It has been shown that platelet count correlates with degree of liver fibrosis, a concept that is the basis for the Fib-4 scoring system.¹² Studies have shown that platelet count is a survival predictor in those with cirrhosis, and thrombocytopenia is a negative predictor of HCV treatment success using peginterferon and ribavirin.^13,14 Therefore, the VA memorandum automatically assigned the sickest individuals to the VA for HCV treatment. The goal of this study was to compare the impact of factors other than stage of fibrosis on HCV treatment success, which is why the 12 veterans with platelet count < 100,000 in the VA group were excluded. There were no veterans with platelet count < 100,000 in the Choice group.

When comparing SVR12 rates between the VA and Choice groups, every veteran treated at VALLHCS in FY 2016 was included, increasing the number in the VA group from 100 to 320 and therefore the power of this comparison.

Results

A summary of the statistical analysis can be found in Table 1. The genotype distribution was consistent with epidemiological studies, including those specific to veterans.^15,16 There were statistically significant differences (P < .001) in mean Fib-4 and mean platelet count. The VA group had a higher Fib-4 and lower platelet count. Seventy-four percent of the VA population was defined as cirrhotic, while only 3% of the Choice population met similar criteria (P < .001). The VA and Choice groups were similar in terms of age, gender, and genotype distribution (Table 2).

The VA group was found to have a higher prevalence of comorbidities that affected HCV treatment. These conditions included but were not limited to: chronic kidney disease that precluded the use of certain medications, any condition that required medication with a known interaction with DAAs (ie, proton pump inhibitors, statins, and amiodarone), and cirrhosis if it impacted the treatment regimen. The difference in the prevalence of mental health comorbidities was not significant (P = .39), but there was a higher prevalence of social issues among the VA group (P = .002).

The mean wait time from referral to appointment was 28.6 days for the VA group and 42.3 days for the Choice group (P < .001), indicating that a Choice referral took longer to complete than a referral within the VA for HCV treatment. Thirty of the 71 (42%) veterans seen by a Choice provider accrued extraneous cost, with a mean additional cost of $8,561.40 per veteran. In the Choice group, 61 veterans completed a treatment regimen with the Choice HCP. Fifty-five veterans completed treatment and had available SVR12 data (6 were lost to follow up without SVR12 testing) and 50 (91%) had confirmed SVR12. The charts of the 5 treatment failures were reviewed to discern the cause for failure. Two cases involved early termination of therapy, 3 involved relapse and 2 failed to comply with medication instructions. There was 1 case of the Choice HCP not addressing simultaneous use of ledipasvir and a proton pump inhibitor, potentially causing an interaction, and 1 case where both the VA and Choice providers failed to recognize indicators of cirrhosis, which impacted the regimen used.

In the VALLHCS group, records of 320 veterans who completed treatment and had SVR12 testing were reviewed. While the Choice memorandum was active, veterans selected to be treated at VALLHCS had advanced liver fibrosis or cirrhosis, medical and mental health comorbidities that increased the risk of treatment complications or were considered to have difficulty adhering to the medication regimen. For this group, 296 (93%) had confirmed SVR12. Eighteen of the 24 (75%) treatment failures were complicated by nonadherence, including all 13 cases of early termination. One patient died from complications of decompensated cirrhosis before completing treatment, and 1 did not receive HCV medications during a hospital admission due to poor coordination of care between the VA inpatient and outpatient pharmacy services, leading to multiple missed doses.

The difference in SVR12 rates (ie, treatment failure rates), between the VA and Choice groups was not statistically significant (P = .61). None of the specific reasons for treatment failure had a statistically significant difference between groups. A treatment failure analysis is shown in Table 3, and Table 4 indicates the breakdown of treatment regimens.

Discussion

The Veterans Health Administration (VHA) is the largest integrated health care system in the US, consisting of 152 medical centers and > 1,700 sites of care. The VA has the potential to meet the health care needs of 21.6 million veterans. About 9 million veterans are enrolled in the VA system and 5.9 million received health care through VHA.¹⁷ However, every medical service cannot realistically be made available at every facility, and some veterans have difficulty gaining access to VHA care; distance and wait times have been well-publicized issues that need further exploration.^18,19 The Choice program is an attempt to meet gaps in VA coverage using non-VA HCPs.

HCV infection is a specific diagnosis with national treatment guidelines and well-studied treatments; it can be cured, with an evidence-based definition of cure. The VACO policy memorandum to refer less sick veterans to Choice while treating sicker veterans at the VA provided the opportunity to directly compare the quality of the 2 programs. The SVR12 rates of VALLHCS and Choice providers were comparable to the national average at the time, and while the difference in SVR12 rate was not significant, VALLHCS treated a significantly higher number of patients with cirrhosis because of the referral criteria.²⁰

The significant difference in medical comorbidities between the VA and Choice groups was not surprising, partly because of the referral criteria. Cirrhosis can impact the treatment regimen, especially in regard to use of ribavirin. Since the presence of mental health comorbidities did not affect selection into the Choice group, it makes sense that there was no significant difference in prevalence between the groups.

VACO allowed veterans with HCV treatment plans that VA HCPs felt were too complicated for the Choice program to be treated by VHA HCPs.⁹ VALLHCS exercised this right for veterans at risk for nonadherence, because in HCV treatment, nonadherence leads to treatment failure and development of drug resistant virus strains. Therefore, veterans who would have difficulty traveling to VALLHCS to pick up medications, those who lacked means of communication (such as those who were homeless), and those who had active substance abuse were treated at the VA, where closer monitoring and immediate access to a wide range of services was possible. Studies have confirmed the impact of these types of issues on HCV treatment adherence and success.²¹ This explains the higher prevalence of social issues in the VA group.

For an internal referral for HCV treatment at VALLHCS, the hepatology provider submits a consult request to the HCV treatment provider, who works in the same office, making direct communication simple. The main administrative limiting factor to minimizing wait times is the number of HCPs, which is dependent on hiring allowances.

When a veteran is referred to Choice, the VA provider places a consult for non-VA care, which the VA Office of Community Care processes by compiling relevant documents and sending the package to Triwest Healthcare Alliance, a private insurance processor contracted with the VA. Triwest selects the Choice provider, often without any input from the VA, and arranges the veteran’s initial appointment.²² Geographic distance to the veteran’s address is the main selection criteria for Triwest. Documents sent between the Choice and VA HCPs go through the Office of Community Care and Triwest. This significantly increases the potential for delays and failed communication. Triwest had a comprehensive list of providers deemed to be qualified to treat HCV within the geographic catchment of VALLHCS. This list was reviewed, and all veterans referred to Choice had HCPs near their home address; therefore, availability of Choice HCPs was not an issue.

The VA can provide guidance on management of the veteran in the form of bundle packages containing a list of services for which the Choice provider is authorized to provide, and ones the Choice provider is not authorized to provide. Some Choice HCPs ordered tests that were not authorized for HCV treatment such as esophagogastroduodenoscopy, colonoscopy, and liver biopsy. In all, 17 of 71 (24%) veterans seen by Choice HCPs had tests performed or ordered that VA HCPs would not have obtained for the purpose of HCV treatment (Table 5).

In order to prevent veterans from receiving unnecessary tests, a VALLHCS hepatologist asked to be notified by VA administrators overseeing Choice referrals whenever a secondary authorization request (SAR) was submitted by a Choice HCP. This strategy is not standard VA practice, therefore at many VA sites these requested tests would have been performed by the Choice HCP, which is why SARs were factored into cost analysis.

SVR12 test results that were drawn too early and had to be repeated at VALLHCS were a cost unique to the Choice program. Duplicate tests, particularly imaging studies and blood work, were extraneous costs. The largest extraneous costs were treatment regimens prescribed by Choice HCPs that did not follow standard of care and required VA provider intervention. Thirty of the 71 (42%) veterans seen by a Choice provider accrued a mean $8,561.40 in extra costs. As a result, the Choice program cost VHA $250,000 more to provide care for 30 veterans (enough to pay for a physician’s annual salary).

Some inappropriate treatment regimens were the result of Choice HCP error, such as 1 case in which a veteran was inadvertently switched from ledipasvir/sofosbuvir to ombitasvir/paritaprevir/ritonavir/dasabuvir after week 4. The veteran had to start therapy over but still achieved SVR12. Other cases saw veterans receive regimens for which they had clear contraindications, such as creatinine clearance < 30 mL/min/1.73m² for sofosbuvir or a positive resistance panel for specific medications. Eleven of 62 (18%) veterans who were started on HCV treatment by a Choice HCP received a regimen not consistent with VA guidelines—an alarming result.

Follow up for veterans referred to Choice was extremely labor intensive, and assessment of personnel requirements in a Choice-based VA system must take this into consideration. The Choice HCP has no obligation to communicate with the VA HCP. At the time of chart review, 57 of 71 (80%) Choice veterans had inadequate documentation to make a confident assessment of the treatment outcome. Multiple calls to the offices of the Choice HCP were needed to acquire records, and veterans had to be tracked down for additional tests. Veterans often would complete treatment and stop following up with the Choice provider before SVR12 confirmation. The VA hepatology provider reviewing Choice referrals served as clinician, case manager, and clerk in order to get veterans to an appropriate end point in their hepatitis C treatment, with mostly unmeasured hours of work.

Limitations

The study population size was limited by the number of veterans able to complete treatment through Choice. The parameters in the VACO policy memos automatically selected the VA and Choice groups but made them clinically distinct populations. New treatment medications were released during the study period, which impacted management strategy. Occasionally, VA and non-VA HCPs preferred different treatment regimens, leading to variation in the distribution of regimens used despite similar genotype distribution (Tables 2 and 4). In addition, a retrospective study is at risk for recall bias. A prospective study randomizing veterans to the Choice and VA groups is an important future endeavor. Comparing veteran satisfaction for Choice and VA services is also crucial.

Conclusions

This study demonstrates that the VA was able to provide more cost-effective and more timely care for HCV treatment to a relatively sicker population with no reduction in treatment success when compared with non-VA HCPs through the Choice program. While the Choice program can help veterans receive services they may otherwise not have access to and reduce travel time, the current system introduces inefficiencies that delay care and decrease cost-effectiveness. The Choice HCP selection process is based on proximity rather than quality, which may place the veteran at risk for receiving substandard care. Large-scale quality of care studies that compare efficiency measures, clinical outcomes, patient demographics, travel distance, cost efficacy and patient satisfaction for veterans receiving similar services at a VA facility and through Choice should be performed to ensure that veterans receive the best care available.

Readmissions following hospitalization for exacerbations of chronic obstructive pulmonary disease (COPD) are common and economically burdensome.¹ The Affordable Care Act² outlined the Hospital Readmissions Reduction Program (HRRP),³ which aims to improve the quality of care and reduce the costs for patients with pneumonia, myocardial infarction, congestive heart failure, and COPD.³ With the implementation of the HRRP, readmission reduction has become a key priority of health systems.

Multiple approaches to reduce readmissions are published, with variable degrees of success across respiratory and all-cause rehospitalizations.⁴ Patient self-management programs are heterogenous with inconsistent utilization reductions.^5-7 While some transitional care programs demonstrate benefits,^8-10 one notable study of an intensive transitional care and self-management program showed increaseNod acute care utilization without improving health-related quality of life.^11-13 Another study of COPD comprehensive care management was stopped prematurely for increased mortality in the intervention group.¹⁴ Telehealth monitoring may predict exacerbations,^15,16 but inconsistent effects on quality of life and utilization are observed.^17,18 Pulmonary rehabilitation improves quality of life but not healthcare utilization.¹⁹ Dispensing respiratory medications at hospital discharge shows improved prescription fills and fewer readmissions,²⁰ further reinforced by inhaler training prior to discharge.²¹ Postdischarge oxygen therapy does not improve health-related quality of life or acute care utilization.²² The fact that these approaches have not reliably succeeded raises the need for further study on the drivers of readmissions in COPD. Previous studies found differences in factors associated with the timing of COPD readmissions and return diagnoses.^23,24 While HRRP is Medicare-specific, health systems likely use programs targeting their entire population when planning readmission reduction strategies. Previous analyses were primarily single-center studies²⁵ and Medicare²⁴ or private insurance claims.²⁶

In this analysis, we explore how comorbidity burden^27-29 may differentially influence readmissions for recurrent COPD exacerbations versus other diagnoses. Our approach uses a national all-payer sample that covers a diverse geographic area across the United States, providing robust estimates of factors influencing readmission and valuable insights for planning and implementing effective readmission reduction programs. By including data from a period that encompasses the implementation of HRRP, we also provide new information on the factors in the HRRP postimplementation that are not yet available in published literature.

Data Source

The Nationwide Readmissions Database (NRD) is a nationally representative, all-payer, 100% sample of community acute care hospital discharges from multiple states.³⁰ We pooled COPD discharge records spanning 2010-2016, excluding those where the patients were not residents of the state in which they were hospitalized to minimize loss to follow-up.

Inclusion/Exclusion Criteria

Selection criteria mirrored the methodology used by the HRRP,^31,32 defining an index discharge as a patient ≥40 years of age with a qualifying COPD diagnosis (Appendix Tables 1-2), discharged alive, with at least 30 days elapsed since previous hospitalization. We excluded discharges against medical advice or those from a hospital with fewer than 25 COPD discharges in that calendar year as per HRRP,^31,32 as well as those involving lung transplants. In this pooled cross-sectional analysis, record identifiers were not reliably unique across years. We restricted to observations originating February-November because January stays may not have had the requisite HRRP 30-day washout period from last admission and December stays could not be tracked into the subsequent January.

Outcomes

We defined a readmission as subsequent hospitalization for any cause within 30 days of the index discharge, with exemptions defined by the HRRP (Appendix Figure 1).^31,32 We segmented the readmission outcome into two parts: those readmitted with diagnoses that met the COPD HRRP criteria versus for any other diagnoses. We also tabulated diagnosis-related groups (DRGs) coded for the readmission observation to capture attributable cause for rehospitalization.

Our main independent variable was the Elixhauser Comorbidity Index score,³³ constructed using adaptations of published software,^34,35 having previously validated its use for modeling COPD readmissions.³⁶ We involved covariates provided with the database, including sociodemographic variables (eg, age, sex, community characteristics, payer, and median income at patient’s ZIP code) and hospital characteristics (eg, size, ownership, teaching status). We constructed additional covariates to account for in-hospital events by aggregating ICD diagnosis and procedure codes (eg, mechanical ventilation), hospital discharge volume, and proportion of annual within-hospital Medicaid patient days as a surrogate marker for safety-net hospitals. A detailed explanation of database construction and selection criteria is found in the Supplemental Methods Appendix.

Statistical Analysis

We tabulated patient-level descriptive statistics across the three outcomes of interest (ie, not readmitted, readmitted for a stay that would have qualified as COPD-related by HRRP criteria and readmitted for any other diagnosis). Continuous variables were compared using Welch’s t-tests (ie, unequal variance) and categorical variables using Chi-squared tests. At the hospital level, we tabulated the proportions of hospitals within categories in key variables of interest and a sub-population readmission rate for that particular characteristic, compared using Chi-squared tests.

We fit a multilevel multinomial logistic regression with random intercepts at the hospital cluster level, with the tripartite readmission outcome described above with “not readmitted” as the reference group. We included fixed effects for year, Elixhauser score, and patient- and hospital-level covariates as described above. Time to readmission for each group was plotted to assess the time distribution for each outcome. In-hospital mortality during each readmission event was tabulated.

Sensitivity Analyses and Missing Data

We conducted sensitivity analyses to determine whether a lower age cutoff (≥18 years) affects modeling. We also tested the stability of our estimates across each individual year of the pooled analysis. To test the effect of time to differential readmission, we fit a Cox proportional hazards model within the readmitted patient subgroup with Huber-White standard errors clustered at the hospital level to estimate the differential hazard of readmission for COPD versus non-COPD diagnoses across the same variables of interest as a sensitivity analysis. We also tested using a liberal classification of readmission diagnoses by sorting into “respiratory” versus “nonrespiratory” returns, with DRGs 163 through 208 for “respiratory” versus all others, respectively. We tested the agreement between the HRRP ICD-based classification and DRG classification using Cohen’s kappa.

We designated a threshold of 10% missing data to necessitate imputation techniques, determined a priori for our main variables, none of which met this level. Complete case analyses were used for all models. Analyses were performed in Stata version 15.1 (StataCorp, College Station, Texas) with weighted estimates reported using patient-level survey weights for national representativeness.³⁷ The study protocol was reviewed by the institutional review board at the University of California, Los Angeles, and deemed exempt from oversight due to the publicly available, deidentified nature of the data (IRB# 18-001208).

Out of 104,897,595 hospitalizations in the NRD, a final sample of 1,622,983 COPD discharges was identified for our analysis (sample weighted effective population 3,743,164). The overall readmission rate was 17.25%, with 7.69% of patients readmitted for COPD and 9.56% readmitted for other diagnoses. Those with COPD readmissions were significantly younger with a lower proportion of Medicare and a higher proportion of Medicaid as the primary payer compared with those readmitted for all other causes (Table 1). Compared with non-COPD-readmitted patients, COPD-readmitted patients were more frequently discharged home without services and had shorter lengths of stay. Noninvasive ventilation was more common among COPD readmissions while mechanical ventilation and tracheostomy placement were less frequent compared with non-COPD readmissions. Compared with non-COPD-readmitted patients, COPD-readmitted patients had significantly lower mean Elixhauser Comorbidity Index scores (17.8 vs 22.8), rates of congestive heart failure (28.3% vs 38.6%), and renal failure (11.8% vs 21.5%; Appendix Table 3).

Readmission rates were significantly higher for non-COPD causes than for COPD causes across all hospital types by ownership, teaching status, or size (Table 2). Parallel patterns were observed for non-COPD and COPD readmissions across hospital types, with two key exceptions. Across categories of hospital ownership, for-profit hospitals had the highest rates for non-COPD readmissions, with no differences in hospital control for COPD rehospitalizations. While rates did not vary for non-COPD readmissions by within-hospital Medicaid prevalence, COPD readmission rates significantly increased as Medicaid-paid patient-days increased within hospitals.

In this assessment of readmission odds following hospitalizations for COPD in a nationally representative all-payer sample, we demonstrate that 55% of rehospitalizations following COPD exacerbations are attributable to non-COPD diagnoses and describe the important role of comorbidity on influencing diagnoses at rehospitalization. These findings are consistent with a prior study of Medicare patients by Shah et al.²⁴ and expand upon the results of Jacobs et al. using a pre-HRRP sample of the NRD.²³ Our study offers an expanded analysis by including data spanning HRRP implementation, which went into effect for COPD in October 2014.³ Effect estimates were stable across all seven years of our study in sensitivity analyses, demonstrating the robustness of our findings. Our analysis also adds to the existing body of literature by assessing which factors are associated with readmissions related to ongoing COPD versus other diagnoses.

In our study, an increase in aggregated comorbidity by the Elixhauser Index was associated with a significantly higher readmission odds, with over four times the effect size for non-COPD than COPD returns. Comorbidity also moderated the effect of other factors, such as income and discharge disposition. While overall readmission rates declined across the course of the study period, the effect of comorbidity on readmission odds for both groups remained significant in annualized models. We also observed higher rates of nearly every individual Elixhauser component comorbidity in those readmitted for non-COPD causes compared with those readmitted for COPD causes. Taken together, these results underscore the need to account for comorbidities at the individual and composite levels when identifying those at highest risk for readmissions and necessitate a multidisciplinary approach to reduce risk for the multimorbid patient.

In a 2018 report, the American Thoracic Society highlighted the focus of programs on adherence to guidelines and reducing variability in COPD care as a potential pitfall in efforts to reduce COPD readmissions.³⁹ We demonstrate that a majority of patients who are readmitted return for diagnoses other than COPD. This finding further highlights that readmission reduction programs need not only focus on COPD control but on the overall management of the patient’s complex medical comorbidities. HRRP penalties are assessed for all-cause readmissions,^31,32 and attention to the entire range of diagnoses leading to return to hospital is important to reduce readmission rates and expenditures. Use of strategies such as multispecialty clinics or integrated practice units may be useful in mitigating risk in multimorbid COPD patients.

Other significant factors that deserve further investigation include the use of postacute care services, including home health and skilled nursing facilities. Both factors were associated with higher likelihood of returning for non-COPD than for COPD-related diagnoses. This finding may be collinear to some degree with comorbidity because complex patients are probably less likely to be discharged home directly. Interestingly, those discharged to a postacute care facility had substantially high odds of readmission for a non-COPD cause. Transitional care programs, including short stays in a nursing home, are often employed to mitigate the risk of adverse outcomes after discharge in sicker patients,⁴⁰ which may be insufficient based on these data.

We applied the HRRP criteria for coding a COPD-related admission to the readmission diagnoses, which is more stringent than using only a principal diagnosis or DRGs, to maintain the same standard for defining the index and readmission event. In the sensitivity analyses, we did not find significant differences in our estimates of comorbidity’s effect on outcomes using a more liberal DRG classification system.

We also used DRGs to classify the readmission causes in order to use the same grouping logic that a payer would use when determining the cause. When evaluating which DRG patients returned for following a COPD exacerbation, pneumonia or other respiratory infections make up 13.8%, which may represent the evolution of respiratory infections that provoked the original exacerbation. Heart failure comprised 9.1% of the non-COPD causes, with about one-third of our COPD cohort having known comorbid heart failure at the time of index admission, illustrating significant overlap between these two conditions. Heart failure and pneumonia are conditions of interest in the HRRP and would potentially garner their own penalties had sufficient time elapsed since a prior hospitalization. Among other causes in the top 20 return DRGs were esophagitis, gastritis, gastrointestinal bleeding, and psychoses, which may be potentially associated with the use of corticosteroids to treat a COPD exacerbation, as described in other population studies.^41,42 Lack of medication regimen data in our analysis precludes further attribution of these causes, but the potential associations are interesting and warrant additional study.

The structure of our data as pooled annual cross sections rather than a true longitudinal cohort limited us to use only 10 months (February to November) of index hospitalizations in order to stay aligned with HRRP policy inclusion criteria. As such, we may have missed some important observations during peak respiratory virus season. As in any administrative data analysis, we are limited to codes in the discharge records, which may not reflect the entire nature of a hospitalization. Administrative data are particularly problematic in identifying true COPD exacerbations, particularly with multiple comorbid cardiopulmonary conditions.^43,44 Validating coding algorithms for identifying COPD was beyond the scope of our evaluation, which purposefully used HRRP methodology. Further study thereof would be a useful endeavor, especially with transition to ICD-10, considering that previously published evaluation was limited to ICD-9.⁴⁴ Despite these limitations, we were left with a robust and representative national cohort, which is an acceptable tradeoff.

Our study highlights the importance of understanding comorbidity as a major determinant of readmissions following COPD exacerbations, particularly in distinguishing which patients will return for COPD versus non-COPD-related diagnoses. At the health system level, readmission programs should be designed with the multimorbid patient in mind. Engagement of care teams, facilitating communication, and shared decision making are strategies to mitigate readmission risk in addition to COPD-focused disease management.³⁹ These data highlight the need to use risk prediction tools in assigning resources to reduce readmissions,⁴⁵ as well as the need to move readmission reduction programs beyond COPD management alone. Developing such systems to prospectively identify which patients are at risk of returning for both COPD and non-COPD reasons may further elucidate readmission mitigation strategies and should be a subject of future prospective study.

Acknowledgments

Data were made available through the Agency for Healthcare Research and Quality’s Healthcare Utilization Project. A full list of partner organizations providing data for the Nationwide Readmission Database can be found at https://www.hcup-us.ahrq.gov/db/hcupdatapartners.jsp.

Prior Presentation

Portions of this work were presented in abstract form at the 2018 American Thoracic Society International Conference (May 2018, San Diego, CA). This manuscript is derived from the doctoral dissertation for the degree of PhD in Health Policy and Management of the corresponding author, conferred in June 2019.

Disclaimer

This article does not necessarily represent the views and policies of the Department of Veterans Affairs or the USPSTF.

Readmissions following hospitalization for exacerbations of chronic obstructive pulmonary disease (COPD) are common and economically burdensome.¹ The Affordable Care Act² outlined the Hospital Readmissions Reduction Program (HRRP),³ which aims to improve the quality of care and reduce the costs for patients with pneumonia, myocardial infarction, congestive heart failure, and COPD.³ With the implementation of the HRRP, readmission reduction has become a key priority of health systems.

Multiple approaches to reduce readmissions are published, with variable degrees of success across respiratory and all-cause rehospitalizations.⁴ Patient self-management programs are heterogenous with inconsistent utilization reductions.^5-7 While some transitional care programs demonstrate benefits,^8-10 one notable study of an intensive transitional care and self-management program showed increaseNod acute care utilization without improving health-related quality of life.^11-13 Another study of COPD comprehensive care management was stopped prematurely for increased mortality in the intervention group.¹⁴ Telehealth monitoring may predict exacerbations,^15,16 but inconsistent effects on quality of life and utilization are observed.^17,18 Pulmonary rehabilitation improves quality of life but not healthcare utilization.¹⁹ Dispensing respiratory medications at hospital discharge shows improved prescription fills and fewer readmissions,²⁰ further reinforced by inhaler training prior to discharge.²¹ Postdischarge oxygen therapy does not improve health-related quality of life or acute care utilization.²² The fact that these approaches have not reliably succeeded raises the need for further study on the drivers of readmissions in COPD. Previous studies found differences in factors associated with the timing of COPD readmissions and return diagnoses.^23,24 While HRRP is Medicare-specific, health systems likely use programs targeting their entire population when planning readmission reduction strategies. Previous analyses were primarily single-center studies²⁵ and Medicare²⁴ or private insurance claims.²⁶

In this analysis, we explore how comorbidity burden^27-29 may differentially influence readmissions for recurrent COPD exacerbations versus other diagnoses. Our approach uses a national all-payer sample that covers a diverse geographic area across the United States, providing robust estimates of factors influencing readmission and valuable insights for planning and implementing effective readmission reduction programs. By including data from a period that encompasses the implementation of HRRP, we also provide new information on the factors in the HRRP postimplementation that are not yet available in published literature.

Data Source

The Nationwide Readmissions Database (NRD) is a nationally representative, all-payer, 100% sample of community acute care hospital discharges from multiple states.³⁰ We pooled COPD discharge records spanning 2010-2016, excluding those where the patients were not residents of the state in which they were hospitalized to minimize loss to follow-up.

Inclusion/Exclusion Criteria

Selection criteria mirrored the methodology used by the HRRP,^31,32 defining an index discharge as a patient ≥40 years of age with a qualifying COPD diagnosis (Appendix Tables 1-2), discharged alive, with at least 30 days elapsed since previous hospitalization. We excluded discharges against medical advice or those from a hospital with fewer than 25 COPD discharges in that calendar year as per HRRP,^31,32 as well as those involving lung transplants. In this pooled cross-sectional analysis, record identifiers were not reliably unique across years. We restricted to observations originating February-November because January stays may not have had the requisite HRRP 30-day washout period from last admission and December stays could not be tracked into the subsequent January.

Outcomes

We defined a readmission as subsequent hospitalization for any cause within 30 days of the index discharge, with exemptions defined by the HRRP (Appendix Figure 1).^31,32 We segmented the readmission outcome into two parts: those readmitted with diagnoses that met the COPD HRRP criteria versus for any other diagnoses. We also tabulated diagnosis-related groups (DRGs) coded for the readmission observation to capture attributable cause for rehospitalization.

Our main independent variable was the Elixhauser Comorbidity Index score,³³ constructed using adaptations of published software,^34,35 having previously validated its use for modeling COPD readmissions.³⁶ We involved covariates provided with the database, including sociodemographic variables (eg, age, sex, community characteristics, payer, and median income at patient’s ZIP code) and hospital characteristics (eg, size, ownership, teaching status). We constructed additional covariates to account for in-hospital events by aggregating ICD diagnosis and procedure codes (eg, mechanical ventilation), hospital discharge volume, and proportion of annual within-hospital Medicaid patient days as a surrogate marker for safety-net hospitals. A detailed explanation of database construction and selection criteria is found in the Supplemental Methods Appendix.

Statistical Analysis

We tabulated patient-level descriptive statistics across the three outcomes of interest (ie, not readmitted, readmitted for a stay that would have qualified as COPD-related by HRRP criteria and readmitted for any other diagnosis). Continuous variables were compared using Welch’s t-tests (ie, unequal variance) and categorical variables using Chi-squared tests. At the hospital level, we tabulated the proportions of hospitals within categories in key variables of interest and a sub-population readmission rate for that particular characteristic, compared using Chi-squared tests.

We fit a multilevel multinomial logistic regression with random intercepts at the hospital cluster level, with the tripartite readmission outcome described above with “not readmitted” as the reference group. We included fixed effects for year, Elixhauser score, and patient- and hospital-level covariates as described above. Time to readmission for each group was plotted to assess the time distribution for each outcome. In-hospital mortality during each readmission event was tabulated.

Sensitivity Analyses and Missing Data

We conducted sensitivity analyses to determine whether a lower age cutoff (≥18 years) affects modeling. We also tested the stability of our estimates across each individual year of the pooled analysis. To test the effect of time to differential readmission, we fit a Cox proportional hazards model within the readmitted patient subgroup with Huber-White standard errors clustered at the hospital level to estimate the differential hazard of readmission for COPD versus non-COPD diagnoses across the same variables of interest as a sensitivity analysis. We also tested using a liberal classification of readmission diagnoses by sorting into “respiratory” versus “nonrespiratory” returns, with DRGs 163 through 208 for “respiratory” versus all others, respectively. We tested the agreement between the HRRP ICD-based classification and DRG classification using Cohen’s kappa.

We designated a threshold of 10% missing data to necessitate imputation techniques, determined a priori for our main variables, none of which met this level. Complete case analyses were used for all models. Analyses were performed in Stata version 15.1 (StataCorp, College Station, Texas) with weighted estimates reported using patient-level survey weights for national representativeness.³⁷ The study protocol was reviewed by the institutional review board at the University of California, Los Angeles, and deemed exempt from oversight due to the publicly available, deidentified nature of the data (IRB# 18-001208).

Out of 104,897,595 hospitalizations in the NRD, a final sample of 1,622,983 COPD discharges was identified for our analysis (sample weighted effective population 3,743,164). The overall readmission rate was 17.25%, with 7.69% of patients readmitted for COPD and 9.56% readmitted for other diagnoses. Those with COPD readmissions were significantly younger with a lower proportion of Medicare and a higher proportion of Medicaid as the primary payer compared with those readmitted for all other causes (Table 1). Compared with non-COPD-readmitted patients, COPD-readmitted patients were more frequently discharged home without services and had shorter lengths of stay. Noninvasive ventilation was more common among COPD readmissions while mechanical ventilation and tracheostomy placement were less frequent compared with non-COPD readmissions. Compared with non-COPD-readmitted patients, COPD-readmitted patients had significantly lower mean Elixhauser Comorbidity Index scores (17.8 vs 22.8), rates of congestive heart failure (28.3% vs 38.6%), and renal failure (11.8% vs 21.5%; Appendix Table 3).

Readmission rates were significantly higher for non-COPD causes than for COPD causes across all hospital types by ownership, teaching status, or size (Table 2). Parallel patterns were observed for non-COPD and COPD readmissions across hospital types, with two key exceptions. Across categories of hospital ownership, for-profit hospitals had the highest rates for non-COPD readmissions, with no differences in hospital control for COPD rehospitalizations. While rates did not vary for non-COPD readmissions by within-hospital Medicaid prevalence, COPD readmission rates significantly increased as Medicaid-paid patient-days increased within hospitals.

In this assessment of readmission odds following hospitalizations for COPD in a nationally representative all-payer sample, we demonstrate that 55% of rehospitalizations following COPD exacerbations are attributable to non-COPD diagnoses and describe the important role of comorbidity on influencing diagnoses at rehospitalization. These findings are consistent with a prior study of Medicare patients by Shah et al.²⁴ and expand upon the results of Jacobs et al. using a pre-HRRP sample of the NRD.²³ Our study offers an expanded analysis by including data spanning HRRP implementation, which went into effect for COPD in October 2014.³ Effect estimates were stable across all seven years of our study in sensitivity analyses, demonstrating the robustness of our findings. Our analysis also adds to the existing body of literature by assessing which factors are associated with readmissions related to ongoing COPD versus other diagnoses.

In our study, an increase in aggregated comorbidity by the Elixhauser Index was associated with a significantly higher readmission odds, with over four times the effect size for non-COPD than COPD returns. Comorbidity also moderated the effect of other factors, such as income and discharge disposition. While overall readmission rates declined across the course of the study period, the effect of comorbidity on readmission odds for both groups remained significant in annualized models. We also observed higher rates of nearly every individual Elixhauser component comorbidity in those readmitted for non-COPD causes compared with those readmitted for COPD causes. Taken together, these results underscore the need to account for comorbidities at the individual and composite levels when identifying those at highest risk for readmissions and necessitate a multidisciplinary approach to reduce risk for the multimorbid patient.

In a 2018 report, the American Thoracic Society highlighted the focus of programs on adherence to guidelines and reducing variability in COPD care as a potential pitfall in efforts to reduce COPD readmissions.³⁹ We demonstrate that a majority of patients who are readmitted return for diagnoses other than COPD. This finding further highlights that readmission reduction programs need not only focus on COPD control but on the overall management of the patient’s complex medical comorbidities. HRRP penalties are assessed for all-cause readmissions,^31,32 and attention to the entire range of diagnoses leading to return to hospital is important to reduce readmission rates and expenditures. Use of strategies such as multispecialty clinics or integrated practice units may be useful in mitigating risk in multimorbid COPD patients.

Other significant factors that deserve further investigation include the use of postacute care services, including home health and skilled nursing facilities. Both factors were associated with higher likelihood of returning for non-COPD than for COPD-related diagnoses. This finding may be collinear to some degree with comorbidity because complex patients are probably less likely to be discharged home directly. Interestingly, those discharged to a postacute care facility had substantially high odds of readmission for a non-COPD cause. Transitional care programs, including short stays in a nursing home, are often employed to mitigate the risk of adverse outcomes after discharge in sicker patients,⁴⁰ which may be insufficient based on these data.

We applied the HRRP criteria for coding a COPD-related admission to the readmission diagnoses, which is more stringent than using only a principal diagnosis or DRGs, to maintain the same standard for defining the index and readmission event. In the sensitivity analyses, we did not find significant differences in our estimates of comorbidity’s effect on outcomes using a more liberal DRG classification system.

We also used DRGs to classify the readmission causes in order to use the same grouping logic that a payer would use when determining the cause. When evaluating which DRG patients returned for following a COPD exacerbation, pneumonia or other respiratory infections make up 13.8%, which may represent the evolution of respiratory infections that provoked the original exacerbation. Heart failure comprised 9.1% of the non-COPD causes, with about one-third of our COPD cohort having known comorbid heart failure at the time of index admission, illustrating significant overlap between these two conditions. Heart failure and pneumonia are conditions of interest in the HRRP and would potentially garner their own penalties had sufficient time elapsed since a prior hospitalization. Among other causes in the top 20 return DRGs were esophagitis, gastritis, gastrointestinal bleeding, and psychoses, which may be potentially associated with the use of corticosteroids to treat a COPD exacerbation, as described in other population studies.^41,42 Lack of medication regimen data in our analysis precludes further attribution of these causes, but the potential associations are interesting and warrant additional study.

The structure of our data as pooled annual cross sections rather than a true longitudinal cohort limited us to use only 10 months (February to November) of index hospitalizations in order to stay aligned with HRRP policy inclusion criteria. As such, we may have missed some important observations during peak respiratory virus season. As in any administrative data analysis, we are limited to codes in the discharge records, which may not reflect the entire nature of a hospitalization. Administrative data are particularly problematic in identifying true COPD exacerbations, particularly with multiple comorbid cardiopulmonary conditions.^43,44 Validating coding algorithms for identifying COPD was beyond the scope of our evaluation, which purposefully used HRRP methodology. Further study thereof would be a useful endeavor, especially with transition to ICD-10, considering that previously published evaluation was limited to ICD-9.⁴⁴ Despite these limitations, we were left with a robust and representative national cohort, which is an acceptable tradeoff.

Our study highlights the importance of understanding comorbidity as a major determinant of readmissions following COPD exacerbations, particularly in distinguishing which patients will return for COPD versus non-COPD-related diagnoses. At the health system level, readmission programs should be designed with the multimorbid patient in mind. Engagement of care teams, facilitating communication, and shared decision making are strategies to mitigate readmission risk in addition to COPD-focused disease management.³⁹ These data highlight the need to use risk prediction tools in assigning resources to reduce readmissions,⁴⁵ as well as the need to move readmission reduction programs beyond COPD management alone. Developing such systems to prospectively identify which patients are at risk of returning for both COPD and non-COPD reasons may further elucidate readmission mitigation strategies and should be a subject of future prospective study.

Acknowledgments

Data were made available through the Agency for Healthcare Research and Quality’s Healthcare Utilization Project. A full list of partner organizations providing data for the Nationwide Readmission Database can be found at https://www.hcup-us.ahrq.gov/db/hcupdatapartners.jsp.

Prior Presentation

Portions of this work were presented in abstract form at the 2018 American Thoracic Society International Conference (May 2018, San Diego, CA). This manuscript is derived from the doctoral dissertation for the degree of PhD in Health Policy and Management of the corresponding author, conferred in June 2019.

Disclaimer

This article does not necessarily represent the views and policies of the Department of Veterans Affairs or the USPSTF.

Readmissions following hospitalization for exacerbations of chronic obstructive pulmonary disease (COPD) are common and economically burdensome.¹ The Affordable Care Act² outlined the Hospital Readmissions Reduction Program (HRRP),³ which aims to improve the quality of care and reduce the costs for patients with pneumonia, myocardial infarction, congestive heart failure, and COPD.³ With the implementation of the HRRP, readmission reduction has become a key priority of health systems.

Multiple approaches to reduce readmissions are published, with variable degrees of success across respiratory and all-cause rehospitalizations.⁴ Patient self-management programs are heterogenous with inconsistent utilization reductions.^5-7 While some transitional care programs demonstrate benefits,^8-10 one notable study of an intensive transitional care and self-management program showed increaseNod acute care utilization without improving health-related quality of life.^11-13 Another study of COPD comprehensive care management was stopped prematurely for increased mortality in the intervention group.¹⁴ Telehealth monitoring may predict exacerbations,^15,16 but inconsistent effects on quality of life and utilization are observed.^17,18 Pulmonary rehabilitation improves quality of life but not healthcare utilization.¹⁹ Dispensing respiratory medications at hospital discharge shows improved prescription fills and fewer readmissions,²⁰ further reinforced by inhaler training prior to discharge.²¹ Postdischarge oxygen therapy does not improve health-related quality of life or acute care utilization.²² The fact that these approaches have not reliably succeeded raises the need for further study on the drivers of readmissions in COPD. Previous studies found differences in factors associated with the timing of COPD readmissions and return diagnoses.^23,24 While HRRP is Medicare-specific, health systems likely use programs targeting their entire population when planning readmission reduction strategies. Previous analyses were primarily single-center studies²⁵ and Medicare²⁴ or private insurance claims.²⁶

In this analysis, we explore how comorbidity burden^27-29 may differentially influence readmissions for recurrent COPD exacerbations versus other diagnoses. Our approach uses a national all-payer sample that covers a diverse geographic area across the United States, providing robust estimates of factors influencing readmission and valuable insights for planning and implementing effective readmission reduction programs. By including data from a period that encompasses the implementation of HRRP, we also provide new information on the factors in the HRRP postimplementation that are not yet available in published literature.

Data Source

The Nationwide Readmissions Database (NRD) is a nationally representative, all-payer, 100% sample of community acute care hospital discharges from multiple states.³⁰ We pooled COPD discharge records spanning 2010-2016, excluding those where the patients were not residents of the state in which they were hospitalized to minimize loss to follow-up.

Inclusion/Exclusion Criteria

Selection criteria mirrored the methodology used by the HRRP,^31,32 defining an index discharge as a patient ≥40 years of age with a qualifying COPD diagnosis (Appendix Tables 1-2), discharged alive, with at least 30 days elapsed since previous hospitalization. We excluded discharges against medical advice or those from a hospital with fewer than 25 COPD discharges in that calendar year as per HRRP,^31,32 as well as those involving lung transplants. In this pooled cross-sectional analysis, record identifiers were not reliably unique across years. We restricted to observations originating February-November because January stays may not have had the requisite HRRP 30-day washout period from last admission and December stays could not be tracked into the subsequent January.

Outcomes

We defined a readmission as subsequent hospitalization for any cause within 30 days of the index discharge, with exemptions defined by the HRRP (Appendix Figure 1).^31,32 We segmented the readmission outcome into two parts: those readmitted with diagnoses that met the COPD HRRP criteria versus for any other diagnoses. We also tabulated diagnosis-related groups (DRGs) coded for the readmission observation to capture attributable cause for rehospitalization.

Our main independent variable was the Elixhauser Comorbidity Index score,³³ constructed using adaptations of published software,^34,35 having previously validated its use for modeling COPD readmissions.³⁶ We involved covariates provided with the database, including sociodemographic variables (eg, age, sex, community characteristics, payer, and median income at patient’s ZIP code) and hospital characteristics (eg, size, ownership, teaching status). We constructed additional covariates to account for in-hospital events by aggregating ICD diagnosis and procedure codes (eg, mechanical ventilation), hospital discharge volume, and proportion of annual within-hospital Medicaid patient days as a surrogate marker for safety-net hospitals. A detailed explanation of database construction and selection criteria is found in the Supplemental Methods Appendix.

Statistical Analysis

We tabulated patient-level descriptive statistics across the three outcomes of interest (ie, not readmitted, readmitted for a stay that would have qualified as COPD-related by HRRP criteria and readmitted for any other diagnosis). Continuous variables were compared using Welch’s t-tests (ie, unequal variance) and categorical variables using Chi-squared tests. At the hospital level, we tabulated the proportions of hospitals within categories in key variables of interest and a sub-population readmission rate for that particular characteristic, compared using Chi-squared tests.

We fit a multilevel multinomial logistic regression with random intercepts at the hospital cluster level, with the tripartite readmission outcome described above with “not readmitted” as the reference group. We included fixed effects for year, Elixhauser score, and patient- and hospital-level covariates as described above. Time to readmission for each group was plotted to assess the time distribution for each outcome. In-hospital mortality during each readmission event was tabulated.

Sensitivity Analyses and Missing Data

We conducted sensitivity analyses to determine whether a lower age cutoff (≥18 years) affects modeling. We also tested the stability of our estimates across each individual year of the pooled analysis. To test the effect of time to differential readmission, we fit a Cox proportional hazards model within the readmitted patient subgroup with Huber-White standard errors clustered at the hospital level to estimate the differential hazard of readmission for COPD versus non-COPD diagnoses across the same variables of interest as a sensitivity analysis. We also tested using a liberal classification of readmission diagnoses by sorting into “respiratory” versus “nonrespiratory” returns, with DRGs 163 through 208 for “respiratory” versus all others, respectively. We tested the agreement between the HRRP ICD-based classification and DRG classification using Cohen’s kappa.

We designated a threshold of 10% missing data to necessitate imputation techniques, determined a priori for our main variables, none of which met this level. Complete case analyses were used for all models. Analyses were performed in Stata version 15.1 (StataCorp, College Station, Texas) with weighted estimates reported using patient-level survey weights for national representativeness.³⁷ The study protocol was reviewed by the institutional review board at the University of California, Los Angeles, and deemed exempt from oversight due to the publicly available, deidentified nature of the data (IRB# 18-001208).

Out of 104,897,595 hospitalizations in the NRD, a final sample of 1,622,983 COPD discharges was identified for our analysis (sample weighted effective population 3,743,164). The overall readmission rate was 17.25%, with 7.69% of patients readmitted for COPD and 9.56% readmitted for other diagnoses. Those with COPD readmissions were significantly younger with a lower proportion of Medicare and a higher proportion of Medicaid as the primary payer compared with those readmitted for all other causes (Table 1). Compared with non-COPD-readmitted patients, COPD-readmitted patients were more frequently discharged home without services and had shorter lengths of stay. Noninvasive ventilation was more common among COPD readmissions while mechanical ventilation and tracheostomy placement were less frequent compared with non-COPD readmissions. Compared with non-COPD-readmitted patients, COPD-readmitted patients had significantly lower mean Elixhauser Comorbidity Index scores (17.8 vs 22.8), rates of congestive heart failure (28.3% vs 38.6%), and renal failure (11.8% vs 21.5%; Appendix Table 3).

Readmission rates were significantly higher for non-COPD causes than for COPD causes across all hospital types by ownership, teaching status, or size (Table 2). Parallel patterns were observed for non-COPD and COPD readmissions across hospital types, with two key exceptions. Across categories of hospital ownership, for-profit hospitals had the highest rates for non-COPD readmissions, with no differences in hospital control for COPD rehospitalizations. While rates did not vary for non-COPD readmissions by within-hospital Medicaid prevalence, COPD readmission rates significantly increased as Medicaid-paid patient-days increased within hospitals.

In this assessment of readmission odds following hospitalizations for COPD in a nationally representative all-payer sample, we demonstrate that 55% of rehospitalizations following COPD exacerbations are attributable to non-COPD diagnoses and describe the important role of comorbidity on influencing diagnoses at rehospitalization. These findings are consistent with a prior study of Medicare patients by Shah et al.²⁴ and expand upon the results of Jacobs et al. using a pre-HRRP sample of the NRD.²³ Our study offers an expanded analysis by including data spanning HRRP implementation, which went into effect for COPD in October 2014.³ Effect estimates were stable across all seven years of our study in sensitivity analyses, demonstrating the robustness of our findings. Our analysis also adds to the existing body of literature by assessing which factors are associated with readmissions related to ongoing COPD versus other diagnoses.

In our study, an increase in aggregated comorbidity by the Elixhauser Index was associated with a significantly higher readmission odds, with over four times the effect size for non-COPD than COPD returns. Comorbidity also moderated the effect of other factors, such as income and discharge disposition. While overall readmission rates declined across the course of the study period, the effect of comorbidity on readmission odds for both groups remained significant in annualized models. We also observed higher rates of nearly every individual Elixhauser component comorbidity in those readmitted for non-COPD causes compared with those readmitted for COPD causes. Taken together, these results underscore the need to account for comorbidities at the individual and composite levels when identifying those at highest risk for readmissions and necessitate a multidisciplinary approach to reduce risk for the multimorbid patient.

In a 2018 report, the American Thoracic Society highlighted the focus of programs on adherence to guidelines and reducing variability in COPD care as a potential pitfall in efforts to reduce COPD readmissions.³⁹ We demonstrate that a majority of patients who are readmitted return for diagnoses other than COPD. This finding further highlights that readmission reduction programs need not only focus on COPD control but on the overall management of the patient’s complex medical comorbidities. HRRP penalties are assessed for all-cause readmissions,^31,32 and attention to the entire range of diagnoses leading to return to hospital is important to reduce readmission rates and expenditures. Use of strategies such as multispecialty clinics or integrated practice units may be useful in mitigating risk in multimorbid COPD patients.

Other significant factors that deserve further investigation include the use of postacute care services, including home health and skilled nursing facilities. Both factors were associated with higher likelihood of returning for non-COPD than for COPD-related diagnoses. This finding may be collinear to some degree with comorbidity because complex patients are probably less likely to be discharged home directly. Interestingly, those discharged to a postacute care facility had substantially high odds of readmission for a non-COPD cause. Transitional care programs, including short stays in a nursing home, are often employed to mitigate the risk of adverse outcomes after discharge in sicker patients,⁴⁰ which may be insufficient based on these data.

We applied the HRRP criteria for coding a COPD-related admission to the readmission diagnoses, which is more stringent than using only a principal diagnosis or DRGs, to maintain the same standard for defining the index and readmission event. In the sensitivity analyses, we did not find significant differences in our estimates of comorbidity’s effect on outcomes using a more liberal DRG classification system.

We also used DRGs to classify the readmission causes in order to use the same grouping logic that a payer would use when determining the cause. When evaluating which DRG patients returned for following a COPD exacerbation, pneumonia or other respiratory infections make up 13.8%, which may represent the evolution of respiratory infections that provoked the original exacerbation. Heart failure comprised 9.1% of the non-COPD causes, with about one-third of our COPD cohort having known comorbid heart failure at the time of index admission, illustrating significant overlap between these two conditions. Heart failure and pneumonia are conditions of interest in the HRRP and would potentially garner their own penalties had sufficient time elapsed since a prior hospitalization. Among other causes in the top 20 return DRGs were esophagitis, gastritis, gastrointestinal bleeding, and psychoses, which may be potentially associated with the use of corticosteroids to treat a COPD exacerbation, as described in other population studies.^41,42 Lack of medication regimen data in our analysis precludes further attribution of these causes, but the potential associations are interesting and warrant additional study.

The structure of our data as pooled annual cross sections rather than a true longitudinal cohort limited us to use only 10 months (February to November) of index hospitalizations in order to stay aligned with HRRP policy inclusion criteria. As such, we may have missed some important observations during peak respiratory virus season. As in any administrative data analysis, we are limited to codes in the discharge records, which may not reflect the entire nature of a hospitalization. Administrative data are particularly problematic in identifying true COPD exacerbations, particularly with multiple comorbid cardiopulmonary conditions.^43,44 Validating coding algorithms for identifying COPD was beyond the scope of our evaluation, which purposefully used HRRP methodology. Further study thereof would be a useful endeavor, especially with transition to ICD-10, considering that previously published evaluation was limited to ICD-9.⁴⁴ Despite these limitations, we were left with a robust and representative national cohort, which is an acceptable tradeoff.

Our study highlights the importance of understanding comorbidity as a major determinant of readmissions following COPD exacerbations, particularly in distinguishing which patients will return for COPD versus non-COPD-related diagnoses. At the health system level, readmission programs should be designed with the multimorbid patient in mind. Engagement of care teams, facilitating communication, and shared decision making are strategies to mitigate readmission risk in addition to COPD-focused disease management.³⁹ These data highlight the need to use risk prediction tools in assigning resources to reduce readmissions,⁴⁵ as well as the need to move readmission reduction programs beyond COPD management alone. Developing such systems to prospectively identify which patients are at risk of returning for both COPD and non-COPD reasons may further elucidate readmission mitigation strategies and should be a subject of future prospective study.

Acknowledgments

Data were made available through the Agency for Healthcare Research and Quality’s Healthcare Utilization Project. A full list of partner organizations providing data for the Nationwide Readmission Database can be found at https://www.hcup-us.ahrq.gov/db/hcupdatapartners.jsp.

Prior Presentation

Portions of this work were presented in abstract form at the 2018 American Thoracic Society International Conference (May 2018, San Diego, CA). This manuscript is derived from the doctoral dissertation for the degree of PhD in Health Policy and Management of the corresponding author, conferred in June 2019.

Disclaimer

This article does not necessarily represent the views and policies of the Department of Veterans Affairs or the USPSTF.

Hip fractures are a significant cause of morbidity and mortality among elderly patients. Patients with fragility hip fractures often carry multiple comorbid diagnoses with a significant risk of perioperative complications. After hip fracture, 30-day mortality has been reported as 3.3% to 17.2% with one-year mortality as high as 50%.¹

Multidisciplinary care,^2-5 surgery within 24 hours (h),^6-12 use of regional peripheral nerve blocks,^13-16 restrictive blood transfusion strategies,^17,18 tranexamic acid (TXA) use,¹⁹ pharmacologic deep venous thrombosis (DVT) prophylaxis,²⁰ surgical site infection prevention protocols,²¹ early mobilization,²² and nutritional optimization^23-25 have been individually shown to improve outcomes in hip fracture patients.

Our program sought to define, standardize, and implement evidence-based best practices to improve clinical care and outcomes of patients with hip fractures. We convened a Center for Musculoskeletal Care (CMC) Hip Fracture Oversight Group that included surgeons and advanced practice providers from Orthopedics; physicians from Internal Medicine Hospitalist, Geriatrics, Emergency Medicine, and Anesthesia; and representatives from rehabilitation services, nursing, care management, pharmacy, and performance improvement. With clinical input from all involved services, we developed evidence-based protocols to standardize the care of patients with fragility hip fractures from the time of the patient’s evaluation in the emergency room to discharge and outpatient rehabilitation. The program was operationalized in February 2016.

This project was considered by the Yale University institutional review board (IRB) to be a quality improvement and, therefore, exempted from IRB approval.

Yale-New Haven Hospital is composed of two main campuses. The York Street Campus (YSC) is the Level 1 Trauma Center. The St. Raphael’s Campus (SRC) houses the CMC nursing units for elective lower extremity arthroplasty and spine procedures. Prior to 2016, patients with hip fractures were cared for equally at both Yale-New Haven Hospital campuses. Patients were admitted to both medical and surgical services with no standardization of hip fracture care processes. Surgeons were assigned based on availability. Frequently, patients were added on to the operating room (OR) schedule and did not undergo surgery until off-hours and after a prolonged waiting period.

Medical comanagement of patients with fragility hip fractures at our institution predated the start of our CMC Integrated Fragility Hip Fracture Program (IFHFP). Comanagement was instituted in 2012 at YSC and in 2014 at SRC but without standardized protocols. The IFHFP began in February 2016 with the centralization of all patients with fragility hip fractures to the SRC at Yale-New Haven Hospital. Emergency medical services directed patients with suspected hip fractures to the designated campus. A dedicated hip fracture OR was allocated daily with a hip fracture surgeon assigned by a shared community and faculty surgeon call schedule. Patients were encouraged but not required to accept care from the on-call hip fracture surgical attending. Anesthesia was notified of the arrival of a patient with a hip fracture in the emergency department, and if the patient consented and qualified, a single-shot femoral nerve block was performed. Patients were screened for nasal staphylococcal colonization and treated with povidone-iodine nasal decolonization, chlorhexidine wash, and antibiotics determined by staphylococcal status and type of surgical procedure planned. Preoperative and postoperative order sets were implemented that dictated the care processes as outlined in Table 1. Surgeons determined the choice of operative intervention as per usual; this included internal fixation and partial or total hip replacement. Detailed medical and surgical protocols are included in Appendix A.

There were 275 consecutive patients with hip fractures admitted to SRC in the baseline year (January 1, 2015 to December 31, 2015) and 434 patients with hip fractures admitted in the intervention year (January 1, 2018, to December 31, 2018) after consolidation of the program to the single Yale-New Haven Campus and implementation of standardized care processes. Patient demographic data including age, sex, ethnicity, body mass index, and American Society of Anesthesiologists physical status classification were evaluated for the baseline year and intervention year and reported in Table 2. There were no differences in the demographics of patients between baseline and intervention years.

From baseline year to intervention year, 30-day mortality, transfusion, adverse effects of drugs, length of stay, unexpected return to OR, and time to OR were all significantly reduced. Mortality within 30 days decreased from 8.0% to 2.8%. The results are displayed in Table 3. No significant difference was seen in the incidence of venous thromboembolism, sepsis, myocardial infarctions, readmission at 30 days, or mechanical surgical fixation complications.

Patients with fragility hip fractures are a medically complex and vulnerable population. The goal of the CMC IFHFP was to standardize the care of these high-risk patients in an effort to reduce time to the OR, perioperative medical complications, time spent in the hospital, and ultimately mortality.

The barriers to implementing coordinated, multidisciplinary care are significant. In our case, we had a fragmented care model with fragility hip fracture patients cared for at two campuses, on different nursing units, with both community and faculty surgeons providing operative care, and with no predesignated primary team. We structured our program for equal sharing of call between community and faculty surgeons. However, there was distrust among the physician groups: Primary care physicians were concerned that their referral lines with orthopedic surgical colleagues would be fractured by the new shared call. Surgeons doubted that patients would be distributed equally among community and faculty practices. Hospitalists feared that comanagement would mean surgeons abdicating responsibility for care. Surgeons worried that routine medical involvement would delay surgery and prolong the length of stay with excessive testing. In order to achieve consensus, address concerns, and allay fears, we engaged the primary care and surgeon leadership for their support at the onset of the program and held monthly large group meetings and many smaller sessions to advance objectives. We meticulously tracked data and frequently reported out to the involved groups.

As it is well established that operative intervention on a hip fracture is best completed within 24 h to optimize a patient’s clinical outcomes, critical interventions were the designation of a hip fracture OR starting midday and expectation that surgery be performed the day after admission for medically cleared patients. Surgeons were able to book elective cases or outpatient clinic time in the morning. The morning hours prior to surgery allowed time for any final medical optimization, preoperative nursing care, and family discussions. Most surgeries were then completed by the primary OR staff during standard operating hours. Patients were out of the postanesthesia care unit and settled back on the orthopedic nursing unit in the early evening without a prolonged period of nil per os, bed rest, or sleep interruption.

While our protocol expected surgery the day after admission for medically cleared patients, we used surgery within 24 h as a simple metric to compare baseline with intervention outcomes. With our hip fracture OR block time beginning midday, the majority of our medically cleared hip fracture patients would receive surgical treatment within 24 h of admission. Our data show a significant improvement in timeliness of surgical intervention from 41.8% of patients to the OR within 24 h in 2015 to 55% in 2018. In 2017, we conducted an interval four-month audit involving a detailed chart review of all patients for whom surgery was delayed beyond 24 h from hospital admission. Chart review identified anticoagulation as the primary reason for surgical delay. Of patients who were eligible for surgery (medically stabilized and not therapeutically anticoagulated), 90% underwent surgery within 24 h during this four-month period in 2017. This compares to an overall rate of surgery within 24 h of 57% during the calendar year 2017. We did not perform a subgroup analysis of outcomes in patients with time to OR of 24-36 h. From this study, we are therefore unable to draw any conclusion regarding time to surgery and mortality.

Our dedicated OR hip fracture block time was changed from 7:30 am to 12:30 pm during 2016 per surgeon request (Figure). Patients admitted within the 24-hour time period from 7 am the day prior to 7 am the day of the OR block time undergo surgery in the 12:30 pm time slot. Any patient admitted from 7 am until 12:30 pm is not scheduled until the following day’s OR block time and would hence have a surgical delay of 30 h or more. To better understand the impact of the later OR block time, we included the outcome variable of time to OR of greater than 24 h but less than or equal to 36 h. We demonstrated a significant increase in the proportion of patients going to the OR in 24 h without an increase in patients waiting for 24 to 36 h for their surgery.

Transfusion rate reduction from 46.6% to 28.1% was achieved primarily by the implementation and strict enforcement of a policy to avoid transfusing asymptomatic patients with hemoglobin >7.0 g/dL. In addition, we recommended TXA using standard perioperative arthroplasty dosing of 1 g intravenously (IV) at the time of incision followed by 1 g IV 3 h later in the postanaesthesia care unit. However, adherence to TXA recommendations was poor. A year-long audit (February 2017 to February 2018) demonstrated that only 29% of patients undergoing hip fracture surgery received the recommended TXA. After the conclusion of the study period of this review, we revised our TXA protocol to include an infusion at the time of admission and subsequent perioperative doses. The expanded TXA protocol (with clear exclusion criteria) has been “hard-wired” into our electronic perioperative order sets. We are tracking TXA compliance on a weekly basis. We anticipate that earlier TXA administration and improved compliance will further reduce transfusion rates.

We reduced the adverse effects of medications with two initiatives: First, dedicated hip fracture order sets with medications selected and dosed specifically for the geriatric population were launched at the onset of the IFHFP in 2016. Second, in coordination with our regional anesthesia team, patients who met criteria underwent a single-shot femoral nerve block upon diagnosis of the hip fracture. Patients reported up to 24 h of nonnarcotic pain relief with the femoral nerve block.

Prior to the introduction of the IFHFP, surgeons determined DVT prophylaxis based on their personal preference. Many of our surgeons were concerned that standardizing DVT prophylaxis to enoxaparin would increase the risk of surgical site bleeding, hematoma, infection, and reoperation. With data tracking and periodic reporting, we were able to reassure our surgeons: We demonstrated a reduction in the rate of patients unexpectedly requiring a return to the OR from 5.1% in 2015 to 0% in 2018.

We did not find a significant difference in mechanical complications due to surgical fixation during the index admission. Most mechanical complications do not present within the index admission and, therefore, would not be identified by this metric. Furthermore, in this phase of the program, we did not seek to change or standardize intraoperative surgical processes outside of surgical site infection prevention measures. Surgical technical quality and variation among surgeons is an area of ongoing evaluation within our program. We have begun a surgical quality review process with an expert review of postoperative radiography, beginning with fixation of nondisplaced femoral neck fractures, feedback to surgeons, and tracking of mechanical complications beyond the index admission. The surgical quality outcomes will be presented in a future manuscript.

Anticoagulation use is common in patients with hip fractures because of the high prevalence of comorbid conditions such as atrial fibrillation and venous thromboembolic disease. Direct oral anticoagulants (DOACs) are now commonly used in place of the vitamin K antagonist, warfarin. Our inability to efficiently reverse the DOACs compounded by surgeon unfamiliarity with these agents led to extreme caution in the timing of OR, with most patients delayed a full 48 h from the last dose of their prescribed DOAC. After recognizing the impact of anticoagulation on the timing of surgery, we convened a multidisciplinary group to determine rational guidelines for the timing of surgery in patients on chronic anticoagulation based on the bleeding risk of the planned operative procedure. These guidelines were instituted in December 2018, so their impact is not reflected in this review.

Our results showing a reduction in length of stay and mortality cannot be explained by any one intervention. We propose that the standardization of all processes and protocols, the establishment of clear expectations among all the medical and nursing personnel, and the shorter time spent waiting for surgery all contributed to the length of stay reduction. Likewise, the decrease in time to OR, reduction in time spent in the hospital, fewer transfusions, adverse effects of medication, and surgical complications requiring a return to the OR have all likely contributed to the significant reduction in mortality. The efforts of the orthopedic nursing team certainly contributed: The CMC nurses led the efforts to standardize surgical site infection bundle care, reduce indwelling bladder catheter use, and together with physical therapy, mobilize patients out of bed for meals postoperatively. The strong focus on teamwork, data tracking, feedback and accountability, and the desire for continued improvement may have been the strongest drivers in this program’s success.

Our results showed a nonsignificant increase in 30-day readmission from 9.1% to 12.5%. One limitation of this study is that we did not track specific readmission diagnoses to better understand trends in diagnoses or indications for hospital readmission. Going forward, we are reviewing readmissions to better understand opportunities to improve our inpatient processes and transitions of care.

This an evolving project. We have expanded our use of TXA in an effort to further reduce transfusion rates. We have adjusted our protocols for patients admitted on DOACs and warfarin to allow more rapid surgical intervention. We have initiated a surgical quality review process in which surgical fixation is reviewed with timely feedback to the operating surgeon. We are working closely with the skilled nursing facilities to extend our rehabilitation and nursing care protocols beyond the acute care setting. We are measuring patient engagement with a brief discharge survey specific to the CMC IFHFP. We continue to seek feedback from our referring primary care physicians to improve communication at times of care transition.

One of the limitations of a quality improvement project such as this one is the inability to identify the effect of each individual intervention. We can conclude that the totality of the multidisciplinary project reduced mortality in our hip fracture population, but we cannot report the relative effect of each process change. Another center seeking to replicate this success cannot determine from this research how to prioritize their resources to achieve a similar outcome.

How we care for the fragility hip fracture patient after hospital discharge is critical and unaddressed in this current study. A limitation of our current program is the lack of consistent postdischarge bone health management—which we are working to address. Also related to postdischarge management, we have partnered with a network of preferred skilled nursing facilities to standardize the care and decrease the length of stay. These data will be published separately.

We understand that our experience at the CMC is unique and specific to our care environment. This is a single site study and may not be generalizable to other centers. Nonetheless, the principles of multidisciplinary care, evidence-based protocol development, technological integration of protocols through order sets, and data tracking with feedback and accountability are the essential elements of our success that can be generalized to other institutions.

The CMC at Yale School of Medicine and Yale-New Haven Hospital IFHFP provides a model for implementing well-documented evidence-based interventions to standardize the care of patients with fragility hip fractures. The IFHFP yielded reduced mortality, length of stay, blood transfusion utilization, adverse effects of medications, unexpected return to the OR, and time to the OR.

Acknowledgments

The authors thank the work of the Center for Musculoskeletal Care Hip Fracture Oversight Group, program surgeons, and community primary care leaders: Olukemi Akande, MD, Mark Altman, MD, Diren Arsoy, MD, John Aversa, MD, Michael Connair, MD, Leo Cooney, MD, Kenneth Donohue, MD, David Gibson, MD, Gail Haesche, RN, MS, ACM-RN, Carol Just, MSN, NEA-BC, RN, Patricia Kenyon, RN, ACM, Francis Lee MD, Michael Leslie, MD, Michael Lucchini, MD, Christopher Lynch, MD, Rowland Mayor, MD, Tara Messina, PT, Lorraine Novella, RN, Paul Oliver, PA-C, Vivek Parwani, MD, Joseph Quaranta, MD, Lee Rubin, MD, Derek Shia, MD, Jeff Sumner, MD, John Tarutis, Arya Varthi, MD, Anuruddha Walaliyadda, MD, Daniel Wiznia, MD, Shirvinda Wijesekera, MD, Joseph Wu, MD, Brad Yoo, MD, and James Yue, MD.

Hip fractures are a significant cause of morbidity and mortality among elderly patients. Patients with fragility hip fractures often carry multiple comorbid diagnoses with a significant risk of perioperative complications. After hip fracture, 30-day mortality has been reported as 3.3% to 17.2% with one-year mortality as high as 50%.¹

Multidisciplinary care,^2-5 surgery within 24 hours (h),^6-12 use of regional peripheral nerve blocks,^13-16 restrictive blood transfusion strategies,^17,18 tranexamic acid (TXA) use,¹⁹ pharmacologic deep venous thrombosis (DVT) prophylaxis,²⁰ surgical site infection prevention protocols,²¹ early mobilization,²² and nutritional optimization^23-25 have been individually shown to improve outcomes in hip fracture patients.

Our program sought to define, standardize, and implement evidence-based best practices to improve clinical care and outcomes of patients with hip fractures. We convened a Center for Musculoskeletal Care (CMC) Hip Fracture Oversight Group that included surgeons and advanced practice providers from Orthopedics; physicians from Internal Medicine Hospitalist, Geriatrics, Emergency Medicine, and Anesthesia; and representatives from rehabilitation services, nursing, care management, pharmacy, and performance improvement. With clinical input from all involved services, we developed evidence-based protocols to standardize the care of patients with fragility hip fractures from the time of the patient’s evaluation in the emergency room to discharge and outpatient rehabilitation. The program was operationalized in February 2016.

This project was considered by the Yale University institutional review board (IRB) to be a quality improvement and, therefore, exempted from IRB approval.

Yale-New Haven Hospital is composed of two main campuses. The York Street Campus (YSC) is the Level 1 Trauma Center. The St. Raphael’s Campus (SRC) houses the CMC nursing units for elective lower extremity arthroplasty and spine procedures. Prior to 2016, patients with hip fractures were cared for equally at both Yale-New Haven Hospital campuses. Patients were admitted to both medical and surgical services with no standardization of hip fracture care processes. Surgeons were assigned based on availability. Frequently, patients were added on to the operating room (OR) schedule and did not undergo surgery until off-hours and after a prolonged waiting period.

Medical comanagement of patients with fragility hip fractures at our institution predated the start of our CMC Integrated Fragility Hip Fracture Program (IFHFP). Comanagement was instituted in 2012 at YSC and in 2014 at SRC but without standardized protocols. The IFHFP began in February 2016 with the centralization of all patients with fragility hip fractures to the SRC at Yale-New Haven Hospital. Emergency medical services directed patients with suspected hip fractures to the designated campus. A dedicated hip fracture OR was allocated daily with a hip fracture surgeon assigned by a shared community and faculty surgeon call schedule. Patients were encouraged but not required to accept care from the on-call hip fracture surgical attending. Anesthesia was notified of the arrival of a patient with a hip fracture in the emergency department, and if the patient consented and qualified, a single-shot femoral nerve block was performed. Patients were screened for nasal staphylococcal colonization and treated with povidone-iodine nasal decolonization, chlorhexidine wash, and antibiotics determined by staphylococcal status and type of surgical procedure planned. Preoperative and postoperative order sets were implemented that dictated the care processes as outlined in Table 1. Surgeons determined the choice of operative intervention as per usual; this included internal fixation and partial or total hip replacement. Detailed medical and surgical protocols are included in Appendix A.

There were 275 consecutive patients with hip fractures admitted to SRC in the baseline year (January 1, 2015 to December 31, 2015) and 434 patients with hip fractures admitted in the intervention year (January 1, 2018, to December 31, 2018) after consolidation of the program to the single Yale-New Haven Campus and implementation of standardized care processes. Patient demographic data including age, sex, ethnicity, body mass index, and American Society of Anesthesiologists physical status classification were evaluated for the baseline year and intervention year and reported in Table 2. There were no differences in the demographics of patients between baseline and intervention years.

From baseline year to intervention year, 30-day mortality, transfusion, adverse effects of drugs, length of stay, unexpected return to OR, and time to OR were all significantly reduced. Mortality within 30 days decreased from 8.0% to 2.8%. The results are displayed in Table 3. No significant difference was seen in the incidence of venous thromboembolism, sepsis, myocardial infarctions, readmission at 30 days, or mechanical surgical fixation complications.

Patients with fragility hip fractures are a medically complex and vulnerable population. The goal of the CMC IFHFP was to standardize the care of these high-risk patients in an effort to reduce time to the OR, perioperative medical complications, time spent in the hospital, and ultimately mortality.

The barriers to implementing coordinated, multidisciplinary care are significant. In our case, we had a fragmented care model with fragility hip fracture patients cared for at two campuses, on different nursing units, with both community and faculty surgeons providing operative care, and with no predesignated primary team. We structured our program for equal sharing of call between community and faculty surgeons. However, there was distrust among the physician groups: Primary care physicians were concerned that their referral lines with orthopedic surgical colleagues would be fractured by the new shared call. Surgeons doubted that patients would be distributed equally among community and faculty practices. Hospitalists feared that comanagement would mean surgeons abdicating responsibility for care. Surgeons worried that routine medical involvement would delay surgery and prolong the length of stay with excessive testing. In order to achieve consensus, address concerns, and allay fears, we engaged the primary care and surgeon leadership for their support at the onset of the program and held monthly large group meetings and many smaller sessions to advance objectives. We meticulously tracked data and frequently reported out to the involved groups.

As it is well established that operative intervention on a hip fracture is best completed within 24 h to optimize a patient’s clinical outcomes, critical interventions were the designation of a hip fracture OR starting midday and expectation that surgery be performed the day after admission for medically cleared patients. Surgeons were able to book elective cases or outpatient clinic time in the morning. The morning hours prior to surgery allowed time for any final medical optimization, preoperative nursing care, and family discussions. Most surgeries were then completed by the primary OR staff during standard operating hours. Patients were out of the postanesthesia care unit and settled back on the orthopedic nursing unit in the early evening without a prolonged period of nil per os, bed rest, or sleep interruption.

While our protocol expected surgery the day after admission for medically cleared patients, we used surgery within 24 h as a simple metric to compare baseline with intervention outcomes. With our hip fracture OR block time beginning midday, the majority of our medically cleared hip fracture patients would receive surgical treatment within 24 h of admission. Our data show a significant improvement in timeliness of surgical intervention from 41.8% of patients to the OR within 24 h in 2015 to 55% in 2018. In 2017, we conducted an interval four-month audit involving a detailed chart review of all patients for whom surgery was delayed beyond 24 h from hospital admission. Chart review identified anticoagulation as the primary reason for surgical delay. Of patients who were eligible for surgery (medically stabilized and not therapeutically anticoagulated), 90% underwent surgery within 24 h during this four-month period in 2017. This compares to an overall rate of surgery within 24 h of 57% during the calendar year 2017. We did not perform a subgroup analysis of outcomes in patients with time to OR of 24-36 h. From this study, we are therefore unable to draw any conclusion regarding time to surgery and mortality.

Our dedicated OR hip fracture block time was changed from 7:30 am to 12:30 pm during 2016 per surgeon request (Figure). Patients admitted within the 24-hour time period from 7 am the day prior to 7 am the day of the OR block time undergo surgery in the 12:30 pm time slot. Any patient admitted from 7 am until 12:30 pm is not scheduled until the following day’s OR block time and would hence have a surgical delay of 30 h or more. To better understand the impact of the later OR block time, we included the outcome variable of time to OR of greater than 24 h but less than or equal to 36 h. We demonstrated a significant increase in the proportion of patients going to the OR in 24 h without an increase in patients waiting for 24 to 36 h for their surgery.

Transfusion rate reduction from 46.6% to 28.1% was achieved primarily by the implementation and strict enforcement of a policy to avoid transfusing asymptomatic patients with hemoglobin >7.0 g/dL. In addition, we recommended TXA using standard perioperative arthroplasty dosing of 1 g intravenously (IV) at the time of incision followed by 1 g IV 3 h later in the postanaesthesia care unit. However, adherence to TXA recommendations was poor. A year-long audit (February 2017 to February 2018) demonstrated that only 29% of patients undergoing hip fracture surgery received the recommended TXA. After the conclusion of the study period of this review, we revised our TXA protocol to include an infusion at the time of admission and subsequent perioperative doses. The expanded TXA protocol (with clear exclusion criteria) has been “hard-wired” into our electronic perioperative order sets. We are tracking TXA compliance on a weekly basis. We anticipate that earlier TXA administration and improved compliance will further reduce transfusion rates.

We reduced the adverse effects of medications with two initiatives: First, dedicated hip fracture order sets with medications selected and dosed specifically for the geriatric population were launched at the onset of the IFHFP in 2016. Second, in coordination with our regional anesthesia team, patients who met criteria underwent a single-shot femoral nerve block upon diagnosis of the hip fracture. Patients reported up to 24 h of nonnarcotic pain relief with the femoral nerve block.

Prior to the introduction of the IFHFP, surgeons determined DVT prophylaxis based on their personal preference. Many of our surgeons were concerned that standardizing DVT prophylaxis to enoxaparin would increase the risk of surgical site bleeding, hematoma, infection, and reoperation. With data tracking and periodic reporting, we were able to reassure our surgeons: We demonstrated a reduction in the rate of patients unexpectedly requiring a return to the OR from 5.1% in 2015 to 0% in 2018.

We did not find a significant difference in mechanical complications due to surgical fixation during the index admission. Most mechanical complications do not present within the index admission and, therefore, would not be identified by this metric. Furthermore, in this phase of the program, we did not seek to change or standardize intraoperative surgical processes outside of surgical site infection prevention measures. Surgical technical quality and variation among surgeons is an area of ongoing evaluation within our program. We have begun a surgical quality review process with an expert review of postoperative radiography, beginning with fixation of nondisplaced femoral neck fractures, feedback to surgeons, and tracking of mechanical complications beyond the index admission. The surgical quality outcomes will be presented in a future manuscript.

Anticoagulation use is common in patients with hip fractures because of the high prevalence of comorbid conditions such as atrial fibrillation and venous thromboembolic disease. Direct oral anticoagulants (DOACs) are now commonly used in place of the vitamin K antagonist, warfarin. Our inability to efficiently reverse the DOACs compounded by surgeon unfamiliarity with these agents led to extreme caution in the timing of OR, with most patients delayed a full 48 h from the last dose of their prescribed DOAC. After recognizing the impact of anticoagulation on the timing of surgery, we convened a multidisciplinary group to determine rational guidelines for the timing of surgery in patients on chronic anticoagulation based on the bleeding risk of the planned operative procedure. These guidelines were instituted in December 2018, so their impact is not reflected in this review.

Our results showing a reduction in length of stay and mortality cannot be explained by any one intervention. We propose that the standardization of all processes and protocols, the establishment of clear expectations among all the medical and nursing personnel, and the shorter time spent waiting for surgery all contributed to the length of stay reduction. Likewise, the decrease in time to OR, reduction in time spent in the hospital, fewer transfusions, adverse effects of medication, and surgical complications requiring a return to the OR have all likely contributed to the significant reduction in mortality. The efforts of the orthopedic nursing team certainly contributed: The CMC nurses led the efforts to standardize surgical site infection bundle care, reduce indwelling bladder catheter use, and together with physical therapy, mobilize patients out of bed for meals postoperatively. The strong focus on teamwork, data tracking, feedback and accountability, and the desire for continued improvement may have been the strongest drivers in this program’s success.

Our results showed a nonsignificant increase in 30-day readmission from 9.1% to 12.5%. One limitation of this study is that we did not track specific readmission diagnoses to better understand trends in diagnoses or indications for hospital readmission. Going forward, we are reviewing readmissions to better understand opportunities to improve our inpatient processes and transitions of care.

This an evolving project. We have expanded our use of TXA in an effort to further reduce transfusion rates. We have adjusted our protocols for patients admitted on DOACs and warfarin to allow more rapid surgical intervention. We have initiated a surgical quality review process in which surgical fixation is reviewed with timely feedback to the operating surgeon. We are working closely with the skilled nursing facilities to extend our rehabilitation and nursing care protocols beyond the acute care setting. We are measuring patient engagement with a brief discharge survey specific to the CMC IFHFP. We continue to seek feedback from our referring primary care physicians to improve communication at times of care transition.

One of the limitations of a quality improvement project such as this one is the inability to identify the effect of each individual intervention. We can conclude that the totality of the multidisciplinary project reduced mortality in our hip fracture population, but we cannot report the relative effect of each process change. Another center seeking to replicate this success cannot determine from this research how to prioritize their resources to achieve a similar outcome.

How we care for the fragility hip fracture patient after hospital discharge is critical and unaddressed in this current study. A limitation of our current program is the lack of consistent postdischarge bone health management—which we are working to address. Also related to postdischarge management, we have partnered with a network of preferred skilled nursing facilities to standardize the care and decrease the length of stay. These data will be published separately.

We understand that our experience at the CMC is unique and specific to our care environment. This is a single site study and may not be generalizable to other centers. Nonetheless, the principles of multidisciplinary care, evidence-based protocol development, technological integration of protocols through order sets, and data tracking with feedback and accountability are the essential elements of our success that can be generalized to other institutions.

The CMC at Yale School of Medicine and Yale-New Haven Hospital IFHFP provides a model for implementing well-documented evidence-based interventions to standardize the care of patients with fragility hip fractures. The IFHFP yielded reduced mortality, length of stay, blood transfusion utilization, adverse effects of medications, unexpected return to the OR, and time to the OR.

Acknowledgments

The authors thank the work of the Center for Musculoskeletal Care Hip Fracture Oversight Group, program surgeons, and community primary care leaders: Olukemi Akande, MD, Mark Altman, MD, Diren Arsoy, MD, John Aversa, MD, Michael Connair, MD, Leo Cooney, MD, Kenneth Donohue, MD, David Gibson, MD, Gail Haesche, RN, MS, ACM-RN, Carol Just, MSN, NEA-BC, RN, Patricia Kenyon, RN, ACM, Francis Lee MD, Michael Leslie, MD, Michael Lucchini, MD, Christopher Lynch, MD, Rowland Mayor, MD, Tara Messina, PT, Lorraine Novella, RN, Paul Oliver, PA-C, Vivek Parwani, MD, Joseph Quaranta, MD, Lee Rubin, MD, Derek Shia, MD, Jeff Sumner, MD, John Tarutis, Arya Varthi, MD, Anuruddha Walaliyadda, MD, Daniel Wiznia, MD, Shirvinda Wijesekera, MD, Joseph Wu, MD, Brad Yoo, MD, and James Yue, MD.

Hip fractures are a significant cause of morbidity and mortality among elderly patients. Patients with fragility hip fractures often carry multiple comorbid diagnoses with a significant risk of perioperative complications. After hip fracture, 30-day mortality has been reported as 3.3% to 17.2% with one-year mortality as high as 50%.¹

Multidisciplinary care,^2-5 surgery within 24 hours (h),^6-12 use of regional peripheral nerve blocks,^13-16 restrictive blood transfusion strategies,^17,18 tranexamic acid (TXA) use,¹⁹ pharmacologic deep venous thrombosis (DVT) prophylaxis,²⁰ surgical site infection prevention protocols,²¹ early mobilization,²² and nutritional optimization^23-25 have been individually shown to improve outcomes in hip fracture patients.

Our program sought to define, standardize, and implement evidence-based best practices to improve clinical care and outcomes of patients with hip fractures. We convened a Center for Musculoskeletal Care (CMC) Hip Fracture Oversight Group that included surgeons and advanced practice providers from Orthopedics; physicians from Internal Medicine Hospitalist, Geriatrics, Emergency Medicine, and Anesthesia; and representatives from rehabilitation services, nursing, care management, pharmacy, and performance improvement. With clinical input from all involved services, we developed evidence-based protocols to standardize the care of patients with fragility hip fractures from the time of the patient’s evaluation in the emergency room to discharge and outpatient rehabilitation. The program was operationalized in February 2016.

This project was considered by the Yale University institutional review board (IRB) to be a quality improvement and, therefore, exempted from IRB approval.

Yale-New Haven Hospital is composed of two main campuses. The York Street Campus (YSC) is the Level 1 Trauma Center. The St. Raphael’s Campus (SRC) houses the CMC nursing units for elective lower extremity arthroplasty and spine procedures. Prior to 2016, patients with hip fractures were cared for equally at both Yale-New Haven Hospital campuses. Patients were admitted to both medical and surgical services with no standardization of hip fracture care processes. Surgeons were assigned based on availability. Frequently, patients were added on to the operating room (OR) schedule and did not undergo surgery until off-hours and after a prolonged waiting period.

Medical comanagement of patients with fragility hip fractures at our institution predated the start of our CMC Integrated Fragility Hip Fracture Program (IFHFP). Comanagement was instituted in 2012 at YSC and in 2014 at SRC but without standardized protocols. The IFHFP began in February 2016 with the centralization of all patients with fragility hip fractures to the SRC at Yale-New Haven Hospital. Emergency medical services directed patients with suspected hip fractures to the designated campus. A dedicated hip fracture OR was allocated daily with a hip fracture surgeon assigned by a shared community and faculty surgeon call schedule. Patients were encouraged but not required to accept care from the on-call hip fracture surgical attending. Anesthesia was notified of the arrival of a patient with a hip fracture in the emergency department, and if the patient consented and qualified, a single-shot femoral nerve block was performed. Patients were screened for nasal staphylococcal colonization and treated with povidone-iodine nasal decolonization, chlorhexidine wash, and antibiotics determined by staphylococcal status and type of surgical procedure planned. Preoperative and postoperative order sets were implemented that dictated the care processes as outlined in Table 1. Surgeons determined the choice of operative intervention as per usual; this included internal fixation and partial or total hip replacement. Detailed medical and surgical protocols are included in Appendix A.

There were 275 consecutive patients with hip fractures admitted to SRC in the baseline year (January 1, 2015 to December 31, 2015) and 434 patients with hip fractures admitted in the intervention year (January 1, 2018, to December 31, 2018) after consolidation of the program to the single Yale-New Haven Campus and implementation of standardized care processes. Patient demographic data including age, sex, ethnicity, body mass index, and American Society of Anesthesiologists physical status classification were evaluated for the baseline year and intervention year and reported in Table 2. There were no differences in the demographics of patients between baseline and intervention years.

From baseline year to intervention year, 30-day mortality, transfusion, adverse effects of drugs, length of stay, unexpected return to OR, and time to OR were all significantly reduced. Mortality within 30 days decreased from 8.0% to 2.8%. The results are displayed in Table 3. No significant difference was seen in the incidence of venous thromboembolism, sepsis, myocardial infarctions, readmission at 30 days, or mechanical surgical fixation complications.

Patients with fragility hip fractures are a medically complex and vulnerable population. The goal of the CMC IFHFP was to standardize the care of these high-risk patients in an effort to reduce time to the OR, perioperative medical complications, time spent in the hospital, and ultimately mortality.

The barriers to implementing coordinated, multidisciplinary care are significant. In our case, we had a fragmented care model with fragility hip fracture patients cared for at two campuses, on different nursing units, with both community and faculty surgeons providing operative care, and with no predesignated primary team. We structured our program for equal sharing of call between community and faculty surgeons. However, there was distrust among the physician groups: Primary care physicians were concerned that their referral lines with orthopedic surgical colleagues would be fractured by the new shared call. Surgeons doubted that patients would be distributed equally among community and faculty practices. Hospitalists feared that comanagement would mean surgeons abdicating responsibility for care. Surgeons worried that routine medical involvement would delay surgery and prolong the length of stay with excessive testing. In order to achieve consensus, address concerns, and allay fears, we engaged the primary care and surgeon leadership for their support at the onset of the program and held monthly large group meetings and many smaller sessions to advance objectives. We meticulously tracked data and frequently reported out to the involved groups.

As it is well established that operative intervention on a hip fracture is best completed within 24 h to optimize a patient’s clinical outcomes, critical interventions were the designation of a hip fracture OR starting midday and expectation that surgery be performed the day after admission for medically cleared patients. Surgeons were able to book elective cases or outpatient clinic time in the morning. The morning hours prior to surgery allowed time for any final medical optimization, preoperative nursing care, and family discussions. Most surgeries were then completed by the primary OR staff during standard operating hours. Patients were out of the postanesthesia care unit and settled back on the orthopedic nursing unit in the early evening without a prolonged period of nil per os, bed rest, or sleep interruption.

While our protocol expected surgery the day after admission for medically cleared patients, we used surgery within 24 h as a simple metric to compare baseline with intervention outcomes. With our hip fracture OR block time beginning midday, the majority of our medically cleared hip fracture patients would receive surgical treatment within 24 h of admission. Our data show a significant improvement in timeliness of surgical intervention from 41.8% of patients to the OR within 24 h in 2015 to 55% in 2018. In 2017, we conducted an interval four-month audit involving a detailed chart review of all patients for whom surgery was delayed beyond 24 h from hospital admission. Chart review identified anticoagulation as the primary reason for surgical delay. Of patients who were eligible for surgery (medically stabilized and not therapeutically anticoagulated), 90% underwent surgery within 24 h during this four-month period in 2017. This compares to an overall rate of surgery within 24 h of 57% during the calendar year 2017. We did not perform a subgroup analysis of outcomes in patients with time to OR of 24-36 h. From this study, we are therefore unable to draw any conclusion regarding time to surgery and mortality.

Our dedicated OR hip fracture block time was changed from 7:30 am to 12:30 pm during 2016 per surgeon request (Figure). Patients admitted within the 24-hour time period from 7 am the day prior to 7 am the day of the OR block time undergo surgery in the 12:30 pm time slot. Any patient admitted from 7 am until 12:30 pm is not scheduled until the following day’s OR block time and would hence have a surgical delay of 30 h or more. To better understand the impact of the later OR block time, we included the outcome variable of time to OR of greater than 24 h but less than or equal to 36 h. We demonstrated a significant increase in the proportion of patients going to the OR in 24 h without an increase in patients waiting for 24 to 36 h for their surgery.

Transfusion rate reduction from 46.6% to 28.1% was achieved primarily by the implementation and strict enforcement of a policy to avoid transfusing asymptomatic patients with hemoglobin >7.0 g/dL. In addition, we recommended TXA using standard perioperative arthroplasty dosing of 1 g intravenously (IV) at the time of incision followed by 1 g IV 3 h later in the postanaesthesia care unit. However, adherence to TXA recommendations was poor. A year-long audit (February 2017 to February 2018) demonstrated that only 29% of patients undergoing hip fracture surgery received the recommended TXA. After the conclusion of the study period of this review, we revised our TXA protocol to include an infusion at the time of admission and subsequent perioperative doses. The expanded TXA protocol (with clear exclusion criteria) has been “hard-wired” into our electronic perioperative order sets. We are tracking TXA compliance on a weekly basis. We anticipate that earlier TXA administration and improved compliance will further reduce transfusion rates.

We reduced the adverse effects of medications with two initiatives: First, dedicated hip fracture order sets with medications selected and dosed specifically for the geriatric population were launched at the onset of the IFHFP in 2016. Second, in coordination with our regional anesthesia team, patients who met criteria underwent a single-shot femoral nerve block upon diagnosis of the hip fracture. Patients reported up to 24 h of nonnarcotic pain relief with the femoral nerve block.

Prior to the introduction of the IFHFP, surgeons determined DVT prophylaxis based on their personal preference. Many of our surgeons were concerned that standardizing DVT prophylaxis to enoxaparin would increase the risk of surgical site bleeding, hematoma, infection, and reoperation. With data tracking and periodic reporting, we were able to reassure our surgeons: We demonstrated a reduction in the rate of patients unexpectedly requiring a return to the OR from 5.1% in 2015 to 0% in 2018.

We did not find a significant difference in mechanical complications due to surgical fixation during the index admission. Most mechanical complications do not present within the index admission and, therefore, would not be identified by this metric. Furthermore, in this phase of the program, we did not seek to change or standardize intraoperative surgical processes outside of surgical site infection prevention measures. Surgical technical quality and variation among surgeons is an area of ongoing evaluation within our program. We have begun a surgical quality review process with an expert review of postoperative radiography, beginning with fixation of nondisplaced femoral neck fractures, feedback to surgeons, and tracking of mechanical complications beyond the index admission. The surgical quality outcomes will be presented in a future manuscript.

Anticoagulation use is common in patients with hip fractures because of the high prevalence of comorbid conditions such as atrial fibrillation and venous thromboembolic disease. Direct oral anticoagulants (DOACs) are now commonly used in place of the vitamin K antagonist, warfarin. Our inability to efficiently reverse the DOACs compounded by surgeon unfamiliarity with these agents led to extreme caution in the timing of OR, with most patients delayed a full 48 h from the last dose of their prescribed DOAC. After recognizing the impact of anticoagulation on the timing of surgery, we convened a multidisciplinary group to determine rational guidelines for the timing of surgery in patients on chronic anticoagulation based on the bleeding risk of the planned operative procedure. These guidelines were instituted in December 2018, so their impact is not reflected in this review.

Our results showing a reduction in length of stay and mortality cannot be explained by any one intervention. We propose that the standardization of all processes and protocols, the establishment of clear expectations among all the medical and nursing personnel, and the shorter time spent waiting for surgery all contributed to the length of stay reduction. Likewise, the decrease in time to OR, reduction in time spent in the hospital, fewer transfusions, adverse effects of medication, and surgical complications requiring a return to the OR have all likely contributed to the significant reduction in mortality. The efforts of the orthopedic nursing team certainly contributed: The CMC nurses led the efforts to standardize surgical site infection bundle care, reduce indwelling bladder catheter use, and together with physical therapy, mobilize patients out of bed for meals postoperatively. The strong focus on teamwork, data tracking, feedback and accountability, and the desire for continued improvement may have been the strongest drivers in this program’s success.

Our results showed a nonsignificant increase in 30-day readmission from 9.1% to 12.5%. One limitation of this study is that we did not track specific readmission diagnoses to better understand trends in diagnoses or indications for hospital readmission. Going forward, we are reviewing readmissions to better understand opportunities to improve our inpatient processes and transitions of care.

This an evolving project. We have expanded our use of TXA in an effort to further reduce transfusion rates. We have adjusted our protocols for patients admitted on DOACs and warfarin to allow more rapid surgical intervention. We have initiated a surgical quality review process in which surgical fixation is reviewed with timely feedback to the operating surgeon. We are working closely with the skilled nursing facilities to extend our rehabilitation and nursing care protocols beyond the acute care setting. We are measuring patient engagement with a brief discharge survey specific to the CMC IFHFP. We continue to seek feedback from our referring primary care physicians to improve communication at times of care transition.

One of the limitations of a quality improvement project such as this one is the inability to identify the effect of each individual intervention. We can conclude that the totality of the multidisciplinary project reduced mortality in our hip fracture population, but we cannot report the relative effect of each process change. Another center seeking to replicate this success cannot determine from this research how to prioritize their resources to achieve a similar outcome.

How we care for the fragility hip fracture patient after hospital discharge is critical and unaddressed in this current study. A limitation of our current program is the lack of consistent postdischarge bone health management—which we are working to address. Also related to postdischarge management, we have partnered with a network of preferred skilled nursing facilities to standardize the care and decrease the length of stay. These data will be published separately.

We understand that our experience at the CMC is unique and specific to our care environment. This is a single site study and may not be generalizable to other centers. Nonetheless, the principles of multidisciplinary care, evidence-based protocol development, technological integration of protocols through order sets, and data tracking with feedback and accountability are the essential elements of our success that can be generalized to other institutions.

The CMC at Yale School of Medicine and Yale-New Haven Hospital IFHFP provides a model for implementing well-documented evidence-based interventions to standardize the care of patients with fragility hip fractures. The IFHFP yielded reduced mortality, length of stay, blood transfusion utilization, adverse effects of medications, unexpected return to the OR, and time to the OR.

Acknowledgments

The authors thank the work of the Center for Musculoskeletal Care Hip Fracture Oversight Group, program surgeons, and community primary care leaders: Olukemi Akande, MD, Mark Altman, MD, Diren Arsoy, MD, John Aversa, MD, Michael Connair, MD, Leo Cooney, MD, Kenneth Donohue, MD, David Gibson, MD, Gail Haesche, RN, MS, ACM-RN, Carol Just, MSN, NEA-BC, RN, Patricia Kenyon, RN, ACM, Francis Lee MD, Michael Leslie, MD, Michael Lucchini, MD, Christopher Lynch, MD, Rowland Mayor, MD, Tara Messina, PT, Lorraine Novella, RN, Paul Oliver, PA-C, Vivek Parwani, MD, Joseph Quaranta, MD, Lee Rubin, MD, Derek Shia, MD, Jeff Sumner, MD, John Tarutis, Arya Varthi, MD, Anuruddha Walaliyadda, MD, Daniel Wiznia, MD, Shirvinda Wijesekera, MD, Joseph Wu, MD, Brad Yoo, MD, and James Yue, MD.

Examining disparities in health-related quality of life (HRQoL) outcomes in children provides a unique patient-centered perspective on pediatric health services equity.^1,2 Prior studies have demonstrated the relationship between minority race, low socioeconomic status, and lower maternal education with poorer HRQoL outcomes in children.^3-6 Some studies have also shown a dose-response relationship between social disadvantage markers and poorer child health status.^7,8 Furthermore, the associations between social disadvantage and poor access to care,^9-11 and between poor access to care and lower HRQoL, are also well established.^12-14

Examining HRQoL before and after hospitalization can further our understanding of how disparities in HRQoL may change once children engage with the medical system for an acute illness.¹⁵ Children requiring hospitalization constitute a useful population for examination of this question as they represent a group of children with variable social disadvantage markers and access to outpatient care.¹⁶ Although interventions to address social determinants of health for patients with social disadvantages have been associated with within-group improvements in HRQoL, none have assessed changes in disparities as an outcome.¹⁷ Furthermore, many of these studies were conducted in the outpatient setting,^18,19 whereas hospitalization provides an additional point of care to address the social determinants of health for vulnerable families.²⁰ Even for short hospitalizations, the 24/7 nature of hospital care provides the opportunity for frequent interactions with clinicians, nurses, and support staff to clarify illness-related questions, discuss other health concerns and unmet needs, and connect with social services or community resources. These opportunities may be particularly important for families with a higher number of social disadvantage markers and even more beneficial to those with difficulty accessing needed care from their primary medical home.

In this study, we focused on children with common respiratory illnesses (asthma, bronchiolitis, and pneumonia), which constitute the majority of childhood hospitalizations.²¹ Additionally, we only focused on the child’s physical functioning component of HRQoL because this component is most likely to improve after hospitalization for children with an acute respiratory illness.²² A prior study examining HRQoL before and after hospitalization demonstrated that most children return to and/or surpass their baseline physical functioning by 1 month after hospital discharge.²³

Our primary objective was to examine associations between several markers of social disadvantage, access to care, and child physical functioning before and after hospitalization for acute respiratory illness. Second, we aimed to understand if access to care (defined as perceived difficulty/delays getting care) acts as an independent predictor of improvement in physical functioning from baseline to follow-up and/or if it modifies the relationship between social disadvantage and improvement in physical functioning (Appendix Figure).

Study Design and Population

This study was nested within a multicenter, prospective cohort study of children who were hospitalized for asthma, bronchiolitis, or pneumonia between July 2014 and June 2016 at one of five children’s hospitals in the Pediatric Research in Inpatient Settings Network.²⁴

We approached families for study participation within 72 hours of admission to the hospital using a standard protocol. Patients and their caregivers were eligible to participate in the study if the patient was 2 weeks to 16 years old and if the primary caregiver’s preferred language for medical communication was either English or Spanish. Patients with chronic medical conditions (except asthma), with moderate to severe developmental delay, with a history of prematurity <32 weeks, or who received care in the intensive care unit were excluded. Patients could only participate in the study once.

The study team set out to enroll an even number of patients across all three conditions. If a patient’s discharge diagnosis differed from their admission diagnosis (eg, from bronchiolitis to pneumonia), discharge diagnosis was used for condition group assignment. If the discharge diagnosis was not one of these three respiratory conditions, we excluded the patient from further analysis.

Data Collection

We collected data using two surveys. The first survey was administered within 72 hours of admission. This survey asked questions related to (1) caregiver-reported markers of social disadvantage, (2) caregiver perceptions of access to care, and (3) caregiver- and patient-reported assessments of physical functioning. The second survey was administered within 2 to 8 weeks after the patient’s discharge and included a second assessment of physical functioning.

Social Disadvantage

Patients were considered to have a marker of social disadvantage if their caregiver reported (1) being of non-White race and/or Hispanic ethnicity, (2) primarily speaking a language other than English at home and not speaking English very well (ie, limited English proficiency), (3) attaining at most a high school or equivalent degree, or (4) having a =/<$30,000 annual household income.

Access to Care

We used the following survey item from the 2009-2010 National Survey of Children with Special Health Care Needs²⁵ to measure caregiver perceptions of access to care: “In the last six months, did you have any difficulties or delays getting care for your child because there were waiting lists, backlogs, or other problems getting an appointment?” We narrowed the original assessment time frame from 12 months to 6 months to provide a more proximal assessment of access in relation to the hospitalization.

Child Physical Functioning

We assessed child physical functioning using the physical functioning domain of the Pediatric Quality of Life Inventory (PedsQL) 4.0 Generic Core Scales and PedsQL Infant Scales, which have been validated for use in the inpatient setting.²² Caregivers completed one of these scales based on their child’s age. Assenting patients 8 to 16 years old completed the self-report PedsQL 4.0 Generic Core Scales instrument. When completing the first PedsQL survey, caregivers and patients reflected on the previous month before their child (or they) became ill to obtain a baseline physical functioning assessment.²³ When completing the second PedsQL survey, caregivers and patients reflected on the past 7 days to obtain a follow-up assessment.

All study procedures were approved by the Western Institutional Review Board (IRB) or the participating hospitals’ IRB.

Statistical Analysis

Patients with no missing data for all four social disadvantage markers were categorized based on the number of markers they reported: none, one, two, or three or more markers. We combined patients with three and four social disadvantage markers into one group to maximize power for the analyses. We dichotomized the access to care variable and coded response options as “no difficulty/delays accessing care” if the caregiver chose “Never” and “any difficulty/delays accessing care” if they chose “Sometimes/Usually/Always.”

For each patient–caregiver dyad, PedsQL items were scored using a standard method in which higher scores reflected better functioning.²² A single set of PedsQL scores was used for each patient–caregiver dyad. We used self-reported patient scores if the patient completed the PedsQL instrument; otherwise, we used proxy-reported caregiver scores. Intraclass correlations between child self-report and parent proxy-report demonstrate moderate to good agreement above age 8 years.²⁶ We computed a change in the physical functioning score by subtracting the baseline score from the follow-up score. The minimal clinically important difference (MCID) for the PedsQL instrument is 4.5 points, which we used to identify clinically meaningful differences.¹³

Analysis of variance models were constructed to test for differences in mean baseline and follow-up PedsQL scores (dependent variable) between the following independent variables: (1) social disadvantage groups and (2) those who reported having any difficulty/delays accessing care compared with those who did not. Only patient–caregiver dyads with both baseline and follow-up assessments were included in these analyses. Mixed-effects linear regression models were constructed to identify clinically meaningful differences in PedsQL scores between groups (MCID =/> 4.5) with adjustment for patient age, gender, respiratory condition, days between surveys, and hospital site as fixed effects. Site-specific random effects were included to account for within-hospital clustering. A similarly adjusted mixed-effects linear regression model was constructed to examine whether having any difficulty/delays accessing care modified the association between social disadvantage and PedsQL change scores (eg, an improvement from baseline to follow-up).

Because 17% of respondents had missing data for at least one social disadvantage marker, sensitivity analyses were conducted using multiple imputation to account for missing social disadvantage markers using chained equations.²⁷ Sensitivity analyses were also conducted to adjust for severity of illness using vital sign data within the first 24 hours, which could only be validly captured on patients with asthma within our dataset. By restricting this latter analysis to patients with asthma, we were able to examine the relationships of interest in a population with chronic disease.

The study sample included 1,860 patients, of which 1,325 had both baseline and follow-up PedsQL data (71%). Descriptive statistics were similar between those who completed the baseline and follow-up surveys (Table 1).

Twenty-two percent of patients had >/=3 social disadvantages and 30% of caregivers reported having any difficulty/delays accessing care. The mean follow-up PedsQL score was higher than the baseline score (90.4 vs 82.5; Table 1).

Social Disadvantage Markers and PedsQL Scores

The number of social disadvantage markers was inversely related to mean baseline PedsQL scores, but there was no difference in mean follow-up PedsQL scores between social disadvantage groups (Table 2). In adjusted analyses, the mean baseline PedsQL score was −6.1 points (95% CI: −8.7, −3.5) lower for patients with >/= 3 social disadvantage markers compared with patients with no social disadvantage markers, which exceeded the scale’s MCID.

Difficulty/Delays Accessing Care and PedsQL Scores

Having any difficulty/delays accessing care was significantly associated with lower baseline and follow-up PedsQL scores (Table 2). In adjusted analyses, the difference in baseline scores was 5.2 points (95% CI: −7.2, −3.2), which exceedes the scale’s MCID.

Interaction Between Social Disadvantage Markers, Difficulty/Delays Accessing Care, and Change in PedsQL Scores from Baseline to Follow-Up

While having =/>2 social disadvantage markers and difficulty/delays accessing care were each positively associated with changes in PedsQL scores from baseline to follow-up (Table 3), only patients with =/> 3 social disadvantage markers exceeded the PedsQL MCID. In stratified analyses, patients with a combination of social disadvantage makers and difficulties/delays accessing care had lower baseline PedsQL scores and greater change in PedsQL scores from baseline to follow-up compared with those without difficulties/delays accessing care (Figure). However, having any difficulty/delays accessing care did not significantly modify the relationship between social disadvantage and change in PedsQL scores, as none of the interaction terms were significant (Table 3, Model 3).

Sensitivity Analysis

Baseline, follow-up, and change in PedsQL scores were similar to our main analysis after performing multiple imputation for missing social disadvantage markers (Supplemental Table 1). Findings were also similar for patients with a diagnosis of asthma only; however, changes in PedsQL scores were greater in magnitude (Appendix Table 2).

This study examined the relationship between social disadvantage and child physical functioning before and after hospitalization for acute respiratory illness. Study findings indicated that patients with higher numbers of social disadvantage markers reported lower PedsQL scores before hospitalization; however, differences in PedsQL scores were not apparent after hospitalization. Patients who experienced difficulty/delays accessing care also reported lower PedsQL scores at baseline. This difference was still significant but did not exceed the PedsQL MCID threshold after hospitalization. Difficulty/delays accessing care appeared to be an additional social disadvantage marker; however, it did not modify the relationship between social disadvantage and improvement in physical functioning.

The study findings at baseline are consistent with prior studies demonstrating a negative association between social disadvantage markers and HRQoL and a cumulative effect based on the number of social disadvantages.^3,4,7,8 This study adds to the existing literature by examining how this relationship changes after hospitalization. As evidenced by the lack of association between social disadvantage markers and follow-up PedsQL scores, our findings suggest that receipt of inpatient care improved perceptions of physical functioning to a greater extent for patients with more social disadvantage markers (especially patients with =/> 3 social disadvantage markers). There are several potential reasons for these findings.

Social disadvantage was associated with lower child physical functioning before hospitalization, but differences were not apparent after hospitalization for children with acute respiratory illness. Caregiver-perceived difficulty/delays accessing care was found to be an additional predictor of lower physical functioning at baseline but did not significantly alter the association between social disadvantage and improvement in physical functioning over time. Further studies are needed to understand how hospital care may differentially impact child physical functioning for patients with higher social disadvantage makers in order to sustain improvements in HRQoL disparities.

Acknowledgments

The authors thank the following individuals of the Pediatric Respiratory Illness Measurement System (PRIMES) study team for their contributions to this work: Karen M. Wilson, New York, New York; Ricardo A. Quinonez, Houston, Texas; Joyee G. Vachani, Houston, Texas; and Amy Tyler, Aurora, Colorado. We would also like to thank the Pediatric Research in Inpatient Settings Network for facilitating this work.

Examining disparities in health-related quality of life (HRQoL) outcomes in children provides a unique patient-centered perspective on pediatric health services equity.^1,2 Prior studies have demonstrated the relationship between minority race, low socioeconomic status, and lower maternal education with poorer HRQoL outcomes in children.^3-6 Some studies have also shown a dose-response relationship between social disadvantage markers and poorer child health status.^7,8 Furthermore, the associations between social disadvantage and poor access to care,^9-11 and between poor access to care and lower HRQoL, are also well established.^12-14

Examining HRQoL before and after hospitalization can further our understanding of how disparities in HRQoL may change once children engage with the medical system for an acute illness.¹⁵ Children requiring hospitalization constitute a useful population for examination of this question as they represent a group of children with variable social disadvantage markers and access to outpatient care.¹⁶ Although interventions to address social determinants of health for patients with social disadvantages have been associated with within-group improvements in HRQoL, none have assessed changes in disparities as an outcome.¹⁷ Furthermore, many of these studies were conducted in the outpatient setting,^18,19 whereas hospitalization provides an additional point of care to address the social determinants of health for vulnerable families.²⁰ Even for short hospitalizations, the 24/7 nature of hospital care provides the opportunity for frequent interactions with clinicians, nurses, and support staff to clarify illness-related questions, discuss other health concerns and unmet needs, and connect with social services or community resources. These opportunities may be particularly important for families with a higher number of social disadvantage markers and even more beneficial to those with difficulty accessing needed care from their primary medical home.

In this study, we focused on children with common respiratory illnesses (asthma, bronchiolitis, and pneumonia), which constitute the majority of childhood hospitalizations.²¹ Additionally, we only focused on the child’s physical functioning component of HRQoL because this component is most likely to improve after hospitalization for children with an acute respiratory illness.²² A prior study examining HRQoL before and after hospitalization demonstrated that most children return to and/or surpass their baseline physical functioning by 1 month after hospital discharge.²³

Our primary objective was to examine associations between several markers of social disadvantage, access to care, and child physical functioning before and after hospitalization for acute respiratory illness. Second, we aimed to understand if access to care (defined as perceived difficulty/delays getting care) acts as an independent predictor of improvement in physical functioning from baseline to follow-up and/or if it modifies the relationship between social disadvantage and improvement in physical functioning (Appendix Figure).

Study Design and Population

This study was nested within a multicenter, prospective cohort study of children who were hospitalized for asthma, bronchiolitis, or pneumonia between July 2014 and June 2016 at one of five children’s hospitals in the Pediatric Research in Inpatient Settings Network.²⁴

We approached families for study participation within 72 hours of admission to the hospital using a standard protocol. Patients and their caregivers were eligible to participate in the study if the patient was 2 weeks to 16 years old and if the primary caregiver’s preferred language for medical communication was either English or Spanish. Patients with chronic medical conditions (except asthma), with moderate to severe developmental delay, with a history of prematurity <32 weeks, or who received care in the intensive care unit were excluded. Patients could only participate in the study once.

The study team set out to enroll an even number of patients across all three conditions. If a patient’s discharge diagnosis differed from their admission diagnosis (eg, from bronchiolitis to pneumonia), discharge diagnosis was used for condition group assignment. If the discharge diagnosis was not one of these three respiratory conditions, we excluded the patient from further analysis.

Data Collection

We collected data using two surveys. The first survey was administered within 72 hours of admission. This survey asked questions related to (1) caregiver-reported markers of social disadvantage, (2) caregiver perceptions of access to care, and (3) caregiver- and patient-reported assessments of physical functioning. The second survey was administered within 2 to 8 weeks after the patient’s discharge and included a second assessment of physical functioning.

Social Disadvantage

Patients were considered to have a marker of social disadvantage if their caregiver reported (1) being of non-White race and/or Hispanic ethnicity, (2) primarily speaking a language other than English at home and not speaking English very well (ie, limited English proficiency), (3) attaining at most a high school or equivalent degree, or (4) having a =/<$30,000 annual household income.

Access to Care

We used the following survey item from the 2009-2010 National Survey of Children with Special Health Care Needs²⁵ to measure caregiver perceptions of access to care: “In the last six months, did you have any difficulties or delays getting care for your child because there were waiting lists, backlogs, or other problems getting an appointment?” We narrowed the original assessment time frame from 12 months to 6 months to provide a more proximal assessment of access in relation to the hospitalization.

Child Physical Functioning

We assessed child physical functioning using the physical functioning domain of the Pediatric Quality of Life Inventory (PedsQL) 4.0 Generic Core Scales and PedsQL Infant Scales, which have been validated for use in the inpatient setting.²² Caregivers completed one of these scales based on their child’s age. Assenting patients 8 to 16 years old completed the self-report PedsQL 4.0 Generic Core Scales instrument. When completing the first PedsQL survey, caregivers and patients reflected on the previous month before their child (or they) became ill to obtain a baseline physical functioning assessment.²³ When completing the second PedsQL survey, caregivers and patients reflected on the past 7 days to obtain a follow-up assessment.

All study procedures were approved by the Western Institutional Review Board (IRB) or the participating hospitals’ IRB.

Statistical Analysis

Patients with no missing data for all four social disadvantage markers were categorized based on the number of markers they reported: none, one, two, or three or more markers. We combined patients with three and four social disadvantage markers into one group to maximize power for the analyses. We dichotomized the access to care variable and coded response options as “no difficulty/delays accessing care” if the caregiver chose “Never” and “any difficulty/delays accessing care” if they chose “Sometimes/Usually/Always.”

For each patient–caregiver dyad, PedsQL items were scored using a standard method in which higher scores reflected better functioning.²² A single set of PedsQL scores was used for each patient–caregiver dyad. We used self-reported patient scores if the patient completed the PedsQL instrument; otherwise, we used proxy-reported caregiver scores. Intraclass correlations between child self-report and parent proxy-report demonstrate moderate to good agreement above age 8 years.²⁶ We computed a change in the physical functioning score by subtracting the baseline score from the follow-up score. The minimal clinically important difference (MCID) for the PedsQL instrument is 4.5 points, which we used to identify clinically meaningful differences.¹³

Analysis of variance models were constructed to test for differences in mean baseline and follow-up PedsQL scores (dependent variable) between the following independent variables: (1) social disadvantage groups and (2) those who reported having any difficulty/delays accessing care compared with those who did not. Only patient–caregiver dyads with both baseline and follow-up assessments were included in these analyses. Mixed-effects linear regression models were constructed to identify clinically meaningful differences in PedsQL scores between groups (MCID =/> 4.5) with adjustment for patient age, gender, respiratory condition, days between surveys, and hospital site as fixed effects. Site-specific random effects were included to account for within-hospital clustering. A similarly adjusted mixed-effects linear regression model was constructed to examine whether having any difficulty/delays accessing care modified the association between social disadvantage and PedsQL change scores (eg, an improvement from baseline to follow-up).

Because 17% of respondents had missing data for at least one social disadvantage marker, sensitivity analyses were conducted using multiple imputation to account for missing social disadvantage markers using chained equations.²⁷ Sensitivity analyses were also conducted to adjust for severity of illness using vital sign data within the first 24 hours, which could only be validly captured on patients with asthma within our dataset. By restricting this latter analysis to patients with asthma, we were able to examine the relationships of interest in a population with chronic disease.

The study sample included 1,860 patients, of which 1,325 had both baseline and follow-up PedsQL data (71%). Descriptive statistics were similar between those who completed the baseline and follow-up surveys (Table 1).

Twenty-two percent of patients had >/=3 social disadvantages and 30% of caregivers reported having any difficulty/delays accessing care. The mean follow-up PedsQL score was higher than the baseline score (90.4 vs 82.5; Table 1).

Social Disadvantage Markers and PedsQL Scores

The number of social disadvantage markers was inversely related to mean baseline PedsQL scores, but there was no difference in mean follow-up PedsQL scores between social disadvantage groups (Table 2). In adjusted analyses, the mean baseline PedsQL score was −6.1 points (95% CI: −8.7, −3.5) lower for patients with >/= 3 social disadvantage markers compared with patients with no social disadvantage markers, which exceeded the scale’s MCID.

Difficulty/Delays Accessing Care and PedsQL Scores

Having any difficulty/delays accessing care was significantly associated with lower baseline and follow-up PedsQL scores (Table 2). In adjusted analyses, the difference in baseline scores was 5.2 points (95% CI: −7.2, −3.2), which exceedes the scale’s MCID.

Interaction Between Social Disadvantage Markers, Difficulty/Delays Accessing Care, and Change in PedsQL Scores from Baseline to Follow-Up

While having =/>2 social disadvantage markers and difficulty/delays accessing care were each positively associated with changes in PedsQL scores from baseline to follow-up (Table 3), only patients with =/> 3 social disadvantage markers exceeded the PedsQL MCID. In stratified analyses, patients with a combination of social disadvantage makers and difficulties/delays accessing care had lower baseline PedsQL scores and greater change in PedsQL scores from baseline to follow-up compared with those without difficulties/delays accessing care (Figure). However, having any difficulty/delays accessing care did not significantly modify the relationship between social disadvantage and change in PedsQL scores, as none of the interaction terms were significant (Table 3, Model 3).

Sensitivity Analysis

Baseline, follow-up, and change in PedsQL scores were similar to our main analysis after performing multiple imputation for missing social disadvantage markers (Supplemental Table 1). Findings were also similar for patients with a diagnosis of asthma only; however, changes in PedsQL scores were greater in magnitude (Appendix Table 2).

This study examined the relationship between social disadvantage and child physical functioning before and after hospitalization for acute respiratory illness. Study findings indicated that patients with higher numbers of social disadvantage markers reported lower PedsQL scores before hospitalization; however, differences in PedsQL scores were not apparent after hospitalization. Patients who experienced difficulty/delays accessing care also reported lower PedsQL scores at baseline. This difference was still significant but did not exceed the PedsQL MCID threshold after hospitalization. Difficulty/delays accessing care appeared to be an additional social disadvantage marker; however, it did not modify the relationship between social disadvantage and improvement in physical functioning.

The study findings at baseline are consistent with prior studies demonstrating a negative association between social disadvantage markers and HRQoL and a cumulative effect based on the number of social disadvantages.^3,4,7,8 This study adds to the existing literature by examining how this relationship changes after hospitalization. As evidenced by the lack of association between social disadvantage markers and follow-up PedsQL scores, our findings suggest that receipt of inpatient care improved perceptions of physical functioning to a greater extent for patients with more social disadvantage markers (especially patients with =/> 3 social disadvantage markers). There are several potential reasons for these findings.

Social disadvantage was associated with lower child physical functioning before hospitalization, but differences were not apparent after hospitalization for children with acute respiratory illness. Caregiver-perceived difficulty/delays accessing care was found to be an additional predictor of lower physical functioning at baseline but did not significantly alter the association between social disadvantage and improvement in physical functioning over time. Further studies are needed to understand how hospital care may differentially impact child physical functioning for patients with higher social disadvantage makers in order to sustain improvements in HRQoL disparities.

Acknowledgments

The authors thank the following individuals of the Pediatric Respiratory Illness Measurement System (PRIMES) study team for their contributions to this work: Karen M. Wilson, New York, New York; Ricardo A. Quinonez, Houston, Texas; Joyee G. Vachani, Houston, Texas; and Amy Tyler, Aurora, Colorado. We would also like to thank the Pediatric Research in Inpatient Settings Network for facilitating this work.

Examining disparities in health-related quality of life (HRQoL) outcomes in children provides a unique patient-centered perspective on pediatric health services equity.^1,2 Prior studies have demonstrated the relationship between minority race, low socioeconomic status, and lower maternal education with poorer HRQoL outcomes in children.^3-6 Some studies have also shown a dose-response relationship between social disadvantage markers and poorer child health status.^7,8 Furthermore, the associations between social disadvantage and poor access to care,^9-11 and between poor access to care and lower HRQoL, are also well established.^12-14

Examining HRQoL before and after hospitalization can further our understanding of how disparities in HRQoL may change once children engage with the medical system for an acute illness.¹⁵ Children requiring hospitalization constitute a useful population for examination of this question as they represent a group of children with variable social disadvantage markers and access to outpatient care.¹⁶ Although interventions to address social determinants of health for patients with social disadvantages have been associated with within-group improvements in HRQoL, none have assessed changes in disparities as an outcome.¹⁷ Furthermore, many of these studies were conducted in the outpatient setting,^18,19 whereas hospitalization provides an additional point of care to address the social determinants of health for vulnerable families.²⁰ Even for short hospitalizations, the 24/7 nature of hospital care provides the opportunity for frequent interactions with clinicians, nurses, and support staff to clarify illness-related questions, discuss other health concerns and unmet needs, and connect with social services or community resources. These opportunities may be particularly important for families with a higher number of social disadvantage markers and even more beneficial to those with difficulty accessing needed care from their primary medical home.

In this study, we focused on children with common respiratory illnesses (asthma, bronchiolitis, and pneumonia), which constitute the majority of childhood hospitalizations.²¹ Additionally, we only focused on the child’s physical functioning component of HRQoL because this component is most likely to improve after hospitalization for children with an acute respiratory illness.²² A prior study examining HRQoL before and after hospitalization demonstrated that most children return to and/or surpass their baseline physical functioning by 1 month after hospital discharge.²³

Our primary objective was to examine associations between several markers of social disadvantage, access to care, and child physical functioning before and after hospitalization for acute respiratory illness. Second, we aimed to understand if access to care (defined as perceived difficulty/delays getting care) acts as an independent predictor of improvement in physical functioning from baseline to follow-up and/or if it modifies the relationship between social disadvantage and improvement in physical functioning (Appendix Figure).

Study Design and Population

This study was nested within a multicenter, prospective cohort study of children who were hospitalized for asthma, bronchiolitis, or pneumonia between July 2014 and June 2016 at one of five children’s hospitals in the Pediatric Research in Inpatient Settings Network.²⁴

We approached families for study participation within 72 hours of admission to the hospital using a standard protocol. Patients and their caregivers were eligible to participate in the study if the patient was 2 weeks to 16 years old and if the primary caregiver’s preferred language for medical communication was either English or Spanish. Patients with chronic medical conditions (except asthma), with moderate to severe developmental delay, with a history of prematurity <32 weeks, or who received care in the intensive care unit were excluded. Patients could only participate in the study once.

The study team set out to enroll an even number of patients across all three conditions. If a patient’s discharge diagnosis differed from their admission diagnosis (eg, from bronchiolitis to pneumonia), discharge diagnosis was used for condition group assignment. If the discharge diagnosis was not one of these three respiratory conditions, we excluded the patient from further analysis.

Data Collection

We collected data using two surveys. The first survey was administered within 72 hours of admission. This survey asked questions related to (1) caregiver-reported markers of social disadvantage, (2) caregiver perceptions of access to care, and (3) caregiver- and patient-reported assessments of physical functioning. The second survey was administered within 2 to 8 weeks after the patient’s discharge and included a second assessment of physical functioning.

Social Disadvantage

Patients were considered to have a marker of social disadvantage if their caregiver reported (1) being of non-White race and/or Hispanic ethnicity, (2) primarily speaking a language other than English at home and not speaking English very well (ie, limited English proficiency), (3) attaining at most a high school or equivalent degree, or (4) having a =/<$30,000 annual household income.

Access to Care

We used the following survey item from the 2009-2010 National Survey of Children with Special Health Care Needs²⁵ to measure caregiver perceptions of access to care: “In the last six months, did you have any difficulties or delays getting care for your child because there were waiting lists, backlogs, or other problems getting an appointment?” We narrowed the original assessment time frame from 12 months to 6 months to provide a more proximal assessment of access in relation to the hospitalization.

Child Physical Functioning

We assessed child physical functioning using the physical functioning domain of the Pediatric Quality of Life Inventory (PedsQL) 4.0 Generic Core Scales and PedsQL Infant Scales, which have been validated for use in the inpatient setting.²² Caregivers completed one of these scales based on their child’s age. Assenting patients 8 to 16 years old completed the self-report PedsQL 4.0 Generic Core Scales instrument. When completing the first PedsQL survey, caregivers and patients reflected on the previous month before their child (or they) became ill to obtain a baseline physical functioning assessment.²³ When completing the second PedsQL survey, caregivers and patients reflected on the past 7 days to obtain a follow-up assessment.

All study procedures were approved by the Western Institutional Review Board (IRB) or the participating hospitals’ IRB.

Statistical Analysis

Patients with no missing data for all four social disadvantage markers were categorized based on the number of markers they reported: none, one, two, or three or more markers. We combined patients with three and four social disadvantage markers into one group to maximize power for the analyses. We dichotomized the access to care variable and coded response options as “no difficulty/delays accessing care” if the caregiver chose “Never” and “any difficulty/delays accessing care” if they chose “Sometimes/Usually/Always.”

For each patient–caregiver dyad, PedsQL items were scored using a standard method in which higher scores reflected better functioning.²² A single set of PedsQL scores was used for each patient–caregiver dyad. We used self-reported patient scores if the patient completed the PedsQL instrument; otherwise, we used proxy-reported caregiver scores. Intraclass correlations between child self-report and parent proxy-report demonstrate moderate to good agreement above age 8 years.²⁶ We computed a change in the physical functioning score by subtracting the baseline score from the follow-up score. The minimal clinically important difference (MCID) for the PedsQL instrument is 4.5 points, which we used to identify clinically meaningful differences.¹³

Analysis of variance models were constructed to test for differences in mean baseline and follow-up PedsQL scores (dependent variable) between the following independent variables: (1) social disadvantage groups and (2) those who reported having any difficulty/delays accessing care compared with those who did not. Only patient–caregiver dyads with both baseline and follow-up assessments were included in these analyses. Mixed-effects linear regression models were constructed to identify clinically meaningful differences in PedsQL scores between groups (MCID =/> 4.5) with adjustment for patient age, gender, respiratory condition, days between surveys, and hospital site as fixed effects. Site-specific random effects were included to account for within-hospital clustering. A similarly adjusted mixed-effects linear regression model was constructed to examine whether having any difficulty/delays accessing care modified the association between social disadvantage and PedsQL change scores (eg, an improvement from baseline to follow-up).

Because 17% of respondents had missing data for at least one social disadvantage marker, sensitivity analyses were conducted using multiple imputation to account for missing social disadvantage markers using chained equations.²⁷ Sensitivity analyses were also conducted to adjust for severity of illness using vital sign data within the first 24 hours, which could only be validly captured on patients with asthma within our dataset. By restricting this latter analysis to patients with asthma, we were able to examine the relationships of interest in a population with chronic disease.

The study sample included 1,860 patients, of which 1,325 had both baseline and follow-up PedsQL data (71%). Descriptive statistics were similar between those who completed the baseline and follow-up surveys (Table 1).

Twenty-two percent of patients had >/=3 social disadvantages and 30% of caregivers reported having any difficulty/delays accessing care. The mean follow-up PedsQL score was higher than the baseline score (90.4 vs 82.5; Table 1).

Social Disadvantage Markers and PedsQL Scores

The number of social disadvantage markers was inversely related to mean baseline PedsQL scores, but there was no difference in mean follow-up PedsQL scores between social disadvantage groups (Table 2). In adjusted analyses, the mean baseline PedsQL score was −6.1 points (95% CI: −8.7, −3.5) lower for patients with >/= 3 social disadvantage markers compared with patients with no social disadvantage markers, which exceeded the scale’s MCID.

Difficulty/Delays Accessing Care and PedsQL Scores

Having any difficulty/delays accessing care was significantly associated with lower baseline and follow-up PedsQL scores (Table 2). In adjusted analyses, the difference in baseline scores was 5.2 points (95% CI: −7.2, −3.2), which exceedes the scale’s MCID.

Interaction Between Social Disadvantage Markers, Difficulty/Delays Accessing Care, and Change in PedsQL Scores from Baseline to Follow-Up

While having =/>2 social disadvantage markers and difficulty/delays accessing care were each positively associated with changes in PedsQL scores from baseline to follow-up (Table 3), only patients with =/> 3 social disadvantage markers exceeded the PedsQL MCID. In stratified analyses, patients with a combination of social disadvantage makers and difficulties/delays accessing care had lower baseline PedsQL scores and greater change in PedsQL scores from baseline to follow-up compared with those without difficulties/delays accessing care (Figure). However, having any difficulty/delays accessing care did not significantly modify the relationship between social disadvantage and change in PedsQL scores, as none of the interaction terms were significant (Table 3, Model 3).

Sensitivity Analysis

Baseline, follow-up, and change in PedsQL scores were similar to our main analysis after performing multiple imputation for missing social disadvantage markers (Supplemental Table 1). Findings were also similar for patients with a diagnosis of asthma only; however, changes in PedsQL scores were greater in magnitude (Appendix Table 2).

This study examined the relationship between social disadvantage and child physical functioning before and after hospitalization for acute respiratory illness. Study findings indicated that patients with higher numbers of social disadvantage markers reported lower PedsQL scores before hospitalization; however, differences in PedsQL scores were not apparent after hospitalization. Patients who experienced difficulty/delays accessing care also reported lower PedsQL scores at baseline. This difference was still significant but did not exceed the PedsQL MCID threshold after hospitalization. Difficulty/delays accessing care appeared to be an additional social disadvantage marker; however, it did not modify the relationship between social disadvantage and improvement in physical functioning.

The study findings at baseline are consistent with prior studies demonstrating a negative association between social disadvantage markers and HRQoL and a cumulative effect based on the number of social disadvantages.^3,4,7,8 This study adds to the existing literature by examining how this relationship changes after hospitalization. As evidenced by the lack of association between social disadvantage markers and follow-up PedsQL scores, our findings suggest that receipt of inpatient care improved perceptions of physical functioning to a greater extent for patients with more social disadvantage markers (especially patients with =/> 3 social disadvantage markers). There are several potential reasons for these findings.

Social disadvantage was associated with lower child physical functioning before hospitalization, but differences were not apparent after hospitalization for children with acute respiratory illness. Caregiver-perceived difficulty/delays accessing care was found to be an additional predictor of lower physical functioning at baseline but did not significantly alter the association between social disadvantage and improvement in physical functioning over time. Further studies are needed to understand how hospital care may differentially impact child physical functioning for patients with higher social disadvantage makers in order to sustain improvements in HRQoL disparities.

Acknowledgments

The authors thank the following individuals of the Pediatric Respiratory Illness Measurement System (PRIMES) study team for their contributions to this work: Karen M. Wilson, New York, New York; Ricardo A. Quinonez, Houston, Texas; Joyee G. Vachani, Houston, Texas; and Amy Tyler, Aurora, Colorado. We would also like to thank the Pediatric Research in Inpatient Settings Network for facilitating this work.