UC Irvine personalized ratings app may improve patient’s choice of nursing home

Patients can create scores based on personal medical needs and preferences

April 04, 2016

Contact: Pat Harriman, 714-456-3673, pharrima@uci.edu

A new app created at UC Irvine can improve a patient’s choice of a nursing home. This is important, because when it comes to rating quality measures for nursing homes, patients and experts at the Centers for Medicare and Medicaid Services (CMS) usually don’t agree on what is best, leading UCI researchers to conclude that patients may benefit from a more personalized approach to choosing a nursing home.

Their study, titled “When Patients Customize Nursing Home Ratings, Choices and Rankings Differ from the Government’s Version,” appears in the April issue of Health Affairs.

“Medical care is undergoing a cultural transformation, moving towards personalization and patient-centered care,” said Dana B. Mukamel, professor in the Department of Medicine and research study leader. “Our work brings this philosophy to provider choice and quality reporting.”

Most patients and their families rely on the five-star ranking system devised by CMS and featured on the Nursing Home Compare website. The rankings are calculated according to a fixed subset of quality measures, with each measure given a fixed importance weight. This five-star ranking, according to Mukamel, is a “one size fits all patients” measure that does not reflect individual patient needs and preferences.

“When patients and their families have the option of creating their own composite scores based on their personal medical needs and preferences, they make different choices,” Mukamel said. “Our findings suggest that patients may benefit if the rating report cards are modified to also include an option for personalized ranking of quality measures.”

In the study, patients used an iPad-based application, developed by Mukamel and the research team. The app, called Nursing Home Compare Plus, enabled patients to rank the importance of each performance measure according to their personal medical needs and preferences.

The application combined the performance measures published on the CMS Nursing Home Compare website with the preferences expressed by the patient and family. A list of nursing homes that combined personal preferences and the Nursing Home Compare performance measures was provided to the patient.

Researchers quantified the level of agreement between Nursing Home Compare Plus and the five-star rankings by measuring the level of agreement between the two for all nursing homes in each user’s ZIP code-based choice set, on a scale of zero to one, with zero indicating random agreement and one indicating perfect agreement. The levels of agreement ranged from 0.22 – 0.38, indicating substantial disagreement between the two ranking systems, indicating that the “one size fits all patients” approach to choosing a nursing home might not be best.

“Patients’ medical needs and preferences vary,” Mukamel said. “Instead of looking for the ‘best’ provider along all measures, patients should be looking for the best provider for them. Therefore, allowing patients to personalize the composite measures has the potential to improve their choices."

The randomized controlled study involved 146 patients who were discharged from the departments of medicine and surgery at UC Irvine Medical Center to nursing homes, from February 2014 to August 2015.

The research team also includes Dara H. Sorkin, an associate professor in the Department of Medicine at UCI; Alpesh Amin, chair and professor in the Department of Medicine as well as executive director of the Hospitalist Program at UCI; David L. Weimer, professor at the La Follete School of Public Affairs, University of Wisconsin–Madison; Joseph Sharit, research professor in the Department of Industrial Engineering at the University of Miami; and Heather Ladd, senior statistician in the Department of Medicine at UC Irvine. Funding for this study was provided by the Agency for Healthcare Research and Quality.

UCI Health comprises the clinical, medical education and research enterprises of the University of California, Irvine. Patients can access UCI Health at physician offices throughout Orange County and at its main campus, UC Irvine Medical Center in Orange, Calif., a 411-bed acute care hospital that provides tertiary and quaternary care, ambulatory and specialty medical clinics, and behavioral health and rehabilitation services. U.S. News & World Report has listed it among America’s Best Hospitals for 15 consecutive years. UC Irvine Medical Center is home to Orange County’s only National Cancer Institute-designated comprehensive cancer center, high-risk perinatal/neonatal program, Level I trauma center and Level II pediatric trauma center, and it is the primary teaching hospital for the UC Irvine School of Medicine. UCI Health serves a region of more than 3 million people in Orange County, western Riverside County and southeast Los Angeles County. Follow us on Facebook and Twitter.

About the University of California, Irvine: Currently celebrating its 50th anniversary, UC Irvine is the youngest member of the prestigious Association of American Universities. The campus has produced three Nobel laureates and is known for its academic achievement, premier research, innovation and anteater mascot. Led by Chancellor Howard Gillman, UC Irvine has more than 30,000 students and offers 192 degree programs. It’s located in one of the world’s safest and most economically vibrant communities and is Orange County’s second-largest employer, contributing $4.8 billion annually to the local economy. For more on UC Irvine, visit www.uci.edu.

View by Category