Radiologists who interpret more mammograms and spend some time reading diagnostic mammograms do better at determining which suspicious breast lesions are cancer, according to a new report published online on February 22 and in print in the April issue of Radiology.
In direct response to a report from the Institute of Medicine that called for more research on the relationship between interpretive volume and performance in screening mammography, the multi-site team undertook the largest and most comprehensive study of U.S. radiologists. The Institute of Medicine is the health arm of the National Academies, advisors to the nation on science, engineering, and medicine.
Funded largely through a unique collaboration between the American Cancer Society and the National Cancer Institute, the study examined information from 120 radiologists who interpreted 783,965 screening mammograms at six mammography registries in the Breast Cancer Surveillance Consortium (BCSC) over five years. The researchers looked at how screening outcomes were related to four different measures of each radiologist’s annual volume: the number of screening and diagnostic mammograms — separately and in combination — and the percentage of total mammograms that were for screening rather than diagnosis.
“We found that radiologists who interpreted more mammograms a year had clinically and statistically significantly fewer false-positive findings — without missing more cancers,” said study leader Diana S.M. Buist, PhD, MPH, a senior investigator at Group Health Research Institute. “That means radiologists with higher ‘interpretive volumes’ could identify the same number of cancers, while making fewer women come in for extra tests that showed they did not have cancer.” On average, for every cancer detected, 22.3 women were called back for more testing.
False-positive findings — when a mammogram suggests a breast cancer is present, but it turns out not to be — cause women anxiety and spur extra testing, which amounts to at least $1.6 billion in health care costs each year. Often, there’s a tradeoff between minimizing false positives and maximizing sensitivity, which is the ability to identify cancer when present. But in this study, despite their lower false-positive rates, the high-volume radiologists had sensitivities and cancer-detection rates that resembled those of their lower-volume colleagues.
“We also found that radiologists were more accurate at interpreting mammograms if they also interpreted some diagnostic mammograms.” Dr. Buist said. Diagnostic mammograms evaluate breast symptoms or abnormalities seen on a prior screening mammogram. The cancer-detection rate was highest when at least one in five of the mammograms that a radiologist read a diagnostic, not screening, mammogram — instead of their focusing more exclusively on reading screening mammograms.
This report’s findings have policy implications. The U.S. Food and Drug Administration (FDA) requires radiologists who interpret mammograms to read only 960 mammograms in two years, with no requirement about the type of mammograms they read (screening or diagnostic). In Europe and Canada, where volume requirements are 5 times higher, screening mammography programs have lower false-positive rates — but similar cancer-detection rates — than the United States.
“In the United States, the goal of screening is to achieve high sensitivity while keeping the rates of false positives low,” Dr. Buist said. “No single measure can be calculated to make policy decisions, because any policy needs to weigh the tradeoff between missed cancers and false positives: Both have important impacts on women and society.”
Dr. Buist added: “Based on these data, it would be beneficial if U.S. volume requirements could be increased to 1,000 or 1,500 screening mammograms per year, while adding a minimal requirement for diagnostic interpretation, which would optimize sensitivity and false-positive rates.” According to her team’s simulations, raising annual requirements for screening volume could lower the number of American women with false-positive workups — by more than 71,000 for annual minimums of 1,000, or by more than 117,000 year for annual minimums of 1,500 — without hindering the detection of breast cancer.
On the other hand, raising the volume requirements could cause low-volume radiologists to stop reading mammograms. Concerns have been raised that the cadre of U.S. radiologists who read mammograms is aging and retiring. In this study, for instance, radiologists’ median age was 54, and 38 percent of them interpreted fewer than 1,500 mammograms a year.
“Without more radiologists interpreting more mammograms, women may have less access to the only screening test that trials have shown can reduce deaths from breast cancer,” Dr. Buist said. “Unlike the mammography debate about whether women in their 40s should be screened, which is based on the weight of harms of false positives, the tradeoff around volume policy will concern workforce issues and reporting requirements that would necessitate changes to how the FDA collects information on how many mammograms radiologists interpret.” Her team has also been testing strategies for improving how well radiologists interpret mammograms.
In a unique partnership and combination of funding, the American Cancer Society through the Longaberger Company’s Horizon of Hope Campaign®, the National Cancer Institute through Breast Cancer Stamp Fund, and the Agency for Healthcare Research and Quality supported this study using data from the Breast Cancer Surveillance Consortium. The Longaberger Company, which sells baskets and other products through home shows, has raised more than $14 million through its Horizon of Hope campaign. From the sale of every Horizon of Hope basket, $2 goes to the American Cancer Society to support breast cancer research and other initiatives.
Collaborating with Dr. Buist were Diana Miglioretti, PhD and Melissa L. Anderson, MS, of Group Health Research Institute; Sebastien J-P.A. Haneuse, PhD, who recently moved from Group Health Research Institute to Harvard School of Public Health, in Boston; Joann G. Elmore, MD, MPH, of the University of Washington School of Medicine, who is also an affiliate investigator at Group Health Research Institute; Edward A. Sickles, MD, and Karla Kerlikowske, MD, of the University of California, San Francisco; Robert A. Smith, PhD, of the American Cancer Society, in Atlanta; Patricia A. Carney, PhD, of Oregon Health & Science University, in Portland, OR; Stephen H. Taplin, MD, MPH, of the National Cancer Institute, in Bethesda, MD; Robert D. Rosenberg, MD, of the University of New Mexico, in Albuquerque; Berta M. Geller, EdD, of the University of Vermont, in Burlington; Tracy L. Onega, PhD, of Dartmouth Medical School, in Lebanon, NH; Barbara S. Monsees, MD, of Washington University School of Medicine, in St. Louis, MO; Lawrence W. Bassett, MD, of the University of California, Los Angeles; and Bonnie C. Yankaskas, PhD, of the University of North Carolina, in Chapel Hill.
Group Health Research Institute
Founded in 1947, Group Health Cooperative is a Seattle-based, consumer-governed, nonprofit health care system. Group Health Research Institute changed its name from Group Health Center for Health Studies in 2009. Since 1983, the Institute has conducted nonproprietary public-interest research on preventing, diagnosing, and treating major health problems. Government and private research grants provide its main funding.
Radiology
Radiology is edited by Herbert Y. Kressel, MD, of Harvard Medical School, in Boston, and owned and published by the Radiological Society of North America, Inc. RSNA is an association of more than 44,000 radiologists, radiation oncologists, medical physicists and related scientists committed to excellence in patient care through education and research. The Society is based in Oak Brook, Ill. For patient-friendly information on mammography, visit RadiologyInfo.org.
Breast Cancer Surveillance Consortium
The Breast Cancer Surveillance Consortium (BCSC) is a research resource for studies designed to assess the delivery and quality of breast cancer screening and related patient outcomes in the United States. The BCSC is a collaborative network of seven mammography registries with linkages to tumor and/or pathology registries. The network is supported by a central Statistical Coordinating Center. Currently, the Consortium’s database contains information on 7,521,000 mammographic examinations, 2,017,869 women, and 86,700 cancer cases (72,800 invasive cancers and 13,800 in situ). For more information, visit http://breastscreening.cancer.gov.
