Why Precision Matters in Healthcare

If overpayments are found, then the extrapolation recoupment number will go up; if underpayments are found, the extrapolation will go down.

Precision matters – in everything. Especially in Medicare statistical sampling and extrapolations.

But that’s not how the world works.

In the fantasy world of statistical sampling and extrapolation inhabited by program integrity auditors, the statisticians long have grown accustomed to cutting corners and doing substandard and sloppy work. And the Administrative Law Judges (ALJs) have been hoodwinked into accepting this inaccurate work based on a dangerous myth.

Yes, there is a dangerous myth in the world of Medicare auditing, statistical sampling, and extrapolations. What is it?

Well, let’s start with the Program Integrity Manual (PIM), which as we all know has a number of dos and don’ts that are routinely ignored by auditors. In the infamous Chapter 8 on statistical sampling and extrapolation, the PIM states explicitly that the auditor can pick and choose what rules they wish to comply with. Well, it doesn’t say that exactly, but here is the tortured language in Section 8.4.1.1: 

Failure by a contractor to follow one or more of the requirements contained herein does not necessarily affect the validity of the statistical sampling that was conducted or the projection of the overpayment.

So here is what that means. This is Washington, D.C. gobbledygook for an insinuation that the auditor can cut corners, take shortcuts, skip steps in the statistical methodology, make up data (or use the wrong data in crucial formulas), and even use the wrong formulas, yet still the extrapolation for the most part will be accepted.

So, on the one hand, the healthcare provider is audited using the strictest possible interpretation of the Local Coverage Determinations (LCDs). A small typo, a missing abbreviation, the smallest detail can disqualify a claim, and then its value will get multiplied hundreds of times in the extrapolation.

On the other hand, it is clear that the auditor is not held to the same standard. Far from it. There is no need to ask if this is fair, because we all know it is not.

Let’s look at this in more detail.

“Plus or Minus”

Small things add up to large things. We know this because it is possible to actually measure statistical work and assess how bad it is. One measure is precision. This is the “plus-or-minus” number.

Polls are statistical extrapolations. “The politician has 45-percent support in the polls, plus or minus 5 percent.” This means the support of the politician is somewhere between 40 and 50 percent, or 45 minus 5 percent and 45 plus 5 percent. This is known as a precision of 5 percent. Using the arcane language of statistics, the 45 percent is the so-called “point estimate.”

But there is another important number. It tells how sure you can be that the precision is plus or minus 5 percent. The standard for this is 95 percent. This means that one can be 95-percent sure that the somewhere between 40 and 50 percent. The term for this is “confidence.” It is fairly standard to use a 95-percent confidence. But the PIM gives much more leeway to the auditors. They can use 90 percent. They need to be only 90-percent sure.

But that is not what happens. Far from it.

We routinely find Medicare auditors handing in extrapolations with precision far worse than 5 percent. They rarely are that precise. In Medicare, precision can be plus or minus 10, 15, 20, 30 percent –  or even worse.

That is somewhere between 25 and 85 percent. But that seems to be good enough for government work.

Effect on Medicare Extrapolations

OK, enough statistics. What does this really mean? In Medicare audits, the extrapolated overpayment amount, the recoupment being demanded, often is a number that is not very accurate. And in some cases, this can mean a very great amount of money, “plus or minus.”

Dangerous Myth

So, what do the auditors and the PIM do about this? They rationalize the imprecision by saying that instead of taking the “point estimate,” they will take the number at the lower range of the confidence. So, they would take the 40 percent in the first example, for the politician, and they would take 25 percent in the last example.

And this is how the ALJs have been told to rationalize sloppy statistical work. They will say something like “well, we can be 90-percent sure that the number is at least this.” And they will tell the healthcare provider that poor precision actually works in their favor.

After all, the worse the precision, the farther and farther the number on the lower side will drop. So everyone should be happy. In a recent case, a statistician hired by the ALJ was responding to complaints that the precision was very poor, somewhere around36 percent. They wrote:

Providers should be happy with poor precision. The more imprecise, the better it is for the provider, because we always ask for the lower bound of the confidence interval.”

And the ALJs go along with this. Do you see what has happened? The Medicare auditing system in the United States has degenerated into an official policy of poor standards for statistical sampling and extrapolations, and although there are guidelines in the PIM for the auditors, they are not required to follow them.

The PIM is Wrong

The problem with all of this is that it is wrong, wrong, wrong. How do we know this? Recently, we developed the mathematical proof that about a third of the time, the true number will be actually lower than the original recoupment demand. So, the PIM is wrong. It is horribly wrong; it is mathematically wrong. And this means that the auditor’s arguments, and the ALJ decisions that accept lousy precision based on this spurious logic, also are wrong. That poor precision works in favor of the provider is a myth, it can be proved to be a myth.

Facebook
Twitter
LinkedIn

Edward M. Roche, PhD, JD

Edward Roche is the director of scientific intelligence for Barraclough NY, LLC. Mr. Roche is also a member of the California Bar. Prior to his career in health law, he served as the chief research officer of the Gartner Group, a leading ICT advisory firm. He was chief scientist of the Concours Group, both leading IT consulting and research organizations. Mr. Roche is a member of the RACmonitor editorial board as an investigative reporter and is a popular panelist on Monitor Mondays.

Related Stories

Leave a Reply

Please log in to your account to comment on this article.

Featured Webcasts

CDI Query Mastery: Best Practices for Denial Prevention and Revenue Integrity

Physician queries are essential for accurate documentation and claims data, but they are increasingly scrutinized by payors, leading to denials and revenue leakage. This webcast, led by industry expert Cheryl Ericson, RN, MS, CCDS, CDIP, provides actionable strategies to craft compliant queries, reduce denials, and enhance revenue integrity. Attendees will gain insights into clinical validation queries, how to avoid common pitfalls, and learn best practices to defend against query denials. Don’t miss this opportunity to refine your query process and protect your organization’s financial health.

March 27, 2025
Heart Failure Coding Essentials: Ensuring Compliance and Optimal Reimbursement

Heart Failure Coding Essentials: Ensuring Compliance and Optimal Reimbursement

Master the complexities of heart failure coding with this expert-led webcast by Emily Montemayor, CCS, CMBCS, COC, CPC, CPMA. Discover strategies to ensure compliance with ICD-10-CM guidelines, documentation integrity, and capture comorbidities like CKD and hypertension. Learn how to resolve coding challenges, improve documentation practices, and submit clean claims to minimize denials and safeguard your organization’s financial health. With practical insights and real-world examples, this session equips you to prevent revenue leakage, enhance compliance, and secure optimal reimbursement—all while supporting better patient outcomes.

February 26, 2025
Decoding 2025 OPPS Charge Capture and Coding Complexities: Strategies for Success

Decoding 2025 OPPS Charge Capture and Coding Complexities: Strategies for Success

Prepare your organization for the 2025 OPPS updates with expert insights from Tiffani Bouchard, CCS, CRCR, a Revenue Integrity Professional with over 30 years of experience. This webcast will address critical challenges in charge capture and coding, providing clarity on APC policies, C-APC packaging, exclusions, and payer-specific requirements. Attendees will learn actionable strategies to ensure compliance, optimize reimbursement, and mitigate risks of claim denials. Gain the knowledge needed to implement updates effectively, educate your team, and maintain seamless revenue cycle operations in the face of evolving OPPS complexities.

January 29, 2025

Trending News

Featured Webcasts

Utilization Review Essentials: What Every Professional Needs to Know About Medicare

Utilization Review Essentials: What Every Professional Needs to Know About Medicare

Dr. Ronald Hirsch dives into the basics of Medicare for clinicians to be successful as utilization review professionals. He’ll break down what Medicare does and doesn’t pay for, what services it provides and how hospitals get paid for providing those services – including both inpatient and outpatient. Learn how claims are prepared and how much patients must pay for their care. By attending our webcast, you will gain a new understanding of these issues and be better equipped to talk to patients, to their medical staff, and to their administrative team.

March 20, 2025

Rethinking Observation Metrics: Standardizing Data for Better Outcomes

Hospitals face growing challenges in measuring observation metrics due to inconsistencies in classification, payer policies, and benchmarking practices. Join Tiffany Ferguson, LMSW, CMAC, ACM, and Anuja Mohla, DO, FACP, MBA, ACPA-C, CHCQM-PHYADV as they provide critical insights into refining observation metrics. This webcast will address key issues affecting observation data integrity and offer strategies for improving consistency in reporting. You will learn how to define meaningful metrics, clarify commonly misinterpreted terms, and apply best practices for benchmarking, and gain actionable strategies to enhance observation data reliability, mitigate financial risk, and drive better decision-making.

February 25, 2025
Navigating the 2025 Medicare Physician Fee Schedule: Key Changes and Strategies for Success

Navigating the 2025 Medicare Physician Fee Schedule: Key Changes and Strategies for Success

The 2025 Medicare Physician Fee Schedule brings significant changes to payment rates, coverage, and coding for physician services, impacting practices nationwide. Join Stanley Nachimson, MS., as he provides a comprehensive guide to understanding these updates, offering actionable insights on new Medicare-covered services, revised coding rules, and payment policies effective January 1. Learn how to adapt your practices to maintain compliance, maximize reimbursement, and plan for revenue in 2025. Whether you’re a physician, coder, or financial staff member, this session equips you with the tools to navigate Medicare’s evolving requirements confidently and efficiently.

January 21, 2025
Patient Notifications and Rights: What You Need to Know

Patient Notifications and Rights: What You Need to Know

Dr. Ronald Hirsch provides critical details on the new Medicare Appeal Process for Status Changes for patients whose status changes during their hospital stay. He also delves into other scenarios of hospital patients receiving custodial care or medically unnecessary services where patient notifications may be needed along with the processes necessary to ensure compliance with state and federal guidance.

December 5, 2024

Trending News

Happy National Doctor’s Day! Learn how to get a complimentary webcast on ‘Decoding Social Admissions’ as a token of our heartfelt appreciation! Click here to learn more →

CYBER WEEK IS HERE! Don’t miss your chance to get 20% off now until Dec. 2 with code CYBER24