Why Precision Matters in Healthcare

If overpayments are found, then the extrapolation recoupment number will go up; if underpayments are found, the extrapolation will go down.

Precision matters – in everything. Especially in Medicare statistical sampling and extrapolations.

But that’s not how the world works.

In the fantasy world of statistical sampling and extrapolation inhabited by program integrity auditors, the statisticians long have grown accustomed to cutting corners and doing substandard and sloppy work. And the Administrative Law Judges (ALJs) have been hoodwinked into accepting this inaccurate work based on a dangerous myth.

Yes, there is a dangerous myth in the world of Medicare auditing, statistical sampling, and extrapolations. What is it?

Well, let’s start with the Program Integrity Manual (PIM), which as we all know has a number of dos and don’ts that are routinely ignored by auditors. In the infamous Chapter 8 on statistical sampling and extrapolation, the PIM states explicitly that the auditor can pick and choose what rules they wish to comply with. Well, it doesn’t say that exactly, but here is the tortured language in Section 8.4.1.1: 

Failure by a contractor to follow one or more of the requirements contained herein does not necessarily affect the validity of the statistical sampling that was conducted or the projection of the overpayment.

So here is what that means. This is Washington, D.C. gobbledygook for an insinuation that the auditor can cut corners, take shortcuts, skip steps in the statistical methodology, make up data (or use the wrong data in crucial formulas), and even use the wrong formulas, yet still the extrapolation for the most part will be accepted.

So, on the one hand, the healthcare provider is audited using the strictest possible interpretation of the Local Coverage Determinations (LCDs). A small typo, a missing abbreviation, the smallest detail can disqualify a claim, and then its value will get multiplied hundreds of times in the extrapolation.

On the other hand, it is clear that the auditor is not held to the same standard. Far from it. There is no need to ask if this is fair, because we all know it is not.

Let’s look at this in more detail.

“Plus or Minus”

Small things add up to large things. We know this because it is possible to actually measure statistical work and assess how bad it is. One measure is precision. This is the “plus-or-minus” number.

Polls are statistical extrapolations. “The politician has 45-percent support in the polls, plus or minus 5 percent.” This means the support of the politician is somewhere between 40 and 50 percent, or 45 minus 5 percent and 45 plus 5 percent. This is known as a precision of 5 percent. Using the arcane language of statistics, the 45 percent is the so-called “point estimate.”

But there is another important number. It tells how sure you can be that the precision is plus or minus 5 percent. The standard for this is 95 percent. This means that one can be 95-percent sure that the somewhere between 40 and 50 percent. The term for this is “confidence.” It is fairly standard to use a 95-percent confidence. But the PIM gives much more leeway to the auditors. They can use 90 percent. They need to be only 90-percent sure.

But that is not what happens. Far from it.

We routinely find Medicare auditors handing in extrapolations with precision far worse than 5 percent. They rarely are that precise. In Medicare, precision can be plus or minus 10, 15, 20, 30 percent –  or even worse.

That is somewhere between 25 and 85 percent. But that seems to be good enough for government work.

Effect on Medicare Extrapolations

OK, enough statistics. What does this really mean? In Medicare audits, the extrapolated overpayment amount, the recoupment being demanded, often is a number that is not very accurate. And in some cases, this can mean a very great amount of money, “plus or minus.”

Dangerous Myth

So, what do the auditors and the PIM do about this? They rationalize the imprecision by saying that instead of taking the “point estimate,” they will take the number at the lower range of the confidence. So, they would take the 40 percent in the first example, for the politician, and they would take 25 percent in the last example.

And this is how the ALJs have been told to rationalize sloppy statistical work. They will say something like “well, we can be 90-percent sure that the number is at least this.” And they will tell the healthcare provider that poor precision actually works in their favor.

After all, the worse the precision, the farther and farther the number on the lower side will drop. So everyone should be happy. In a recent case, a statistician hired by the ALJ was responding to complaints that the precision was very poor, somewhere around36 percent. They wrote:

Providers should be happy with poor precision. The more imprecise, the better it is for the provider, because we always ask for the lower bound of the confidence interval.”

And the ALJs go along with this. Do you see what has happened? The Medicare auditing system in the United States has degenerated into an official policy of poor standards for statistical sampling and extrapolations, and although there are guidelines in the PIM for the auditors, they are not required to follow them.

The PIM is Wrong

The problem with all of this is that it is wrong, wrong, wrong. How do we know this? Recently, we developed the mathematical proof that about a third of the time, the true number will be actually lower than the original recoupment demand. So, the PIM is wrong. It is horribly wrong; it is mathematically wrong. And this means that the auditor’s arguments, and the ALJ decisions that accept lousy precision based on this spurious logic, also are wrong. That poor precision works in favor of the provider is a myth, it can be proved to be a myth.

Facebook
Twitter
LinkedIn

Edward M. Roche, PhD, JD

Edward Roche is the director of scientific intelligence for Barraclough NY, LLC. Mr. Roche is also a member of the California Bar. Prior to his career in health law, he served as the chief research officer of the Gartner Group, a leading ICT advisory firm. He was chief scientist of the Concours Group, both leading IT consulting and research organizations. Mr. Roche is a member of the RACmonitor editorial board as an investigative reporter and is a popular panelist on Monitor Mondays.

Related Stories

Leave a Reply

Please log in to your account to comment on this article.

Featured Webcasts

Enhancing Outcomes with CDI-Coding-Quality Collaboration in Acute Care Hospitals

Enhancing Outcomes with CDI-Coding-Quality Collaboration in Acute Care Hospitals

Join Angela Comfort, DBA, MBA, RHIA, CDIP, CCS, CCS-P, as she presents effective strategies to strengthen collaboration between CDI, coding, and quality departments in acute care hospitals. Angela will also share guidance on implementing cross-departmental meetings, using shared KPIs, and engaging leadership to foster a culture of collaboration. Attendees will gain actionable tools to optimize documentation accuracy, elevate quality metrics, and drive a unified approach to healthcare goals, ultimately enhancing both patient outcomes and organizational performance.

November 21, 2024
Comprehensive Inpatient Clinical Documentation Integrity: From Foundations to Advanced Strategies

Comprehensive Outpatient Clinical Documentation Integrity: From Foundations to Advanced Strategies

Optimize your outpatient clinical documentation and gain comprehensive knowledge from foundational practices to advanced technologies, ensuring improved patient care and organizational and financial success. This webcast bundle provides a holistic approach to outpatient CDI, empowering you to implement best practices from the ground up and leverage advanced strategies for superior results. You will gain actionable insights to improve documentation quality, patient care, compliance, and financial outcomes.

September 5, 2024
Advanced Outpatient Clinical Documentation Integrity: Mastering Complex Narratives and Compliance

Advanced Outpatient Clinical Documentation Integrity: Mastering Complex Narratives and Compliance

Enhancing outpatient clinical documentation is crucial for maintaining accuracy, compliance, and proper reimbursement in today’s complex healthcare environment. This webcast, presented by industry expert Angela Comfort, DBA, RHIA, CDIP, CCS, CCS-P, will provide you with actionable strategies to tackle complex challenges in outpatient documentation. You’ll learn how to craft detailed clinical narratives, utilize advanced EHR features, and implement accurate risk adjustment and HCC coding. The session also covers essential regulatory updates to keep your documentation practices compliant. Join us to gain the tools you need to improve documentation quality, support better patient care, and ensure financial integrity.

September 12, 2024

Trending News

Featured Webcasts

Patient Notifications and Rights: What You Need to Know

Patient Notifications and Rights: What You Need to Know

Dr. Ronald Hirsch provides critical details on the new Medicare Appeal Process for Status Changes for patients whose status changes during their hospital stay. He also delves into other scenarios of hospital patients receiving custodial care or medically unnecessary services where patient notifications may be needed along with the processes necessary to ensure compliance with state and federal guidance.

December 5, 2024
Navigating the No Surprises Act & Price Transparency: Essential Insights for Compliance

Navigating the No Surprises Act & Price Transparency: Essential Insights for Compliance

Healthcare organizations face complex regulatory requirements under the No Surprises Act and Price Transparency rules. These policies mandate extensive fee disclosures across settings, and confusion is widespread—many hospitals remain unaware they must post every contracted rate. Non-compliance could lead to costly penalties, financial loss, and legal risks.  Join David M. Glaser Esq. as he shows you how to navigate these regulations effectively.

November 19, 2024
Post Operative Pain Blocks: Guidelines, Documentation, and Billing to Protect Your Facility

Post Operative Pain Blocks: Guidelines, Documentation, and Billing to Protect Your Facility

Protect your facility from unwanted audits! Join Becky Jacobsen, BSN, RN, MBS, CCS-P, CPC, CPEDC, CBCS, CEMC, and take a deep dive into both the CMS and AMA guidelines for reporting post operative pain blocks. You’ll learn how to determine if the nerve block is separately codable with real life examples for better understanding. Becky will also cover how to evaluate whether documentation supports medical necessity, offer recommendations for stronger documentation practices, and provide guidance on educating providers about documentation requirements. She’ll include a discussion of appropriate modifier and diagnosis coding assignment so that you can be confident that your billing of post operative pain blocks is fully supported and compliant.

October 24, 2024
The OIG Update: Targets and Tools to Stay in Compliance

The OIG Update: Targets and Tools to Stay in Compliance

During this RACmonitor webcast Dr. Ronald Hirsch spotlights the areas of the OIG’s Work Plan and the findings of their most recent audits that impact utilization review, case management, and audit staff. He also provides his common-sense interpretation of the prevailing regulations related to those target issues. You’ll walk away better equipped with strategies to put in place immediately to reduce your risk of paybacks, increased scrutiny, and criminal penalties.

September 19, 2024

Trending News

Happy National Doctor’s Day! Learn how to get a complimentary webcast on ‘Decoding Social Admissions’ as a token of our heartfelt appreciation! Click here to learn more →