-
J Ment Health Policy Econ · Dec 2002
Consistency in performance evaluation reports and medical records.
- Mingshan Lu and Ching-to Albert Ma.
- Department of Economics, University of Calgary, 2500 University Drive, NW, Calgary, AB, Canada, T2N 1N4. lu@ucalgary.ca
- J Ment Health Policy Econ. 2002 Dec 1; 5 (4): 141-52.
BackgroundIn the health care market managed care has become the latest innovation for the delivery of services. For efficient implementation, the managed care organization relies on accurate information. So clinicians are often asked to report on patients before referrals are approved, treatments authorized, or insurance claims processed. What are clinicians responses to solicitation for information by managed care organizations? The existing health literature has already pointed out the importance of provider gaming, sincere reporting, nudging, and dodging the rules.Aims Of The StudyWe assess the consistency of clinicians reports on clients across administrative data and clinical records.MethodsFor about 1,000 alcohol abuse treatment episodes, we compare clinicians reports across two data sets. The first one, the Maine Addiction Treatment System (MATS), was an administrative data set; the state government used it for program performance monitoring and evaluation. The second was a set of medical record abstracts, taken directly from the clinical records of treatment episodes. A clinician s reporting practice exhibits an inconsistency if the information reported in MATS differs from the information reported in the medical record in a statistically significant way. We look for evidence of inconsistencies in five categories: admission alcohol use frequency, discharge alcohol use frequency, termination status, admission employment status, and discharge employment status. Chi-square tests, Kappa statistics, and sensitivity and specificity tests are used for hypothesis testing. Multiple imputation methods are employed to address the problem of missing values in the record abstract data set.ResultsFor admission and discharge alcohol use frequency measures, we find, respectively, strong and supporting evidence for inconsistencies. We find equally strong evidence for consistency in reports of admission and discharge employment status, and mixed evidence on report consistency on termination status. Patterns of inconsistency may be due to both altruistic and self-interest motives.Discussion And LimitationsPayment contracts based on performance may be subject to provider mis-reporting, which could seriously undermine its purpose. However, further analysis is needed to determine how much of the inconsistencies observed are results of clinician gaming in reporting.Implications For Health PolicyIncreasing system accountability is becoming more and more important for health care policy makers. Results of this study will lead to a better understanding of physician reporting behavior.Implications For Future ResearchOur work in this paper on the data sets confirms the statistical significance of strategic reporting in alcohol addiction treatment. It will be of interest to confirm our finding in other data sets. Our on-going research will model the motives behind strategic reporting. We will hypothesize that both altruistic and financial incentives are present. Our empirical identification strategy will use Maine s Performance-Based Contracting system and client insurance sources to test how these incentives affect the direction of clinician s strategic reporting.
Notes
Knowledge, pearl, summary or comment to share?You can also include formatting, links, images and footnotes in your notes
- Simple formatting can be added to notes, such as
*italics*
,_underline_
or**bold**
. - Superscript can be denoted by
<sup>text</sup>
and subscript<sub>text</sub>
. - Numbered or bulleted lists can be created using either numbered lines
1. 2. 3.
, hyphens-
or asterisks*
. - Links can be included with:
[my link to pubmed](http://pubmed.com)
- Images can be included with:
![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
- For footnotes use
[^1](This is a footnote.)
inline. - Or use an inline reference
[^1]
to refer to a longer footnote elseweher in the document[^1]: This is a long footnote.
.