Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter December 2, 2022

Definitions and major prerequisites of direct and indirect approaches for estimating reference limits

  • Rainer Haeckel ORCID logo EMAIL logo , Khosrow Adeli , Graham Jones , Ken Sikaris and Werner Wosniok

Abstract

Reference intervals are established either by direct or indirect approaches. Whereas the definition of direct is well established, the definition of indirect is still a matter of debate. In this paper, a general definition that covers all indirect models presently in use is proposed. With the upcoming popularity of indirect models, it has become evident that further partitioning strategies are required to minimize the risk of patients’ false classifications. With indirect methods, such partitions are much easier to execute than with direct methods. The authors believe that the future of reference interval estimation belongs to indirect models with big data pools either from one laboratory or combined from several regional centres (if necessary). Independent of the approach applied, the quality assurance of the pre-analytical and analytical phase, considering biological variables and other confounding factors, is essential.


Corresponding author: Rainer Haeckel, Bremer Zentrum für Laboratoriumsmedizin, Klinikum Bremen Mitte, Bremen, Germany, Phone: +49 421 273446, E-mail:

Acknowledgments

The data presented in Figure 1 were gratefully provided by Dr. Alexander Krebs, Labor Volkmann, Karlsruhe, Germany.

  1. Research funding: None declared.

  2. Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.

  3. Competing interests: Authors state no conflict of interest.

  4. Informed consent: Not applicable.

  5. Ethical approval: Not applicable.

References

1. Clinical Laboratory Standard Institute Guideline C28-A3. Defining, establishing, and verifying reference intervals in the clinical laboratory; approval guideline, 3rd ed. Wayne, PA, USA: CLSI; 2010.Search in Google Scholar

2. Sikaris, K. Physiology and its importance for reference intervals. Clin Biochem Rev 2014;35:3–14.Search in Google Scholar

3. Jones, GRD, Haeckel, R, Loh, TP, Sikaris, K, Streichert, T, Katayev, A, et al.. Indirect methods for reference interval determination – review and recommendations. Clin Chem Lab Med 2019;57:20–9. https://doi.org/10.1515/cclm-2018-0073.Search in Google Scholar PubMed

4. Farrell, CJL, Nguyen, L. Indirect reference intervals: harnessing the power of stored laboratory data. Clin Biochem Rev 2019;40:99–111.10.33176/AACB-19-00022Search in Google Scholar

5. Haeckel, R, Wosniok, W, Streichert, T. Review of potentials and limitations of indirect approaches for estimating reference limits of quantitative procedures in laboratory medicine. J Lab Med 2021;45:35–53. https://doi.org/10.1515/labmed-2020-0131.Search in Google Scholar

6. Özarda, Y, Ichihara, K, Jones, G, Streichert, T, Ahmadian, R. Comparison of reference intervals derived by direct and indirect methods based on compatible datasets obtained in Turkey. Clin Chim Acta 2021;520:186–95. https://doi.org/10.1016/j.cca.2021.05.030.Search in Google Scholar PubMed

7. Den Elzen, WPJ, Brouwer, N, Thelen, MH, Le Cessie, S, Haagen, IA, Colbert, CM. NUMBER: standardized reference intervals in The Netherlands using a ‘big-data’ approach. Clin Chem Lab Med 2019;57:42–56. https://doi.org/10.1515/cclm-2018-0462.Search in Google Scholar PubMed

8. Marques-Garcia, F, Nieto-Librero, A, Gonzales-Garcia, N, Galindo-Villardon, P, Martinez-Sanchez, LM, Tijedor-Gandoxé, X, et al.. Within-subject biological variation estimates using an indirect data mining strategy. Clin Chem Lab Med 2022;60:1804–12.10.1515/cclm-2021-0863Search in Google Scholar PubMed

9. Hickman, PA, Koerbin, G, Potter, JM, Abhayaratna, WP. Statistical consideration for determining high-sensitivity cardiac troponin reference intervals. Clin Biochem 2017;50:502–5. https://doi.org/10.1016/j.clinbiochem.2017.02.022.Search in Google Scholar PubMed

10. Hoffmann, RG. Statistics in the practice of medicine. JAMA 1963;185:864–73. https://doi.org/10.1001/jama.1963.03060110068020.Search in Google Scholar PubMed

11. Katayev, A, Balciza, C, Seccombe, DW. Establishing reference intervals for clinical laboratory test results; is there a better way? Am J Clin Pathol 2010;133:175–7. https://doi.org/10.1309/ajcpn5bmtsf1cdyp.Search in Google Scholar PubMed

12. Katayev, A, Fleming, JK, Luo, D, Fisher, AH, Sharp, TM. Reference intervals data mining. No longer a probability paper method. Am J Clin Pathol 2015;143:134–42. https://doi.org/10.1309/ajcpqprnib54wfkj.Search in Google Scholar

13. Bhattacharya, CG. A simple method of resolution of a distribution into Gaussian components. Biometrics 1967;23:115–35. https://doi.org/10.2307/2528285.Search in Google Scholar

14. Baadenhuijsen, H, Smit, JC. Indirect estimation of clinical chemistry reference intervals from total hospital patient data: application of a modified Bhattacharaya procedure. J Clin Chem Clin Biochem 1985;23:829–39.10.1515/cclm.1985.23.12.829Search in Google Scholar

15. Arzideh, F, Brandhorst, G, Gurr, E, Hinsch, W, Hoff, T, Roggenbuck, L, et al.. An improved indirect approach for determining reference limits from intra-laboratory data bases exemplified by concentrations of electrolytes. J Lab Med 2009;33:52–66. https://doi.org/10.1515/jlm.2009.015.Search in Google Scholar

16. Wosniok, W, Haeckel, R. A new indirect estimation of reference intervals: truncated minimum chi-square (TMC) approach. Clin Chem Lab Med 2019;57:1933–47. https://doi.org/10.1515/cclm-2018-1341.Search in Google Scholar PubMed

17. Zierk, J, Arzideh, F, Kapsner, LA, Prokosch, HU, Metzler, M, Rauh, M. Reference interval estimation from mixed distributions using truncation points and the Kolmogorow–Smirnow distance (kosmic). Sci Rep 2020;10:1704. https://doi.org/10.1038/s41598-020-58749-2.Search in Google Scholar PubMed PubMed Central

18. Ammer, T, Schützenmeier, A, Prokosch, HU, Rauh, M, Rank, CM, ZierkRefine, JR. A novel algorithm for reference interval estimation from real world data. Sci Rep 2021;11:16023. https://doi.org/10.1038/s41598-021-95301-2.Search in Google Scholar PubMed PubMed Central

19. Özcürümez, MK, Haeckel, R. Biological variables influencing the estimation of reference limits. Scand J Clin Invest Lab Med 2018;78:337–45. https://doi.org/10.1080/00365513.2018.1471617.Search in Google Scholar PubMed

20. Haeckel, R, Wosniok, W, Arzideh, F. Equivalence limits of reference limits for partitioning of population data. Relevant differences of reference intervals. J Lab Med 2016;40:199–205. https://doi.org/10.1515/labmed-2016-0002.Search in Google Scholar

21. Holmes, DT, Buhr, KA. Widespread incorrect implementation of the Hoffmann method, the correct approach, and modern alternatives. Am J Clin Pathol 2019;151:328–36. https://doi.org/10.1093/ajcp/aqy149.Search in Google Scholar PubMed

22. Ammer, T, Schützenmeier, A, Prokosch, HU, Zierk, J, Rank, CM, RIbench, RM. A proposed benchmark for the standardized evaluation of indirect methods for reference interval estimation. Clin Chem 2022;68:1410–24. https://doi.org/10.1093/clinchem/hvac142.Search in Google Scholar PubMed

23. Tan, RZ, Markus, C, Vasikaran, S, Loh, TP. Comparison of 8 methods for univariate statistical exclusion of pathological subpopulations for indirect reference intervals and biological variation studies. Clin Biochem 2022;103:16–24. https://doi.org/10.1016/j.clinbiochem.2022.02.006.Search in Google Scholar PubMed

24. Haeckel, R, Wosniok, W, Torge, A, Junker, R. Reference limits of high-sensitive cardiac troponin T indirectly estimated by a new approach applying data mining. A special example for measurands with a relatively high percentage of values at or below the detection limit. J Lab Med 2021;45:87–94. https://doi.org/10.1515/labmed-2020-0063.Search in Google Scholar

Received: 2022-10-20
Accepted: 2022-11-23
Published Online: 2022-12-02
Published in Print: 2023-02-23

© 2022 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 27.4.2024 from https://www.degruyter.com/document/doi/10.1515/cclm-2022-1061/html
Scroll to top button