Abstract
Objectives
In laboratory medicine, external quality assessment (EQA) schemes have become versatile tools for detecting analytical flaws. However, EQA schemes are lacking for pediatric sex steroid levels. We aimed to investigate the suitability of different estradiol and testosterone immunoassays in a pediatric setting in comparison with clinical liquid chromatography-tandem mass spectrometry (LC-MS/MS) assays.
Methods
The study was conducted by staff and the advisory group on endocrinology at Equalis, the Swedish provider of EQA schemes for laboratory medicine. The test material consisted of five pooled serum samples from children who were either prepubertal or in puberty. Clinical laboratories enrolled in Equalis EQA schemes for estradiol and testosterone were invited to participate, as were clinical laboratories using LC-MS/MS-assays. Samples were analyzed by either routine immunoassays (n=18) or in-house LC-MS/MS assays (n=3).
Results
For estradiol, LC-MS/MS assays showed a high degree of conformity with interlaboratory coefficients of variation (CV) below 24.2 %. Reported levels were between 4.9 ± 1.2 and 33.9 ± 1.6 pmol/L (group mean ± standard deviation). The direct immunoassays had lower precision; their CVs were up to 81.4 %. Reported concentrations were between 25.3 ± 18.1 and 45.7 ± 19.4 pmol/L, an overestimation compared to LC-MS/MS. Testosterone LC-MS/MS also showed a high degree of conformity, CVs were below 13.4 %, and reported concentrations were from 0.06 ± 0.00 to 1.00 ± 0.11 nmol/L. The direct immunoassays had a larger discrepancy between results; CVs were up to 95.8 %. Concentrations were between 0.12 ± 0.11 and 0.85 ± 0.23 nmol/L.
Conclusions
For the safe diagnosis and determination of sex steroids in children, analysis with mass spectrometry-based methods is recommended.
Introduction
Sex steroid determinations are invaluable tools in the investigation and treatment of adrenal and sex development disorders in children. Therefore, specific, sensitive and quantitative assays are of crucial importance. Based on studies primarily using samples from adults, a growing amount of evidence indicates a significant analytical bias of sex steroid immunoassays in the lower concentration ranges [1], [2], [3], [4], [5], [6]. There is a need for a more elaborate approach to the problem with regard to different assays. Moreover, there is a lack of awareness concerning the flaws in immunoassays and what reasonable hormone levels are in children.
Most clinical laboratory methods used today for the determination of sex steroids are commercially available chemiluminescent immunoassays (CLIA) that use patient sera that has not been pretreated or purified. These methods have the advantages of being user-friendly, suitable for high throughput automated platforms and capable of fast turnaround times. For the most part, they are designed for fertility investigations in adults and are not validated to quantify the low levels of sex steroids found in prepubertal children, which typically are 100 times lower [7, 8]. Immune-based methods without sample pre-extraction generally do not quantify estradiol below 50–100 pmol/L or testosterone below 1–3 nmol/L with acceptable reproducibility [1], [2], [3], [4, 9]. Since external quality assessment (EQA) schemes for pediatric samples are not commonly available, the analytical problems associated with different types of assays are likely to be very hard to detect for many clinical laboratories, and the problems might be underestimated. With that background, along with recently published pediatric reference intervals for estradiol and testosterone performed by CLIA, one may question the relevance of those references.
Since the late 1990s, clinical practitioners in Sweden have had access to sensitive assays in terms of an extraction estradiol radio-immunoassay (RIA) and a sensitive testosterone-RIA together with sex- and puberty-specific reference intervals adopted in-house and validated at a specialist laboratory [10], [11], [12], [13]. In the last decade, sensitive in-house-developed clinical assays for sex steroid determinations based on liquid chromatography-tandem mass spectrometry (LC-MS/MS) have become more available and are now generally considered golden-standard assays for many steroid hormones. These assays have technical advantages that significantly improve the analytical selectivity required for differentiation between closely structurally related steroids. Moreover, visual presentation of results in the form of chromatograms allows detecting possible analytical interferences.
The aim of this study was to investigate the suitability of different estradiol and testosterone immunoassays to quantify levels of these hormones in a pediatric setting, and to compare the analytical performance of the immunoassays to available validated clinical LC-MS/MS-assays. The study is based on results from a national distribution of serum samples from children via Equalis, the Swedish provider of EQA schemes for laboratory medicine.
Materials and methods
Samples
This method comparison study was conducted by staff and the advisory group on endocrinology at Equalis AB, Uppsala, Sweden in August 2020. The test material consisted of five pooled serum samples from children 4–18 years of age, without any additives. In each material, about 30 left-over samples, either from prepubertal children (samples A and E), boys in early puberty (sample B), girls in early-mid puberty (sample C) or boys in early-mid puberty (sample D), were pooled together.
The sera were left-over samples from hormone determinations at Tillväxtlaboratoriet, Gothenburg, Sweden. The deidentified samples were stored at −20 °C for a maximum of three months and sent frozen in Falcon tubes (Sarstedt) to Equalis AB, Uppsala, Sweden. After being divided into 1 mL aliquots, samples were sent to participants in polypropylene micro tubes (Sarstedt) at 21 °C (±1 °C), to participants. Stability tests were conducted in previous studies. Evaluation showed that serum sex steroids were not affected by storage at 21 °C (±1 °C) for three days, in +2 to +8 °C for up to three weeks, long-term storage in −20 °C or repeated thaw/freeze cycles [12, 13].
Methods
Clinical laboratories in Sweden enrolled in the Equalis EQA scheme were invited to participate in a specially composed EQA round (Article number: KSP 014; Round 2020:01). Participants were informed that the samples were pooled from patient plasma, but not that the samples were derived from children. They were instructed to analyze the samples according to their normal routine procedures either within three days if stored at +2 to +8 °C, or within 16 days if stored in a freezer.
Participants analyzed the external quality controls either by using commercially available CLIAs (n=17) or RIA (with in-house pre-extraction for estradiol, n=1). In addition, clinical laboratories that had a validated in-house LC-MS/MS-assay were asked to analyze the samples in both their CLIA and LC-MS/MS-assay (n=3).
After determining estradiol and testosterone concentrations, participants registered the data with Equalis, where it was compiled and the analytical performance was reported back to the participants.
For estradiol and testosterone determinations most participants used Modular E & cobas e601/e602/e801 from Roche Diagnostics. Further information on the instruments used in the comparison study is depicted in Table 1A and 1B.
Instrument, manufacturer | Estradiol, pmol/L | ||||
---|---|---|---|---|---|
Assay range | Analytical sensitivity/LLOD according to manufacturer | Functional sensitivitya/LLOQ according to manufacturer | [Source] Female pediatric reference intervals |
[Source] Male pediatric reference intervals |
|
Abbott Alinity i, Abbott Diagnostics, Chicago, IL, USA | 88–3,670 | 73 | 88 | [Konforte et al. 2013 [25]; Bohn et al. 2021 [29]]; TS 1: <73 TS 2: <95 TS 3: <315 TS 4: 48–517 TS 5: 70–763 |
[Konforte et al. 2013 [25]; Bohn et al. 2021 [29]]; TS 1: <70 TS 2: <66 TS 3: <77 TS 4: <128 TS 5: 62–125 |
Beckman UniCel DxI 800, Beckman Coulter AB, Brea, CA, USA | 55.1–19,089 | 55.1 | 69.7 | [Karbasy et al. 2016 [26]]; 1–<12 years: <73 12–<19 years: <73–728 |
[Karbasy et al. 2016 [26]]; 1–<12 years: <73 12–<19 years: <73–157 |
Cobas Roche e601/e801 analyzer series and e411 analyzer, Roche Diagnostics, Mannheim, Germany | 18.4–11,010 | 18.4 | 91.8b | [Zec et al. 2012 [24]]; 4–<8 years: <18–167 8–<11 years: <18–169 [Bohn et al. 2019 [28]]; 1 m–<10 years: <18 10–<14 years: <18-250 1–<19 years: 54-91 |
[Zec et al. 2012 [24]]; 1–<11 years: <18–96 [Bohn et al. 2019 [28]]; 1 m–<10 years: <18 10–<19 years: <18–134 |
Advia Centaur, Siemens Healthineers, Tarrytown, NY, USA | 43.6–11,010 | 43.6 | 69.8 | [Lab’s website]; TS 1: < 230 TS 2–4: < 800 TS 5: 80–1,100 |
[Lab’s website]; TS 1–2: < 110 TS 3–4: < 200 TS 5: < 250 |
Ortho Vitros 3,600, Ortho Clinical Diagnostics, Raritan, NJ, USA | 23.4–14,000 | 23.4 | No information | [Higgins et al. 2018 [27]]; 1 m–<6 years: <23–177 6–<11 years:<23–68 11–<15 years: 68–344 15–<19 years: 45–663 |
[Higgins et al. 2018 [27]]; 1 m –<6 years: <23–177 6–<11 years:<23–68 11–<15 years: 25–145 15–<19 years: 48–144 |
In-house extraction-CT RIA, Cisbio bioassays, Montpellier, France | 7.5–750 | 4c | 6c | [Norjavaara et al. 1996 [10]; Ankarberg-Lindgren et al. 2013 [23]]; 0800–1200 h; TS 1:<7 TS 1–2: 7–25 TS 2: 25–45 TS 2–3: 45–75 TS 3–4 before menarche: 75–300 |
[Ankarberg-Lindgren et al. 2008 [13]; Ankarberg-Lindgren et al. 2013 [23]]; 0800–1200 h; Testis: 1–2 mL: ≤9 Testis: 3–6 mL: ≤13 Testis: 8–12 mL: 5–50 Testis: 15–25 mL: 16–63 |
-
h, hours; LLOD, lower limit of detection; LLOQ, lower limit of quantification; m, months; TS, tanner stage. aFunctional sensitivity defined as the lowest analyte concentration that can be reproducibly measured with an intermediate precision CV less than or equal to 20 %. bTotal allowable error of ≤30 %. cAccording to in-house validation.
Instrument, manufacturer | Testosterone, nmol/L | ||||
---|---|---|---|---|---|
Assay range | Analytical sensitivity/LLOD according to manufacturer | Functional sensitivitya/LLOQ according to manufacturer | [Source] Female pediatric reference intervals |
[Source] Male pediatric reference intervals |
|
Abbott Alinity i, Abbott Diagnostics, Chicago, IL, USA | 0.15–64.6 | 0.05 | 0.06 | [Konforte et al. 2013 [25]; Bohn et al. 2021 [29]]; TS 1: <0.67 TS 2: <0.69 TS 3: <1.5 TS 4: 0.31–1.4 TS 5: 0.13–1.7 |
[Konforte et al. 2013 [25]; Bohn et al. 2021 [29]]; TS 1: <0.62 TS 2: <0.85 TS 3: <18.9 TS 4: 0.30–22.1 TS 5: 3.5–26.4 |
Beckman UniCel DxI 800, Beckman Coulter AB, Brea, CA, USA | 0.35–55.5 | 0.35 | 1.7 | Karbasy et al. 2016 [26]]; 1.5–<7 years: ≤0.35 7–<9 years: <0.35–0.62 9–<12 years: <0.35–1.6 12–15 years: 0.35–2.3 15–<19 years: 0.62–3.0 |
[Karbasy et al. 2016 [26]]; 1.5–<7 years: ≤0.35 7–<9 years: <0.35–0.62 9–<12 years: <0.35–1.6 12–<19 years: 0.38–19.6 |
Cobas Roche e601/e801 analyzer series and e411 analyzer, Roche Diagnostics, Mannheim, Germany | 0.087–52 | 0.087 | 0.416 | [Lab’s website]b; 6–18 years; TS 1: <0.42 TS 2: <0.42 TS 3: <0.42–0.8 TS 4: <0.42–0.9 TS 5: <0.42–1.4 [Bohn et al. 2019 [28]]; 6 m–<11 years: <0.1 11–<19 years:<0.1–1.8 |
[Lab’s website]b; 6–18 years; TS 1: <0.42 TS 2: <0.42–15.0 TS 3: 2.3–27.0 TS 4: 6.2–26.0 TS 5: 6.5–31.0 [Bohn et al. 2019 [28]]; 6 m–<11 years: <0.1 11–<15 years: <0.1–20 15–<19 years: 1.7–27.0 |
Advia Centaur, Siemens Healthineers, Tarrytown, NY, USA | 0.24–52.1 | 0.17 | 0.24 | [Manufacturer’s website [35]]; TS 1: <0.24–3.1 TS 2: <0.24–1.3 TS 3: <0.24–1.2 TS 4: <0.24–1.3 TS 5: 0.38–1.7 |
[Manufacturer’s website [35]]; TS 1: <0.24–1.7 TS 2: <0.24–6.1 TS 3: 0.37–27.9 TS 4: 2.2–25.6 TS 5: 1.9–31.1 |
Ortho Vitros 3,600, Ortho Clinical Diagnostics, Raritan, NJ, USA | 0.17–75 | 0.17 | No information | [Higgins et al. 2018 [27]]; 6 m–<12 years: <0.17–1.6 12–<19 years: 0.53–2.2 |
[Higgins et al. 2018 [27]]; 6 m–<12 years: <0.17–1.6 12–<15 years: 0.36–24.9 15–<19 years: 4.1–27.1 |
CT RIA, Cisbio bioassays, Montpellier, France | 0.04–40 | 0.03c | 0.1c | [Ankarberg et al. 1999 [11]; Ankarberg-Lindgren et al. 2013 [23]]; 0800–1000 h; TS 1–2: ≤0.6 TS 2: 0.3–1.0 TS 3–5 up to 1 year post menarche: 0.3–1.4 |
[Ankarberg-Lindgren et al. 2004 [12]; Ankarberg-Lindgren et al. 2013 [23]]; 0800–1000 h; Testis: 1–2 mL: ≤0.5 Testis: 3–6 mL: 0.4–3.2 Testis: 8–12 mL: 2.3–17.0 Testis: 15–25 mL: 9.9–25.9 |
-
h, hours; LLOD, lower limit of detection; LLOQ, lower limit of quantification; m, months; TS, Tanner stage. aFunctional sensitivity defined as the lowest analyte concentration that can be reproducibly measured with an intermediate precision CV less than or equal to 20 %. bConsistent puberty-specific reference intervals in relation to Tanner stages were reported by two laboratories. Another three laboratories reported reference intervals divided into age groups, data not shown. cAccording to in-house validation.
The method validation data obtained for the three different LC-MS/MS instruments provided by the laboratories are summarized in Table 2. Further detailed information for laboratory 1 has been published elsewhere [14].
Estradiol, pmol/L | Testosterone, nmol/L | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Instrument, manufacturer | Calibrators/internal standard | Assay range | LLOD/LLOQ | Total precision | [Source] Pediatric reference intervals | Calibrators/internal standard | Assay range | LLOD/LLOQ | Total precision | [Source] pediatric reference intervals |
Xevo TQ-XS, waters, Milford, MA, USA (Laboratory 1) | Cerilliant certified materials, Sigma- Aldrich, prepared in-house, Saint Louis, MO, USA | 7–3520 | LLOD: not determined LLOQ: 7 |
4.3 % at 21.7 | Lacking | Cerilliant certified materials, Sigma- Aldrich, prepared in-house, Saint Louis, MO, USA | 0.04–20 | LLOD: not determined LLOQ: 0.04 |
1.85 % at 0.87 | Lacking |
Xevo TQ-S, Waters, Milford, MA, USA (Laboratory 2) |
Sigma- Aldrich, prepared in-house, Saint Louis, MO, USA | 10–2000 | LLOD: 4 LLOQ: 10 |
11 % at 30 | Lacking | Cerilliant certified materials, Sigma- Aldrich, prepared in-house, Saint Louis, MO, USA | 0.1–100 | LLOD: 0.06 LLOQ: 0.1 |
8 % at 0.1 | [Lab’s website]; Males: 0–9 years: 0.1–1.0 13–14 years: 0.2–22 15–16 years: 1.4–30 17–19 years: 4.2–30. Females: 0–5 years: 0.1–0.4 6–9 years: 0.2–0.5 10–18 years: 0.5–1.8 |
5500 QTrap, AB Sciex, Framingham, MA, USA (Laboratory 3) | Sigma- Aldrich, prepared in-house, Saint Louis, MO, USA | 5.5–587 | LLOD: 3 | 9 % at 12 | [Lab’s website]; Females: TS 1: <10 TS 2: 9–30 TS 3–4: 44–100 TS 3–5: 74–154 Males: Pre puberty: <6 Early: <9 Mid: 5–14 Late: 15–47 |
Cerilliant certified materials, Sigma- Aldrich, prepared in-house, Saint Louis, MO, USA | 0.01–1.65 | LLOD: 0.002 | 3 % at 0.34 | Lacking |
-
LLOD, lower limit of detection; LLOQ, lower limit of quantification; TS, Tanner stage. Additional information on the mass spectrometric assays: Extraction methods; Laboratory 1 used SLE plates (Biotage) and methyl tert-butyl ether in heptane, Laboratory 2 used SLE plates (Biotage) and ethyl acetate in heptane, Laboratory 3 used liquid-liquid extraction using tert-butyl ethyl ether. Analytical columns used; Laboratory 1 used XBridge C8 3.5 µm, 2.1 × 50 mm followed by Kinetex Biphenyl 2.6 µ, 2.1 × 100 mm, Laboratory 2 used XBridge C8 3.5 µm, 2.1 × 50 mm followed by BEH Phenyl 1.7 µm, 2.1 × 100 mm, Laboratory 3 used Zorbax Eclipse XDB-CN, 2.1 × 50 mm, 5 µm followed by Kinetex EVO C18, 50 × 2.1 mm, 2.6 µm. Mobil phases; All Laboratories used deionized water/methanol with ammonium fluoride as an additive. Internal standards; All Laboratories used 13C3 labelled internal standards except Laboratory 2 which used D4 Estradiol as internal standard for estradiol.
Data analysis
For evaluation purposes, the data in this study was primarily analyzed in alternative/additional approaches other than the EQA schemes that use ISO 13528:2015 (statistical methods for use in proficiency testing by interlaboratory comparison). Three approaches to immunoassay performance evaluation were applied. Absolute bias in relation to LC-MS/MS was calculated and graphically presented in a Bland-Altman plot. Relative bias was calculated as relative bias (%) = (immunoassay concentration – LC-MS/MS concentration) × 100/LC-MS/MS concentration. Acceptable imprecision between methods was defined as 20 %, in accordance with criteria used in international EQA schemes for these analyses. Data results within each method group were presented as mean, median, standard deviation (SD) and coefficient of variation (CV). The CLIAs Ortho Vitros, Roche Cobas and Siemens Advia Centaur registered some of their results as <reporting limit. For evaluation purposes, the results of those laboratories that reported results <reporting limit were assigned the values of reporting limit −1.0 pmol/L for estradiol and reporting limit −0.01 nmol/L for testosterone. In addition, results were calculated when outliers and results below the reporting limit were omitted.
Results
Nineteen out of twenty-one invited clinical laboratories in Sweden participated in this explorative external control round focusing on sera from children, including two sera from children without signs of puberty and three sera from children with early signs of pubertal development. Three laboratories reported results from LC-MS/MS-based methods for both estradiol and testosterone. Of these three laboratories, all also reported estradiol results with CLIA, while only one reported testosterone. The number of users for each instrument and their respective reporting limits are summarized in Table 3.
Instrument, manufacturer | Estradiol | Testosterone | ||
---|---|---|---|---|
Reporting limit, pmol/L | Number of users | Reporting limit, nmol/L | Number of users | |
Abbott Alinity i, Abbott Diagnostics, Chicago, IL, USA | 75 | 1 | Not reported | 1 |
Beckman UniCel DxI 800, Beckman Coulter AB, Brea, CA, USA | Not reported | 2 | Not reported | 2 |
Cobas Roche e601/e801 analyzer series and e411 analyzer, Roche Diagnostics, Mannheim, Germany | 18 | 10 | 0.09 | 11 |
Advia Centaur, Siemens Healthineers, Tarrytown, NY, USA | 43 | 2 | 0.24 | 1 |
Ortho Vitros 3,600, Ortho Clinical Diagnostics, Raritan, NJ, USA | 50 | 1 | 0.5 | 1 |
(In-house extraction-) CT RIA, Cisbio bioassays, Montpellier, France | 4 | 1 | 0.03 | 1 |
-
EQA, external quality assessment.
Estradiol
The results for estradiol quantified by LC-MS/MS are shown in Figure 1A and Table 4. The LC-MS/MS assays showed a high degree of conformity at the following measured levels (mean ± SD); 4.9 ± 1.2 pmol/L, CV 24.2 %; 8.5 ± 1.3 pmol/L, CV 15.3 %; 9.4 ± 1.0 pmol/L, CV 10.7 %; 16.6 ± 0.6 pmol/L, CV 3.3 %; 33.9 ± 1.6 pmol/L, CV 4.7 % for samples E, A, B, D and C, respectively. Thus, in the analytical range of 9–34 pmol/L, the concentrations determined with the three different assays deviated no more than ±11 %. However, for the two sera with the lowest concentration, the relative bias was greater and represented concentrations close to and below the lower limit of quantitation (LLOQ) in the LC-MS/MS assays. Only one of the LC-MS/MS assays were presented with pediatric reference intervals.
Component | Method group | Number of participants | Number of results below reporting limita | Mean | Median | SD | CV% |
---|---|---|---|---|---|---|---|
S-Estradiol, pmol/L | |||||||
|
|||||||
Sample A | LC-MS/MS | 3 | 0 | 8.5 | 8.5 | 1.3 | 15.3 |
Extraction-RIA | 1 | 0 | 11.3 | 11.3 | |||
All CLIA | 17 | 5 | 32.6 | 27.9 | 25.3 | 77.5 | |
CLIA results below reported limit and outliers omitted | 11 | 28.9 | 28.4 | 11.9 | 41.3 | ||
Sample B | LC-MS/MS | 3 | 0 | 9.4 | 9.5 | 1.0 | 10.7 |
Extraction-RIA | 1 | 0 | 6.6 | ||||
All CLIA | 17 | 6 | 27.6 | 19.3 | 18.8 | 68.1 | |
CLIA results below reported limit and outliers omitted | 10 | 22.4 | 20.0 | 10.6 | 47.2 | ||
Sample C | LC-MS/MS | 3 | 0 | 33.9 | 34.0 | 1.6 | 4.7 |
Extraction-RIA | 1 | 0 | 37.8 | ||||
CLIA | 17 | 2 | 45.7 | 48.5 | 19.4 | 42.5 | |
CLIA results below reported limit and outliers omitted | 14 | 44.4 | 47.1 | 16.2 | 36.4 | ||
Sample D | LC-MS/MS | 3 | 0 | 16.6 | 16.6 | 0.6 | 3.3 |
Extraction-RIA | 1 | 0 | 15.1 | ||||
CLIA | 17 | 5 | 32.8 | 23.5 | 26.7 | 81.4 | |
CLIA results below reported limit and outliers omitted | 11 | 29.2 | 23.5 | 17.1 | 58.7 | ||
Sample E | LC-MS/MS | 3 | 1 | 4.9 | 4.5 | 1.2 | 24.2 |
Extraction-RIA | 1 | 0 | 13.8 | ||||
CLIA | 17 | 7 | 25.3 | 18.4 | 18.1 | 71.6 | |
CLIA results below reported limit and outliers omitted | 9 | 18.9 | 18.4 | 8.0 | 42.3 | ||
|
|||||||
S-Testosterone, nmol/L | |||||||
|
|||||||
Sample A | LC-MS/MS | 3 | 0 | 0.19 | 0.20 | 0.02 | 10.8 |
Immuno-based methods | 17 | 7 | 0.11 | 0.09 | 0.05 | 46.1 | |
CLIA results below LOD omitted | 10 | 0.14 | 0.11 | 0.08 | 59.3 | ||
Sample B | LC-MS/MS | 3 | 0 | 0.62 | 0.65 | 0.08 | 13.4 |
Immuno-based methods | 17 | 0 | 0.46 | 0.47 | 0.12 | 26.9 | |
Sample C | LC-MS/MS | 3 | 0 | 1.00 | 1.01 | 0.11 | 11.0 |
Immuno-based methods | 17 | 0 | 0.85 | 0.80 | 0.23 | 27.3 | |
Sample D | LC-MS/MS | 3 | 0 | 0.99 | 0.99 | 0.11 | 10.6 |
Immuno-based methods | 17 | 0 | 0.80 | 0.74 | 0.28 | 34.7 | |
Sample E | LC-MS/MS | 3 | 0 | 0.06 | 0.06 | 0.00 | 5.3 |
Immuno-based methods | 17 | 6 | 0.12 | 0.09 | 0.11 | 95.8 | |
CLIA results below LOD omitted | 11 | 0.07 | 0.09 | 0.04 | 49.7 |
-
aThe results of those laboratories that reported results<reporting limit were assigned the values of reporting limit–1.0 pmol/L for estradiol and reporting limit–0.01 nmol/L for testosterone. CLIA, chemiluminescent immunoassay; EQA, external quality assessment; LC-MS/MS, liquid chromatography-tandem mass spectrometry; RIA, radio-immunoassay.
The extraction-RIA [15] showed a high level of conformity with the LC-MS/MS-based methods which deviated −9% to +12 % in the concentration range 17–35 pmol/L (samples D and C) and ±33 % at 8–9 pmol/L (samples A and B) (Figure 2B). However, for sample E, the relative bias was greater and represented concentration close to the LLOQ.
The results for estradiol determined by the CLIAs are shown in Figure 2 and Table 4. In general, the CLIAs overestimated the estradiol concentrations as the determined levels were (mean ± SD); 25.3 ± 18.1 pmol/L, CV 71.6 %; 32.6 ± 25.3 pmol/L, CV 77.5 %; 27.6 ± 18.8 pmol/L, CV 68.1 %; 32.8 ± 26.7 pmol/L, CV 81.4 %; 45.7 ± 19.4 pmol/L, CV 42.5 % for samples E, A, B, D, and C, respectively. Abbott Alinity generated the most deviating results with 54–111 pmol/L higher concentrations than determined by LC-MS/MS (Figure 2A). The other four CLIAs deviated between −29 % and +196 % at 17 pmol/L and between +15 % and +68 % at 34 pmol/L (Figure 2B). Most laboratories used the Cobas Roche instrument with variable results (Figure 2C and D). At 17 pmol/L and below, all results were higher compared to LC-MS/MS, but at 34 pmol/L, both under- and overestimating results were seen, ranging between −49 % and +95 %.
Testosterone
The results for testosterone quantified by LC-MS/MS are shown in Figure 1B. Like estradiol the LC-MS/MS assays showed a high level of agreement. The determined concentrations were (mean ± SD): 0.06 ± 0.00 nmol/L, CV 5.3 %; 0.19 ± 0.02 nmol/L, CV 10.8 %; 0.62 ± 0.08 nmol/L, CV 13.4 %; 0.99 ± 0.11 nmol/L, CV 10.6 %; and 1.00 ± 0.11 nmol/L, CV 11.0 %; for samples E, A, B, D and C, respectively.
The results for testosterone determined by immune-based assays are shown in Figure 3 and Table 4. The evaluation revealed both under- and over-estimations compared to LC-MS/MS, and a larger discrepancy between method results (mean ± SD); 0.12 ± 0.11 nmol/L, CV 95.8 %; 0.11 ± 0.05 nmol/L, CV 46.1 %; 0.46 ± 0.12 nmol/L, CV 26.9 %; 0.80 ± 0.28 nmol/L, CV 34.7 %; and 0.85 ± 0.23 nmol/L, CV 27.3 %; for samples E, A, B, D and C, respectively. In prepubertal samples (A and E), the immune-based assays both under- and overestimated the testosterone concentration with −52 % to +158 % relative bias at 0.19 nmol/L. At 0.62 nmol/L all methods gave 2–34 % lower results compared to LC-MS/MS, except the CT RIA as overestimated by +18 % (Figure 3B). In samples from pubertal children containing 0.99 nmol/L and 1.00 nmol/L testosterone, respectively, the relative bias ranged between −32 % and +46 %. A distinctive trend was that methods with over-estimating results at low testosterone concentrations were underestimating at higher concentrations and vice versa (Figure 3A and B). The most striking result was the underestimation throughout of the Cobas Roche analyzer, with up to −72 % deviation in samples from children during puberty (0.6–1.0 nmol/L; samples B–D) (Figure 3D).
Discussion
Since the introduction of EQA schemes in clinical laboratory medicine, they have become versatile tools for the detection of analytical flaws and for following the performance of diagnostic assays. For maximum usefulness, EQA schemes, need to include samples that represent the diagnostic challenges for which the assay is intended. The schemes also serve as tools to increase the conformity of assays, especially in terms of the accuracy of levels determined by different methods, facilitating the clinical interpretation and exchange of results between different sites. Since samples in the EQA schemes are generally derived from an adult population, the current study aimed at investigating the analytical aspects of the low concentrations found in pediatric serum samples.
The availability to accurate and sensitive estradiol assays is crucial for a pediatric endocrinologist in order to distinguish between prepubertal and early pubertal levels, and in monitoring the treatment of pubertal disorders, as well as monitoring the impact of aromatase-inhibitor treatment on different disorders in children [16], [17], [18]. Therefore, established and reliable sex- and puberty-specific reference intervals for sex steroids are required, which is a great challenge for each analytical laboratory. Finding healthy volunteers from different age and pubertal stage groups is quite difficult. Just dividing into age groups is not very helpful as individuals mature more or less independently of chronological age. Hence, due to the necessity of pubertal assessments and methodological challenges, pediatric reference intervals are poorly defined, which complicates the interpretation of test results [8, 9, 19]. In this survey, only one laboratory presented puberty-specific reference intervals for the CLIA used, and another one for RIA and one for LC-MS/MS. Still, adopting and implementing reference intervals supplied by the manufacturer, published data or determined at another laboratory, the test cannot be done without caution. In this study we show that even when using the same CLIA, test results may differ significantly between laboratories.
To date there are only four publications on estradiol concentrations in girls during pubertal development performed by MS-based methods [20], [21], [22] or extraction-RIA [23]. In these studies, plasma concentrations of around 10–20 pmol/L are associated with the start of pubertal development in girls. In addition, there are few published scientific articles that make an effort to establish puberty- or age-specific reference intervals with CLIA [24], [25], [26], [27], [28], [29]. Unfortunately, due to lack of specificity and sensitivity in the CLIA, the studies result in intervals with wide overlaps between ages or throughout pubertal stages, and estradiol concentrations in prepubertal children are 10–20 times higher, compared with results from MS-based methods. Hence, these references are not useful for the diagnosis of pubertal disorders, since based on these intervals it is not possible to distinguish between prepubertal and pubertal stages. Since high estradiol concentrations in young girls are associated with precocious puberty, spontaneous onset of puberty and malignancy, overestimation and false results may lead to unnecessary anxiety for the parents and the child, unnecessary investigations of the child, or inadequate therapeutic drug decisions or monitoring. On the other hand, elevated or pathological test results may also be masked by falsely high reference intervals.
In this specially composed round of the EQA scheme, using sample materials from children at prepubertal and pubertal levels, the five CLIAs showed a large spread in estradiol results as well as a clear overestimation. None of these estradiol methods could distinguish between samples from a prepubertal child or children in early puberty. However, there was good agreement between the three LC-MS/MS methods, and the extraction-RIA showed a high degree of conformity with the LC-MS/MS methods, in line with previous recommendations [8].
In recent years awareness has increased in Sweden that extraction RIA or MS-based assays are required to achieve adequate accuracy, sensitivity and specificity for pediatric applications. This is a result of persistent collaboration and networking between laboratory scientists with high expertise, clinical chemists and pediatricians. Several users in Sweden forward child samples to a laboratory with high-sensitive methodology, others determine the estradiol concentration with an immune-based method and re-run samples with LC-MS/MS if the result is below LLOQ, while other laboratories leave the responsibility to the pediatric endocrinologist to choose the adequate method. The latter method requires that the pediatrician is familiar with the principles of the methods used which is impossible or at least very difficult for the uninitiated. The clients also get deceptive information from assay vendors about their intended use for the CLIA analysis. Based on this study’s results, we argue to narrow the intended purpose in manufacturers’ inserts and on laboratories’ websites to analysis of sex steroids in adults, not children.
Over a decade ago, the largest problem with commercially available testosterone CLIAs was overestimation [1]. Ever since, life science companies have focused on standardization and obtaining higher sensitivity in testosterone assays, and to some extent, they have succeeded. However, this study reveals that significant analytical bias in respect to the LC-MS/MS assay persist. The immune-based methods showed a large spread in results where both under- and over-estimation occurred. The most frequent method used, Cobas Roche, differed considerably in results between the 11 participating laboratories, with consistent under-estimation of testosterone results in samples below 1.0 nmol/L, as well as high inter-laboratory variability.
There was good agreement between the three in-house developed and validated LC-MS/MS methods. When comparing testosterone LC-MS/MS methods, the variation was roughly ±10 % throughout the concentration range. This is a typical pattern if one (or more) of the assays is calibrated a bit differently. Thus, we believe all testosterone assays have good precision, but they differ a bit more in accuracy compared to the estradiol assays. This is a good illustration of why EQA schemes for estradiol/testosterone LC-MS/MS assays are important. Such programmes would probably help laboratories detect imperfect calibrated assays, which may be difficult to detect with an EQA scheme intended for higher concentrations.
Reliable testosterone determinations are crucial for a pediatric endocrinologist to distinguish between prepubertal and pubertal plasma levels in boys, diagnose hyperandrogenism in girls, and to distinguish between healthy and pathological states [30], [31], [32]. Testosterone concentrations above 0.5 nmol/L are associated with the onset of male puberty [12, 20, 33, 34]. In this study, the absolute bias of CLIAs ranged from −0.3 to + 0.1 nmol/L around 0.6 nmol/L, and −0.4 and + 0.5 nmol/L around 1 nmol/L which makes it impossible to separate prepubertal from pubertal levels. This is reflected by the published pediatric reference intervals analysed by CLIA, in which intervals are presented with wide and sometimes complete overlaps between ages or pubertal stages [25], [26], [27, 29, 35]. False results or results that are difficult to interpret may lead to unnecessary investigations of the child or inadequate medical treatment. In comparison the three LC-MS/MS methods had an absolute bias of −0.09 to +0.07 at 0.6 nmol/L, and −0.11 to +0.11 at 1 nmol/L, which makes them considerably more useful and reliable.
Altogether, false test results may not only affect pediatric care. The present results are also applicable for postmenopausal women. In this respect, commercially available CLIAs may mislead investigation and diagnosis of peri- and postmenopausal symptoms, which include hormone levels in the studied range [33, 36].
Conclusions
This study enabled the following general conclusions to be drawn from pediatric samples.
Commercially available estradiol immunoassays are not suitable for diagnosis in children.
Commercially available testosterone immunoassays have an uncertainty of reproducibility in the low range that each individual user should consider.
For the safe diagnosis and determination of sex steroids in children, analysis with MS-based methods is recommended.
Every pediatric endocrinologist or laboratory scientist should be familiar with the principles and pitfalls of the sex steroid methods they use.
To increase conformity of methods used for diagnostics in children, participation in an EQA scheme is highly recommended.
We recommend that manufacturers of sex steroid CLIA tests and laboratories that analyse them advertise these tests as recommended for adults, not children.
Since reliable sex steroid quantitation in children requires extremely high expertise, collaboration between biomedical laboratory scientists and clinicians is highly advantageous.
Funding source: Region Skåne
Award Identifier / Grant number: Unassigned
Acknowledgments
We thank Inga Bartuseviciene at Karolinska University Hospital, Tony Karlsborn and Carl Johan Sennbro at University and Regional Laboratories Region Skåne for providing LC-MS/MS validation data.
-
Research ethics: Not applicable.
-
Informed consent: Not applicable.
-
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: Authors state no conflict of interest.
-
Research funding: Non declared.
-
Data availability: All data generated or analyzed during this study are included in this published article.
References
1. Taieb, J, Mathian, B, Millot, F, Patricot, MC, Mathieu, E, Queyrel, N, et al.. Testosterone measured by 10 immunoassays and by isotope-dilution gas chromatography-mass spectrometry in sera from 116 men, women, and children. Clin Chem 2003;49:1381–95. https://doi.org/10.1373/49.8.1381.Search in Google Scholar PubMed
2. Nelson, RE, Grebe, SK, OK, DJ, Singh, RJ. Liquid chromatography-tandem mass spectrometry assay for simultaneous measurement of estradiol and estrone in human plasma. Clin Chem 2004;50:373–84. https://doi.org/10.1373/clinchem.2003.025478.Search in Google Scholar PubMed
3. Lee, JS, Ettinger, B, Stanczyk, FZ, Vittinghoff, E, Hanes, V, Cauley, J, et al.. Comparison of methods to measure low serum estradiol levels in postmenopausal women. J Clin Endocrinol Metab 2006;91:3791–7. https://doi.org/10.1210/jc.2005-2378.Search in Google Scholar PubMed
4. Moal, V, Mathieu, E, Reynier, P, Malthiery, Y, Gallois, Y. Low serum testosterone assayed by liquid chromatography-tandem mass spectrometry. Comparison with five immunoassay techniques. Clin Chim Acta 2007;386:12–9. https://doi.org/10.1016/j.cca.2007.07.013.Search in Google Scholar PubMed
5. Fanelli, F, Belluomo, I, Di Lallo, VD, Cuomo, G, De Iasio, R, Baccini, M, et al.. Serum steroid profiling by isotopic dilution-liquid chromatography-mass spectrometry: comparison with current immunoassays and reference intervals in healthy adults. Steroids 2011;76:244–53. https://doi.org/10.1016/j.steroids.2010.11.005.Search in Google Scholar PubMed
6. Debeljak, Z, Markovic, I, Pavela, J, Lukic, I, Mandic, D, Mandic, S, et al.. Analytical bias of automated immunoassays for six serum steroid hormones assessed by LC-MS/MS. Biochem Med 2020;30:030701. https://doi.org/10.11613/BM.2020.030701.Search in Google Scholar PubMed PubMed Central
7. Rosner, W, Auchus, RJ, Azziz, R, Sluss, PM, Raff, H. Position statement: utility, limitations, and pitfalls in measuring testosterone: an Endocrine Society position statement. J Clin Endocrinol Metab 2007;92:405–13. https://doi.org/10.1210/jc.2006-1864.Search in Google Scholar PubMed
8. Rosner, W, Hankinson, SE, Sluss, PM, Vesper, HW, Wierman, ME. Challenges to the measurement of estradiol: an endocrine society position statement. J Clin Endocrinol Metab 2013;98:1376–87. https://doi.org/10.1210/jc.2012-3780.Search in Google Scholar PubMed PubMed Central
9. Rahhal, SN, Fuqua, JS, Lee, PA. The impact of assay sensitivity in the assessment of diseases and disorders in children. Steroids 2008;73:1322–7. https://doi.org/10.1016/j.steroids.2008.04.014.Search in Google Scholar PubMed
10. Norjavaara, E, Ankarberg, C, Albertsson-Wikland, K. Diurnal rhythm of 17 beta-estradiol secretion throughout pubertal development in healthy girls: evaluation by a sensitive radioimmunoassay. J Clin Endocrinol Metab 1996;81:4095–102. https://doi.org/10.1210/jcem.81.11.8923866.Search in Google Scholar PubMed
11. Ankarberg, C, Norjavaara, E. Diurnal rhythm of testosterone secretion before and throughout puberty in healthy girls: correlation with 17beta-estradiol and dehydroepiandrosterone sulfate. J Clin Endocrinol Metab 1999;84:975–84. https://doi.org/10.1210/jc.84.3.975.Search in Google Scholar
12. Ankarberg-Lindgren, C, Norjavaara, E. Changes of diurnal rhythm and levels of total and free testosterone secretion from pre to late puberty in boys: testis size of 3 ml is a transition stage to puberty. Eur J Endocrinol 2004;151:747–57. https://doi.org/10.1530/eje.0.1510747.Search in Google Scholar PubMed
13. Ankarberg-Lindgren, C, Norjavaara, E. Twenty-four hours secretion pattern of serum estradiol in healthy prepubertal and pubertal boys as determined by a validated ultra-sensitive extraction RIA. BMC Endocr Disord 2008;8:10. https://doi.org/10.1186/1472-6823-8-10.Search in Google Scholar PubMed PubMed Central
14. Ohlsson, C, Langenskiold, M, Smidfelt, K, Poutanen, M, Ryberg, H, Norlen, AK, et al.. Low progesterone and low estradiol levels associate with abdominal aortic aneurysms in men. J Clin Endocrinol Metab 2022;107:e1413–25. https://doi.org/10.1210/clinem/dgab867.Search in Google Scholar PubMed PubMed Central
15. Ankarberg-Lindgren, C, Norjavaara, E. A purification step prior to commercial sensitive immunoassay is necessary to achieve clinical usefulness when quantifying serum 17beta-estradiol in prepubertal children. Eur J Endocrinol 2008;158:117–24. https://doi.org/10.1530/eje-07-0403.Search in Google Scholar
16. Wickman, S, Sipila, I, Ankarberg-Lindgren, C, Norjavaara, E, Dunkel, L. A specific aromatase inhibitor and potential increase in adult height in boys with delayed puberty: a randomised controlled trial. Lancet 2001;357:1743–8. https://doi.org/10.1016/s0140-6736(00)04895-9.Search in Google Scholar
17. Matthews, D, Bath, L, Hogler, W, Mason, A, Smyth, A, Skae, M. Hormone supplementation for pubertal induction in girls. Arch Dis Child 2017;102:975–80. https://doi.org/10.1136/archdischild-2016-311372.Search in Google Scholar PubMed
18. Osterbrand, M, Fors, H, Allvin, K, Norjavaara, E. 17beta-Estradiol and gonadotropin levels for the diagnosis of the benign form of breast development in girls aged up to 4 Years in real-life clinical practice. Horm Res Paediatr 2017;87:315–23. https://doi.org/10.1159/000470841.Search in Google Scholar PubMed
19. Bay, K, Andersson, AM, Skakkebaek, NE. Estradiol levels in prepubertal boys and girls--analytical challenges. Int J Androl 2004;27:266–73. https://doi.org/10.1111/j.1365-2605.2004.00487.x.Search in Google Scholar PubMed
20. Ankarberg-Lindgren, C, Dahlgren, J, Andersson, MX. High-sensitivity quantification of serum androstenedione, testosterone, dihydrotestosterone, estrone and estradiol by gas chromatography-tandem mass spectrometry with sex- and puberty-specific reference intervals. J Steroid Biochem Mol Biol 2018;183:116–24. https://doi.org/10.1016/j.jsbmb.2018.06.005.Search in Google Scholar PubMed
21. Frederiksen, H, Johannsen, TH, Andersen, SE, Albrethsen, J, Landersoe, SK, Petersen, JH, et al.. Sex-specific estrogen levels and reference intervals from infancy to late adulthood determined by LC-MS/MS. J Clin Endocrinol Metab 2020;105:754–68. https://doi.org/10.1210/clinem/dgz196.Search in Google Scholar PubMed PubMed Central
22. Madsen, A, Bruserud, IS, Bertelsen, BE, Roelants, M, Oehme, NHB, Viste, K, et al.. Hormone references for ultrasound breast staging and endocrine profiling to detect female onset of puberty. J Clin Endocrinol Metab 2020;105:e4886–95. https://doi.org/10.1210/clinem/dgaa679.Search in Google Scholar PubMed PubMed Central
23. Ankarberg-Lindgren, C, Mahler, TB, Norjavaara, E. Biological reference intervals for serum estradiol and testosterone in children. Horm Res Paediatr 2013;80:179.Search in Google Scholar
24. Zec, I, Kucak, I, Begcevic, I, Simundic, AM, Tislaric-Medenjak, D, Megla, ZB, et al.. Reference intervals for reproductive hormones in prepubertal children on the automated Roche cobas e 411 analyzer. Clin Biochem 2012;45:1206–12. https://doi.org/10.1016/j.clinbiochem.2012.05.019.Search in Google Scholar PubMed
25. Konforte, D, Shea, JL, Kyriakopoulou, L, Colantonio, D, Cohen, AH, Shaw, J, et al.. Complex biological pattern of fertility hormones in children and adolescents: a study of healthy children from the CALIPER cohort and establishment of pediatric reference intervals. Clin Chem 2013;59:1215–27. https://doi.org/10.1373/clinchem.2013.204123.Search in Google Scholar PubMed
26. Karbasy, K, Lin, DC, Stoianov, A, Chan, MK, Bevilacqua, V, Chen, Y, et al.. Pediatric reference value distributions and covariate-stratified reference intervals for 29 endocrine and special chemistry biomarkers on the Beckman Coulter Immunoassay Systems: a CALIPER study of healthy community children. Clin Chem Lab Med 2016;54:643–57. https://doi.org/10.1515/cclm-2015-0558.Search in Google Scholar PubMed
27. Higgins, V, Fung, AWS, Chan, MK, Macri, J, Adeli, K. Pediatric reference intervals for 29 Ortho VITROS 5600 immunoassays using the CALIPER cohort of healthy children and adolescents. Clin Chem Lab Med 2018;56:327–40. https://doi.org/10.1515/cclm-2017-0349.Search in Google Scholar PubMed
28. Bohn, MK, Higgins, V, Asgari, S, Leung, F, Hoffman, B, Macri, J, et al.. Paediatric reference intervals for 17 Roche cobas 8000 e602 immunoassays in the CALIPER cohort of healthy children and adolescents. Clin Chem Lab Med 2019;57:1968–79. https://doi.org/10.1515/cclm-2019-0707.Search in Google Scholar PubMed
29. Bohn, MK, Wilson, S, Hall, A, Adeli, K. Pediatric reference interval verification for endocrine and fertility hormone assays on the Abbott Alinity system. Clin Chem Lab Med 2021;59:1680–7. https://doi.org/10.1515/cclm-2021-0337.Search in Google Scholar PubMed
30. Rauh, M. Steroid measurement with LC-MS/MS. Application examples in pediatrics. J Steroid Biochem Mol Biol 2010;121:520–7. https://doi.org/10.1016/j.jsbmb.2009.12.007.Search in Google Scholar PubMed
31. Mouritsen, A, Soeborg, T, Johannsen, TH, Aksglaede, L, Sorensen, K, Hagen, CP, et al.. Longitudinal changes in circulating testosterone levels determined by LC-MS/MS and by a commercially available radioimmunoassay in healthy girls and boys during the pubertal transition. Horm Res Paediatr 2014;82:12–7. https://doi.org/10.1159/000358560.Search in Google Scholar PubMed
32. Fanelli, F, Gambineri, A, Belluomo, I, Repaci, A, Di Lallo, VD, Di Dalmazi, G, et al.. Androgen profiling by liquid chromatography-tandem mass spectrometry (LC-MS/MS) in healthy normal-weight ovulatory and anovulatory late adolescent and young women. J Clin Endocrinol Metab 2013;98:3058–67. https://doi.org/10.1210/jc.2013-1381.Search in Google Scholar PubMed
33. Kushnir, MM, Blamires, T, Rockwood, AL, Roberts, WL, Yue, B, Erdogan, E, et al.. Liquid chromatography-tandem mass spectrometry assay for androstenedione, dehydroepiandrosterone, and testosterone with pediatric and adult reference intervals. Clin Chem 2010;56:1138–47. https://doi.org/10.1373/clinchem.2010.143222.Search in Google Scholar PubMed
34. Kulle, AE, Riepe, FG, Melchior, D, Hiort, O, Holterhus, PM. A novel ultrapressure liquid chromatography tandem mass spectrometry method for the simultaneous determination of androstenedione, testosterone, and dihydrotestosterone in pediatric blood samples: age- and sex-specific reference data. J Clin Endocrinol Metab 2010;95:2399–409. https://doi.org/10.1210/jc.2009-1670.Search in Google Scholar PubMed
35. Clinical Specialist Services Care Group. Paediatric reference ranges for serum testosterone – Reference: Siemens ADVIA Centaur XPT TSTII assay instructions for use: Department of Pathology – Clinical Biochemistry. County Durham and Darlington, England: NHS; 2023.Search in Google Scholar
36. Verdonk, SJE, Vesper, HW, Martens, F, Sluss, PM, Hillebrand, JJ, Heijboer, AC. Estradiol reference intervals in women during the menstrual cycle, postmenopausal women and men using an LC-MS/MS method. Clin Chim Acta 2019;495:198–204. https://doi.org/10.1016/j.cca.2019.04.062.Search in Google Scholar PubMed
© 2023 the author(s), published by De Gruyter, Berlin/Boston
This work is licensed under the Creative Commons Attribution 4.0 International License.