Assessment of serological tests for antibodies to different antigens of the SARS-CoV-2 virus: comparison of six immunoassays

The new coronavirus SARS-CoV-2 has become a global challenge to medicine and, in particular, laboratory diagnostics. The study of the antibodies’ level to SARS-CoV-2 can be used as a confirmation test in the diagnosis of a disease, but it becomes of paramount importance in assessing population immunity resulting from a disease or vaccination, as well as in selection of convalescent plasma donors. The kits developed in our country and abroad for detecting antibodies to the SARS-CoV-2 virus differ both in the methods of testing and in the used coronavirus antigens to which the antibodies are directed. The aim of this study was to compare the diagnostic sensitivity and specificity of five kits for the detection of IgG antibodies to the SARS-CoV-2 virus, based on different diagnostic methods. Serum samples from 137 COVID-19 convalescents and 166 donors of blood and its components were examined. The control group consisted of 50 blood sera collected at the beginning of 2019 and 19 sera collected in 2018 (before the advent of the SARS-CoV-2 virus) and stored at -70 °C. Testing was carried out in analytical systems: rapid test “COVID-19 IgM/IgG Rapid Test (Colloidal Gold)” (China), on an automatic immunochemical analyzer Abbott Architect™ i2000 and kit “SARS-CoV2-IgG” (Abbot, Chicago , IL USA), by the chemiluminescence method using an automatic analyzer of the CL series and kits of the “Mindray” company (China) “SARS-CoV-2 IgM” and “SARS-CoV-2 IgG” and by the enzyme immunoassay method on the kits of the companies “Diagnostic Systems” Ltd (Russia, Nizhny Novgorod) “DS-IFA-ANTI-SARS-CoV-2-G”, “Xema” Ltd (Federal State Budgetary Institution “National Medical Research Center of Hematology” of the Ministry of Health of Russia) “SARS-CoV-2-IgG-IFA” and “Vector-Best” CJSC (Russia, Novosibirsk)” SARS-COV-2-IgM-IFA-BEST” and “SARS-COV-2-IgG-IFABEST”. When comparing the results of testing 137 plasma samples on the Vector-Best and Mindray kits for IgG antibodies, 127 samples were positive, 7 samples were negative on both kits, the discrepancy was 2.2%. In the study of IgM antibodies, 32.1% were positive, and 52.6% were negative in both kits. The discrepancy rate was 15.3%. Out of 166 samples, 1 serum (0.6%) was negative in 5 kits. On the Mindray kit, IgG antibodies to the antigens of the SARS-CoV-2 virus were detected in 165 samples (99.4%), on Vector-Best – in 164 sera (98.8%), on Diagnostic systems – in 151 (90.96%), on Xema – in 154 (92.8%), and on Abbott – in 155 samples (93.4%). At the same time, 135 (81.33%) samples were positive in all kits, while 30 samples had discordant results (18.07%), and in 9 sera, specific IgG was not detected in 2 or more kits. ROC analysis revealed a high diagnostic value of all tested kits (AUC from 0.908 to 0.998), which indicates a high quality of the separation model of positive and negative samples (p < 0.001). With the cut-off set by the manufacturers, the sensitivity and specificity ranged from 82.8% and 93.3% for the Diagnostic Systems kit to 99.4% and 95.8% for the VectorBest kit. The calculated correlation coefficients were higher between kits with a similar composition of the antigen used in the kits; therefore, it is better to monitor the dynamics of antibodies by diagnostic kits from the same manufacturer.

1. Gilmutdinov R.G., Ishbuldina A.M., Tyukina L.Yu., Zakharova I.V., Kuznetsov S.I., Zhiburt E.B. Results of the survey of COVID-19 convalescent donors. Spravochnik zaveduyushchego KDL = Handbook of the Head of Clinical Diagnostic Laboratory, 2020, no. 10, pp. 37-42. (In Russ.)

2. Kuvshinova I.N., Nekrasov B.G., Livitskaya N.I., Molodykh S.V., Rukavishnikov M.Yu. Sensitivity and specificity of sets of reagents of JSC “VectorBest” for the detection of immunoglobulins of different classes to SARS-CoV-2. Spravochnik zaveduyushchego KDL = Handbook of the Head of Clinical Diagnostic Laboratory, 2020, no. 10, pp. 27-32. (In Russ.)

3. Kuleshova S.V., Grigorieva E.V. Experience in determining antibodies to SARS-CoV-2, the causative agent of a new coronavirus infection. Spravochnik zaveduyushchego KDL = Handbook of the Head of Clinical Diagnostic Laboratory, 2020, no. 9, pp. 9-15. (In Russ.)

4. Bonelli F., Sarasini A., Zierold C., Calleri M., Bonetti A., Vismara C., Blocki F.A., Pallavicini L., Chinali A., Campisi D., Percivalle E., DiNapoli A.P., Perno C.F., Baldantib F. Clinical and analytical performance of an automated serological test that identifies S1/S2-neutralizing IgG in COVID-19 patients semiquantitatively. J. Clin. Microbiol., 2020, Vol. 58, Iss. 9, e01224-20. doi: 10.1128/JCM.01224-20.

5. Bryan A., Pepper G., Wener M.H., Fink S.L., Morishima C., Chaudhary A., Jerome K.R., Mathias P.C., Greninger A.L. Performance characteristics of the abbott architect SARS-CoV-2 IgG assay and seroprevalence in Boise, Idaho. J. Clin. Microbiol., 2020, Vol. 58. no. 8, e00941-20. doi: 10.1128/JCM.00941-20.

6. Jääskeläinen A.J., Kuivanen S., Kekäläinen E., Ahava M.J., Loginov R., Kallio-Kokko H., Vapalahti O., Jarva H., Kurkela S., Lappalainen M. Performance of six SARS-CoV-2 immunoassays in comparison with microneutralisation. J. Clin. Virol., 2020, Vol. 129, 104512. doi: 10.1016/j.jcv.2020.104512.

7. Kohmer N., Westhaus S., Rüha C., Ciesek S., Rabenau H.F. Brief clinical evaluation of six high-throughput SARS-CoV-2 IgG antibody assays. J. Clin. Virol., 2020, Vol. 129, pp. 104480. doi: 10.1016/j.jcv.2020.104480.

8. Loeffelholz M.J., Tang Y.-W. Laboratory diagnosis of emerging human coronavirus infections – the state of the art. Emerg. Microbes Infect., 2020, Vol. 9, pp. 747-756.

9. Meschi S., Colavita F., Bordi L., Matusali G., Lapa D., Amendola A., Vairo F., Ippolito G., Capobianchi M.R., Castilletti C. Performance evaluation of Abbott ARCHITECT SARS-CoV-2 IgG immunoassay in comparison with indirect immunofluorescence and virus microneutralization test. J. Clin. Virol., 2020, Vol. 129, 104539. doi: 10.1016/j.jcv.2020.104539

10. Montesinos I., Gruson D., Kabamba B., Dahma H., Van den Wijngaert S., Reza S., Carbone V., Vandenberg O., Gulbis B., Wolff F., Rodriguez-Villalobos H. Evaluation of two automated and three rapid lateral flow immunoassays for the detection of anti-SARS-CoV-2 antibodies. J. Clin. Virol., 2020, Vol. 128, 104413. doi: 10.1016/j.jcv.2020.104413.

11. Nicol T., Lefeuvrea C., Serri O., Pivert A., Joubaud F., Dubée V., Kouatchet A., Ducancelle A., LunelFabiani F., le Guillou-Guillemette H. Assessment of SARS-CoV-2 serological tests for the diagnosis of COVID-19 through the evaluation of three immunoassays: two automated immunoassays (Euroimmun and Abbott) and one rapid lateral flow immunoassay (NG Biotech). J. Clin. Virol., 2020, Vol. 129, 104511. doi: 10.1016/j.jcv.2020.104511.

12. Okba N.M.A., Müller M.A., Li W., Wang C., Geurtsvan-Kessel C.H., Corman V.M., Lamers M.M., Sikkema R.S., de Bruin E., Chandler F.D., Yazdanpanah Y., Le Hingrat Q., Descamps D., Houhou-Fidouh N., Reusken C.B.E.M., Bosch B.-J., Drosten C., Koopmans M.P.G., Haagmans B.L. Severe acute respiratory syndrome coronavirus 2-specific antibody responses in coronavirus disease 2019 patients. Emerg. Infect. Dis., 2020, Vol. 26, no. 7, pp. 1478-1488.

13. Ou X., Liu Y., Lei X., Li P., Mi D., Ren L., Guo L., Guo R., Chen T., Hu J., Xiang Z., Mu Z., Chen X., Chen J., Hu K., Jin Q., Wang J., Qian Z., Characterization of spike glycoprotein of SARS-CoV-2 on virus entry and its immune cross-reactivity with SARS-CoV. Nat. Commun., 2020, Vol. 11, 1620. doi: 10.1038/s41467020-15562-9.

14. Padoan A., Cosma C., Zaupa P., Plebani M. Analytical and diagnostic performances of a high-throughput immunoassay for SARS-CoV-2 IgM and IgG. medRxiv, 2020. Available at: https://www.medrxiv.org/content/10.1101/2020.11.20.20235267v1.full.

15. Pan Y., Li X., Yang G., Fan J., Tang Y., Zhao J., Long X., Guo S., Zhao Z., Liu Y., Hu H., Xue H., Li Y. Serological immunochromatographic approach in diagnosis with SARS-CoV-2 infected COVID-19 patients. J. Infect., 2020, Vol. 81, no. 1, pp. e28-e32.

16. Petherick A., Developing antibody tests for SARS-CoV-2. Lancet, 2020, Vol. 395, pp. 1101-1102.

17. Rajendran K., Krishnasamy N., Rangarajan J., Rathinam J., Natarajan M., Ramachandran A. Convalescent plasma transfusion for the treatment of COVID-19: systematic review. J. Med. Virol., 2020, Vol. 92, no. 9, pp. 1475-1483.

18. Tang M.S., Hock K.G., Logsdon N.M., Hayes J.E., Gronowski A.M., Anderson N.W., Farnsworth C.W. Clinical performance of two SARS-CoV-2 serologic assays. Clin. Chem., 2020, Vol. 66, no. 8, pp. 1055-1062.

19. Tang Y.-W., Schmitz J.E., Persing D.H., Stratton C.W. The laboratory diagnosis of COVID-19 infection: current issues and challenges. J. Clin. Microbiol., 2020, Vol. 58, no. 6, e00512-20. doi: 10.1128/JCM.00512-20.

20. Tay M.Z., Poh C.M., Rénia L., MacAry P.A., Ng L.F.P. The trinity of COVID-19: immunity, inflammation and intervention. Nat. Rev. Immunol., 2020, Vol. 20, pp. 363-374.

21. Vashist S.K. In vitro diagnostic assays for COVID-19: recent advances and emerging trends. Diagnostics, 2020, Vol. 10, 202. doi: 10.3390/diagnostics10040202.

22. World Health Organization, Laboratory Biosafety Guidance Related to the Novel Coronavirus (2019-nCoV), 2020 (Accessed 03 March 2021). Available at: https://www.who.int/docs/default-source/coronaviruse/laboratory-biosafety-novel-coronavirus-version1-1.pdf?sfvrsn=912a9847_2.

23. Xu Y., Xiao M., Liu X., Xu S., Du T., Xu J., Yang Q., Xu Y., Han Y., Li T., Zhu H., Wang M. Significance of serology testing to assist timely diagnosis of SARS-CoV-2 infections: implication from a family cluster. Emerg. Microbes Infect., 2020, Vol. 9, pp. 924-927.

24. Yang Y., Yang M., Shen C., Wang F., Yuan J., Li J., Zhang M., Wang Z., Xing L., Wei J., Peng L., Wong G., Zheng H., Liao M., Feng K., Li J., Yang Q., Zhao J., Zhang Z., Liu L., Liu Y., Evaluating the accuracy of different respiratory specimens in the laboratory diagnosis and monitoring the viral shedding of 2019-nCoV infections. medRxiv, 2020. Available at: https://www.medrxiv.org/content/10.1101/2020.02.11.20021493v2.

25. Zhu N., Zhang D., Wang W., Li X., Yang B., Song J., Zhao X., Huang B., Shi W., Lu R., Niu P., Zhan F., Ma X., Wang D., Xu W., Wu G., Gao G.F., Tan W. A novel coronavirus from patients with pneumonia in China, 2019. N. Engl. J. Med., 2020, Vol. 382, pp. 727-733.