Comprehensive, Comparative Evaluation of 35 Manual SARS-CoV-2 Serological Assays

The markets have been flooded with hundreds of SARS-CoV-2 serology tests, and although there are many published reports on their performance, comparative reports are far fewer and tend to be limited to only a few tests. In this report, we comparatively assessed 35 rapid diagnostic tests or microtiter plate enzyme immunoassays (EIAs) using a large set of samples from individuals with a history of mild to moderate COVID-19, commensurate with the target population for serosurveillance, which included serum samples from individuals previously infected, at undetermined time periods, with other seasonal human coronaviruses, Middle East respiratory syndrome coronavirus (MERS-CoV), and SARS-CoV-1. The onset of the coronavirus disease 2019 (COVID-19) pandemic resulted in hundreds of in vitro diagnostic devices (IVDs) coming to market, facilitated by regulatory authorities allowing "emergency use" without a comprehensive evaluation of performance. The World Health Organization (WHO) released target product profiles (TPPs) specifying acceptable performance characteristics for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) assay devices. We evaluated 26 rapid diagnostic tests and 9 enzyme immunoassays (EIAs) for anti-SARS-CoV-2, suitable for use in low- and middle-income countries (LMICs), against these TPPs and other performance characteristics. The sensitivity and specificity ranged from 60.1 to 100% and 56.0 to 100%, respectively. Five of 35 test kits reported no false reactivity for 55 samples with potentially cross-reacting substances. Six test kits reported no false reactivity for 35 samples containing interfering substances, and only one test reported no false reactivity with samples positive for other coronaviruses (not SARS-CoV-2). This study demonstrates that a comprehensive evaluation of the performance of test kits against defined specifications is essential for the selection of test kits, especially in a pandemic setting.IMPORTANCE The markets have been flooded with hundreds of SARS-CoV-2 serology tests, and although there are many published reports on their performance, comparative reports are far fewer and tend to be limited to only a few tests. In this report, we comparatively assessed 35 rapid diagnostic tests or microtiter plate enzyme immunoassays (EIAs) using a large set of samples from individuals with a history of mild to moderate COVID-19, commensurate with the target population for serosurveillance, which included serum samples from individuals previously infected, at undetermined time periods, with other seasonal human coronaviruses, Middle East respiratory syndrome coronavirus (MERS-CoV), and SARS-CoV-1. The significant heterogeneity in their performances, with only a few tests meeting WHO target product profile performance requirements, highlights the importance of independent comparative assessments to inform the use and procurement of these tests for both diagnostics and epidemiological investigations.