Checking Consistency among the Four Basic Indicators of Diagnostic Testing in Saudi Medical Journals

Main Article Content

Hamzah Abdul Majid Serag
Ali Muhammad Ali Rushdi

Abstract

We provide a novel method for validating any purported set of the four most prominent indicators of diagnostic testing (Sensitivity, Specificity, Positive Predictive Value, and Negative Predictive Value), by observing that these indicators constitute three rather than four independent quantities. This observation has virtually been unheard of in the open medical literature. We defined two functions, which serve as consistency criteria, since each of them checks consistency for any set of four numerical values claimed to be the four basic diagnostic indicators. Most of the data we came across in various Saudi medical journals met our criteria for consistency, but in a few cases, there were obvious unexplained blunders. We relate our present findings to the more general issue of detection and ramifications of unwelcome flawed data.

Keywords:
Diagnostic testing, sensitivity, specificity, positive predictive value, negative predictive value, consistency criterion, flawed data.

Article Details

How to Cite
Serag, H. A. M., & Rushdi, A. M. A. (2021). Checking Consistency among the Four Basic Indicators of Diagnostic Testing in Saudi Medical Journals. Asian Journal of Medical Principles and Clinical Practice, 4(1), 14-27. Retrieved from http://journalajmpcp.com/index.php/AJMPCP/article/view/30134
Section
Minireview Article

References

Glantz SA. Biostatistics: how to detect, correct and prevent errors in the medical literature, Circulation. 1980;61(1):1-7.

Lang T. Twenty statistical errors even you can find in biomedical research articles, Croatian Medical Journal. 2004;45(4):361-370.

Kuklin B. Probability misestimates in medical care, Arkansas Law Review. 2006;59:527-554.

Rushdi RA, Rushdi AM. Karnaugh-map utility in medical studies: The case of Fetal Malnutrition. International Journal of Mathematical, Engineering and Management Sciences (IJMEMS). 2018;3(3):220-244.

Rushdi RA, Rushdi AM. Common fallacies of probability in medical context: A simple mathematical exposition, Journal of Advances in Medicine and Medical Research. 2018;26(1): 1-21.

Rushdi RAM, Rushdi AMA. Mathematics and Examples for Avoiding Common Probability Fallacies in Medical Disciplines. Chapter 11 in Current Trends in Medicine and Medical Research, Vol. 1, Book Publishers International, Hooghly, West Bengal, India. 2019;106-132.

Pollach G. The World’s under Five Population—Do We Really Have Good Data of Its Size in Medicine?. International Journal of Clinical Medicine. 2014;5(10), Article ID 46219: 1-6.

De Felice C, Cortelazzo A, Leoncini S, Signorini C, Hayek J, Ciccoli L. Statistics, biomedicine and scientific fraud, Journal of the Siena Academy of Sciences, Focus on Biostatistics. 2016;7(1):15-22.

Pollach G, Brunkhorst F, Mipando M, Namboya F, Mndolo S, Luiz T. The “first digit law”–A hypothesis on its possible impact on medicine and development aid. Medical Hypotheses. 2016;97:102-106.

Montoya JM. Benford ́s Law with small sample sizes: A new exact test useful in health sciences during epidemics. Revista Salud Uis. 2020;52(2):161-163.

Rushdi RA, Rushdi AM, Talmees FA. Novel pedagogical methods for conditional-probability computations in medical disciplines. Journal of Advances in Medicine and Medical Research. 2018;25(10):1-15.

Rushdi AMA, Talmees FA. An exposition of the eight basic measures in diagnostic testing using several pedagogical tools, Journal of Advances in Mathematics and Computer Science. 2018;26(3): 1-17.

Rushdi AMA, Talmees FA. Computations of the Eight Basic Measures in Diagnostic Testing. Chapter 6 in Advances in Mathematics and Computer Science, Vol. 2, Book Publishers International, Hooghly, West Bengal, India. 2019;:66-87.

Rushdi AMA, Serag HA. Solutions of ternary problems of conditional probability with applications to mathematical epidemiology and the COVID-19 pandemic, International Journal of Mathematical, Engineering and Management Sciences. 2020;5(5):787-811.

Rushdi AMA, Serag HA. Inter-relationships among the four basic measures of diagnostic testing: A signal-flow-graph approach, Journal of King Abdulaziz University: Computing and Information Technology. 2021;10(1).

Abbas MM, Abulaban, AA, Kotb MM. Accuracy of magnetic resonance imaging in diagnosis of internal derangement of the knee, Journal of King Abdulaziz University: Medical Sciences. 2016;23(4):11-17.‏

Mufti ST, Sawan AS. Comparative study between Breast Cytology and Histology in Saudi females, Journal of King Abdulaziz University: Medical Sciences. 2011;18(1):37-55.

Al-Ghamdi KB, Rammal AA, Sindi RS. Fungal sinusitis: A ten-year experience at King Abdulaziz University Hospital, Journal of King Abdulaziz University: Medical Sciences. 2013;20(3): 29-41.

Amin MA, Elsadig AM, Osman HA. Evaluation of cathodic antigen urine tests for diagnosis of Schistosoma mansoni infection in Sudan, Saudi Journal of Medicine & Medical Sciences. 2017;5(1):56-61.‏

Zarif HA, Ghandurah SE, Al-Garni MA, Binmahfooz SK, Alsaywid BS, Satti MB. Thyroid nodules cytopathology applying the Bethesda system with histopathological correlation, Saudi Journal of Medicine & Medical Sciences. 2018;6(3):143-148.‏

Udoh BE, Iwalokun BA, Etukumana E, Amoo J. Asymptomatic falciparum malaria and its effects on type 2 diabetes mellitus patients in Lagos, Nigeria. Saudi Journal of Medicine & Medical Sciences. 2020;8(1): 32-40.

Saeed M, Ahmad M, Iram S, Riaz S, Akhtar M, Aslam M. GeneXpert technology: A breakthrough for the diagnosis of tuberculous pericarditis and pleuritis in less than 2 hours, Saudi Medical Journal. 2017;38(7):699-705.‏

Moradan S, Ghorbani R, Lotfi A. Agreement of histopathological findings of uterine curettage and hysterectomy specimens in women with abnormal uterine bleeding, Saudi Medical Journal. 2017;38(5):497–502. ‏

Mehmood T, Al Shehrani MS, Ahmad M. Acute coronary syndrome risk prediction of rapid emergency medicine scoring system in acute chest pain: An observational study of patients presenting with chest pain in the emergency department in Central Saudi Arabia, Saudi Medical Journal. 2017;38(9):900-904.‏

Raffa LH, Alessa SK, Alamri AS, Malaikah RH. Prediction of retinopathy of prematurity using the screening algorithm WINROP in a Saudi cohort of preterm infants, Saudi Medical Journal. 2020;41(6):622-627.‏

Sudheer, K. A Study of the Efficacy of Ultrasonography for Diagnosis after Blunt Abdominal Trauma, Saudi Journal of Medicine (SJM). 2014;3(6):330-333.‏

Nugroho HA, Frannita, EL, Ardiyanto I, andChoridah L. Computer aided diagnosis for thyroid cancer system based on internal and external characteristics. Journal of King Saud University-Computer and Information Sciences. 2019;1-11. Available:https://doi.org/10.1016/j.jksuci.2019.01.007

Al Jahdali H, Ahmed AE, Balkhy HH, Baharoon S, Al Hejaili FF, Hajeer A, Memish Z, Binsalih S, Al Sayyari AA. Comparison of the tuberculin skin test and Quanti-FERON-TB Gold In-Tube (QFT-G) test for the diagnosis of latent tuberculosis infection in dialysis patients, Journal of Infection and Public Health. 2013;6(3):166-172.‏

Nour-Neamatollahi, A., Siadat, S. D., Yari, S., Tasbiti, A. H., Ebrahimzadeh N, Vaziri F, Fateh A, Ghazanfari M, Abdolrahimi F, Pourazar S, Bahrmand A. A new diagnostic tool for rapid and accurate detection of Mycobacterium tuberculosis, Saudi Journal of Biological Sciences. 2018;25(3):418-425.‏

Alghamdi J, Amoudi M, Kassab AC, Al Mufarrej M, Al Ghamdi S. Eye color prediction using single nucleotide polymorphisms in Saudi population, Saudi Journal of Biological Sciences. 2019;26(7):1607-1612.‏

Zhang L, Sun J, Zhang M, Lin Y, Fang L, Fang X, Mai W, andYin Z. The significance of combined detection of CysC, urinary mAlb and β2-MG in diagnosis of the early renal injury in pregnancy-induced hypertension syndrome, Saudi Journal of Biological Sciences. 2019;26(8):1982- 1985.‏

Al-Bahkaly S, Alshamrani A, Hijazi LO, Almegbel MM, Pharaon MM. Diagnostic accuracy of fine-needle aspiration cytology with histopathology of thyroid swellings in King Abdulaziz Medical City, Journal of Nature and Science of Medicine. 2020;3(2):121-125.

Senok AC, Aldosari KM, Alowaisheq RA, Abid OA, Alsuhaibani KA, Khan MA, Somily AM. Detection of Clostridium difficile antigen and toxin in stool specimens: comparison of the C. difficile QuikChek Complete enzyme immunoassay and GeneXpert C. difficile polymerase chain reaction assay, Saudi Journal of Gastroenterology: Official Journal of the Saudi Gastroenterology Association. 2017;23(4):259–262. ‏

Zhang F, Feng Z, Zhang Y, Liu Z, Sun X, and Jin, S. Determination of the optimal volume of ascitic fluid for the precise diagnosis of malignant ascites, Saudi Journal of Gastroenterology: Official Journal of the Saudi Gastroenterology Association. 2019;25(5):327–332.

Mahmoud AA, Bakir AS, Shabana SS. Serum TGF-β, Serum MMP-1, and HOMA-IR as non-invasive predictors of fibrosis in Egyptian patients with NAFLD, Saudi Journal of Gastroenterology: Official Journal of the Saudi Gastroenterology Association. 2012;18(5):327-333.‏

Khayyat YM. Serologic markers of gluten sensitivity in a healthy population from the western region of Saudi Arabia. Saudi Journal of Gastroenterology: Official Journal of the Saudi Gastroenterology Association. 2012;18(1):23-25.‏

Abu-Eshy SA, Abolfotouh, MA, Nawar E, Sabib ARHA. Ranson's criteria for acute pancreatitis in high altitude: Do they need to be modified?. Saudi Journal of Gastroenterology: Official Journal of the Saudi Gastroenterology Association. 2008;14(1):20-23.‏

Alboraie M, Khairy M, Elsharkawy A, Elsharkawy M, Asem N, El-Seoud ARA, Elghamry FG, Esmat G. Egy-score as a noninvasive score for the assessment of hepatic fibrosis in chronic hepatitis C: a preliminary approach, Saudi Journal of Gastroenterology: Official Journal of the Saudi Gastroenterology Association. 2014;20(3):170-174.‏

Almajwal AM, Al-Baghli NA, Batterham MJ, Williams PG, Al-Turki KA, Al-Ghamdi AJ. (2009) Performance of body mass index in predicting diabetes and hypertension in the Eastern Province of Saudi Arabia, Annals of Saudi Medicine. 2009;29(6):437-445.‏

Safavi M, Honarmand A, Zare N. A comparison of the ratio of patient's height to thyromental distance with the modified Mallampati and the upper lip bite test in predicting difficult laryngoscopy, Saudi Journal of Anaesthesia. 2011;5(3):258-263.‏

Terkawi,AS, Abolkhair A, Didier B, Alzhahrani T, Alsohaibani, M, Terkawi YS, Almoqbali, Y, Tolba YY, Pangililan E, Foula F, Tsang S. Development and validation of Arabic version of the douleurneuropathique 4 questionnaire, Saudi Journal of Anaesthesia. 2017;11(Suppl 1): S31–S39.

Vasudevan JA, Nair V, Sukumaran S. Evaluation of risk of malignancy index in the preoperative assessment of ovarian tumors: Study from a tertiary care center, Saudi Journal for Health Sciences. 2016;5(2): 67-71.

Rathore V, Joshi H, Kimmatkar PD, Malhotra V, Agarwal D, Beniwal P, Dawra R, Gupta P. Leukocyte esterase reagent strip as a bedside tool to detect peritonitis in patients undergoing acute peritoneal dialysis, Saudi Journal of Kidney Diseases and Transplantation. 2017;28(6):1264-1269.‏

Chandra A, Raj G, Awasthi NP, Rao N, Srivastava D. Evaluation of the relationship between blood cell parameters and vascular calcification in dialysis-dependent end-stage renal disease patients,Saudi Journal of Kidney Diseases and Transplantation. 2020;31(1):136-143.‏

Alashari DM, Al-Alawi MM, Jiman-Fatani AA. Extended-Spectrum Beta-Lactamase Producing Bacteria: Epidemiology, Risk Factors, Diagnostic Methodology, and Antimicrobial Susceptibility Profile: A Prospective Study at a University Hospital in Western Saudi Arabia, Saudi Journal of Internal Medicine. 2019;9(2):5-18.‏

Steen RG. Misinformation in the medical literature: what role do error and fraud play?. Journal of Medical Ethics. 2011;37(8):498-503.

Steen RG. Retractions in the medical literature: how can patients be protected from risk?. Journal of Medical Ethics. 2012;38(4):228-32.

George SL, Buyse M. Data fraud in clinical trials. Clinical investigation. 2015;5(2):161-173.

Korte SM, van der Heyden MA. Preventing publication of falsified and fabricated data: roles of scientists, editors, reviewers, and readers. Journal of Cardiovascular Pharmacology. 2017;69(2):65-70.

Adam D. How a data detective exposed suspicious medical trials. Nature. 2019;571(7766):462-465.

Carlisle JB. False individual patient data and zombie randomised controlled trials submitted to Anaesthesia. Anaesthesia. Early access; 2020. Available:https://doi.org/10.1111/anae.15263

Ioannidis JPA. Hundreds of thousands of zombie randomised trials circulate among us. Anaesthesia. 2020 Early access 2020 Oct 30. https://doi.org/10.1111/anae.15297.

Buyse M, George SL, Evans S, Geller NL, Ranstam J, Scherrer B, Lesaffre E, Murray G, Edler L, Hutton J, Colton T. The role of biostatistics in the prevention, detection and treatment of fraud in clinical trials. Statistics in medicine. 1999;18(24):3435-51.

Fanelli D. How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PloS one. 2009;4(5):e5738.

Simonsohn U. Just post it: The lesson from two cases of fabricated data detected by statistics alone. Psychological Science. 2013;24(10):1875-88.

Hartgerink C, Wicherts J, Van Assen M. The value of statistical tools to detect data fabrication. Research Ideas and Outcomes. 2016;2: e8860. DOI: https://doi.org/10.3897/rio.2.e8860

Wicherts JM. The weak spots in contemporary science (and how to fix them). Animals. 2017;7(12):90. Available:https://doi.org/10.3390/ani7120090.

Piraino SW. Issues in the statistical detection of data fabrication and data errors in the scientific literature: simulation study and reanalysis of Carlisle. BioRxiv. 2017;179135.

Mascha EJ, Vetter TR, Pittet JF. An appraisal of the Carlisle-Stouffer-Fisher method for assessing study data integrity and fraud. Anesthesia & Analgesia. 2017;125(4):1381-1385.

Hüllemann S, Schüpfer G, Mauch J. Application of Benford’s law: a valuable tool for detecting scientific papers with fabricated data?. Der Anaesthesist. 2017;66(10):795-802.

Hartgerink CH, Voelkel JG, Wicherts J, van Assen MA. Detection of Data Fabrication Using Statistical Tools; 2019. Available:https://psyarxiv.com/jkws4/

Rushdi AM, Badawi RMS. Karnaugh-map utilization in Boolean analysis: The case of war termination. Journal of Qassim University: Engineering and Computer Science. 2017;10(1):53-88.

Rushdi AM, Badawi RMS. Karnaugh map utilization in coincidence analysis. Journal of King Abdulaziz University: Computing and Information Technology. 2017;6(1-2): 37-44.

Rushdi AMA. Utilization of Karnaugh maps in multi-value qualitative comparative analysis. International Journal of Mathematical, Engineering and Management Sciences (IJMEMS), 2018;3(1):28-46.

Rushdi AM, Badawi RM. Computer engineers look at qualitative comparative analysis. International Journal of Mathematical, Engineering and Management Sciences (IJMEMS). 2019;4(4):851-860.