|Year : 2014 | Volume
| Issue : 3 | Page : 277-280
Detection of dechallenge in spontaneous reporting systems: A comparison of Bayes methods
A Bazila Banu1, S Appavu Alias Balamurugan2, Ponniah Thirumalaikolundusubramanian3
1 Department of Information Technology, Velammal College of Engineering and Technology, Madurai, Tamil Nadu, India
2 Department of Information Technology, K.L.N College of Information Technology, Madurai, Tamil Nadu, India
3 Department of Medicine, Chennai Medical, College Hospital and Research Centre, Irungatur, Trichy, Tamil Nadu, India
|Date of Submission||04-Jul-2013|
|Date of Decision||28-Aug-2013|
|Date of Acceptance||25-Mar-2014|
|Date of Web Publication||9-May-2014|
A Bazila Banu
Department of Information Technology, Velammal College of Engineering and Technology, Madurai, Tamil Nadu
Source of Support: None, Conflict of Interest: None
Aim: Dechallenge is a response observed for the reduction or disappearance of adverse drug reactions (ADR) on withdrawal of a drug from a patient. Currently available algorithms to detect dechallenge have limitations. Hence, there is a need to compare available new methods. To detect dechallenge in Spontaneous Reporting Systems, data-mining algorithms like Naive Bayes and Improved Naive Bayes were applied for comparing the performance of the algorithms in terms of accuracy and error. Analyzing the factors of dechallenge like outcome and disease category will help medical practitioners and pharmaceutical industries to determine the reasons for dechallenge in order to take essential steps toward drug safety.
Materials and Methods: Adverse drug reactions of the year 2011 and 2012 were downloaded from the United States Food and Drug Administration's database.
Results: The outcome of classification algorithms showed that Improved Naive Bayes algorithm outperformed Naive Bayes with accuracy of 90.11% and error of 9.8% in detecting the dechallenge.
Conclusion: Detecting dechallenge for unknown samples are essential for proper prescription. To overcome the issues exposed by Naive Bayes algorithm, Improved Naive Bayes algorithm can be used to detect dechallenge in terms of higher accuracy and minimal error.
Keywords: Adverse drug reaction, food and drug administration, improved naive bayes, medical dictionary for regulatory activities, naive bayes, preferred terms, system organ class, World Health Organisation
|How to cite this article:|
Banu A B, Alias Balamurugan S A, Thirumalaikolundusubramanian P. Detection of dechallenge in spontaneous reporting systems: A comparison of Bayes methods. Indian J Pharmacol 2014;46:277-80
|How to cite this URL:|
Banu A B, Alias Balamurugan S A, Thirumalaikolundusubramanian P. Detection of dechallenge in spontaneous reporting systems: A comparison of Bayes methods. Indian J Pharmacol [serial online] 2014 [cited 2017 Apr 24];46:277-80. Available from: http://www.ijp-online.com/text.asp?2014/46/3/277/132157
| » Introduction|| |
Causality assessment (CA), is a method of evaluation used in pharmacovigilance to find out the relationship between drugs exposed and reported Adverse drug reactions (ADR). It includes, finding the temporal relationship between drugs and reported ADR, dechallenge, rechallenge, clinical and pathological characteristics of the events.  It is difficult for the practitioner with careful monitoring to identify the drugs causing ADR. In such a condition the withdrawal of drugs one at a time and evaluating the reaction of dechallenge has become essential. Hence a simple method of analysis for detecting dechallenge was considered in this study. Dechallenge is a response observed in a patient such as reduction or disappearance of ADR after withdrawal of a drug. There are two types of dechallenge namely Positive dechallenge which resolves with the withdrawal of drug and the Negative dechallenge which follows a course of its own.  Decision on the withdrawal of drug has been considered from the point of ADR underlying the disease. Rechallenge is essential to confirm the cause and relationship of ADR.  A typical procedure has to be followed before attempting rechallenge, with an understanding of risk involved for the patient. So the prescribers and the patients may not come forward for the procedures involved except on a few occasions. The prescribers too prefer to adopt dechallenge rather than rechallenge. Detecting adverse drug reactions and dechallenge have attained significance in personalized medicine. 
Data mining is a kind of statistical approach for discovering useful patterns from enormous amount of data.  It contains algorithms to find out the pattern by means of various approaches like classification, prediction, clustering and association. Data-mining algorithm called Multi-item Gamma Position Shrinker is now used for signaling potential ADRs by Food and Drug Administration (FDA) in US. 
The Naive Bayes (NB) a statistical classifier predicts class membership probabilities widely used by researchers in data mining for classification. It is assumed that all the variables contributing toward classification are mutually independent. It leads to a simple prediction framework which gives good results in many cases. There is a possibility of obtaining zero probability. To overcome this, a standard technique like laplacian correction was used.  Various attempts have been made to resolve this issue. 
| » Materials and Methods|| |
Medical Dictionary for Regulatory Activities (MedDRA), an international medical terminology developed under the auspices of the International Conference of Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) is a controlled medical vocabulary for describing adverse events with five levels: the coarsest is System Organ Class (SOC), followed by High Level Group Term (HLGT), Higher Level Term (HLT), Preferred Term (PT), and Lowest level Term (LLT), the finest grained description.  ADRs in FDA 2011 and 2012 were considered in the present study. Data were extracted from SRS provided by FDA. The duplicate reports were deleted in accordance to FDA's recommendation of adopting in recent case number as described in one of the files"Asc-nts.doc' from the website of the FDA. 
FDA had stored diseases category at Preferred Terms (PT) level. Among the five levels of adverse events hierarchy of MedDRA, SOC level was used to classify the diseases category by referring to cancer therapy evaluation program simplified disease classification v4.0 (MedDRA v 12.0).  Researchers suggested that it might be more advantageous to perform data mining, using a coarser grained adverse event representation SOC than PT level. The data were loaded from FDA's text file to oracle database using Extract, Transform and Load (ETL) tools. Indices were constructed using patient identifier. Records with SOC as gastrointestinal, renal and urinary, metabolism and nutrition disorders were considered for dechallenge classification.
The attributes considered to evaluate dechallenge were the diseases categories denoted as System Organ Class (SOC) in MedDRA, drug with valid trade and verbatim name represented by code 1 and 2 by FDA, outcoming like Life-Threatening (LT), Death (DE), Congenital Anomaly (CA), Hospitalization-Initial or Prolonged (HO), Disability (DS), Required Intervention (RI) to prevent permanent impairment had been considered for determining the occurrence of dechallenge. The process of determining suitable algorithm for detecting dechallenge was accomplished by comparing NB and NB + .
The performance of data mining algorithm was estimated by the parameters like percentage of Accuracy, Error, Precision and Receiver Operating Characteristic (ROC) curve. All the parameters were depicted by 2 × 2 confusion matrixes, containing the total number of True Positive (TP), True Negative (TN), False Positive (FP) and False Negative (FN), where Positive referred to identified set and Negative to rejected set. Accuracy, Precision and Error were calculated by Formula 1, 2 and 3 as follows:
ROC curve was used to convey the graphical representation of Perfect, Liberal, Random and Conservative performance of an algorithm.
Statistical data mining techniques had been implemented in the field of post-marketing surveillance. Yanqing and Hao et al., proposed an algorithm for casual association between two events.  Safety signal detection problems in pharmacovigilance were examined by Roy and Jeffrey et al.,  Statistical data sources and data mining methods used in safety signal were studied by Atsuko and Manfred et al., Liang and Rongzhan et al., applied the concept of decision tree algorithm for classification in drug safety.  Corani and Zaffalon proposed an extension of NB named as Naive Credal Classifier to issue reliable classifications for a domain with high uncertain information.  Denis et al., proposed a classifier for eliminating noise in the dataset.  Chen and Shengrui proposed classification method for high dimensional data.  Kotsiantis and Pintelas modified NB classifier using bagging and boosting procedures.  Zhang et al., proposed a novel model called Hidden Naive Bayes to avoid computational complexity. 
Data Mining Model
For Data mining model, each patient was identified by unique number. The other data were outcome of drug and disease category. Drug classified by FDA as 1 for valid trade and 2 for verbatim name. The disease category was denoted in SOC level, by mapping the PT of FDA with MedDRA PT using Extensible Markup Language (xml) mapping. ,
The Algorithms Used
The fundamental assumption to attribute independence was considered in this study. Dechallenge attribute presented in FDA records were taken as class label for detection. NB theorem given in Formula 4 had been used to calculate the probability of an outcome. The class label attribute dechallenge had two distinct values (Yes, No) represented by hypothesis (H).
P(H/X) is the posterior probability where hypothesis (H) represents the presence of dechallenge with X as known disease category, drug code and outcome. P (X/H) is the posterior probability of X on the subject of H. P (H) is the prior probability of H regardless of disease category, drug code and outcome. P(X) is the prior probability of X.
For calculating the prior probability P (X), dechallenge record sets with 'unknown' category were filtered. Then the posterior probability was calculated based on outcome, disease category and drug code. The data set of 2011 and 2012 records contained the constraints mentioned for the failure of Naive Bayes classifier. To overcome this, NB + algorithm  proposed by Balamurugan et al., was applied in the present study as detailed below.
Improved Naive Bayes
This algorithm starts with the Influence Factor as the first step to determine the dependability of an attribute value on the class attribute. Influence Factor was calculated for the attributes drug code, disease category and outcome on the class label dechallenge. Formula 5 was used to calculate the Influence factor.
Where I(X/Ci)=Influence Factor
N(X\C i ) =Number of records in which attribute value X had the class label C i and N(Ci)=Total Number of records in which the class label were C i .The dataset was divided based on the class label dechallenge 'Yes' and 'No'. Influence factor for attributes with high values were taken and others ignored.
| » Results|| |
It is observed from [Table 1], Influence Factor is high for outcomes such as HO and LT, drug code with code 1 and disease category such as gastrointestinal disorder. The value of dechallenge is 'Yes' for combinations like gastrointestinal disorder with outcome as HO and LT and for drugs with code 1. Hence classifying the dechallenge for unknown records with same combinations of attributes can be predicted as 'Yes'. Experiments with 10-fold cross validation have been carried out to evaluate the accuracy.
Performance analysis of NB and NB + provided in [Table 2], where the average accuracy of NB + is 90.11 and NB is 70.25, average error of NB is 19.8 percent higher than NB +],[ and precision of NB + is 7.4 percent higher than NB. It is observed from experimental result, NB + performs well in case of attributes with categorical values and zero probability issue. In the ROC graph shown in [Figure 1], although NB fits in the category of Liberal performance with True Positive Rate as (.7, .8, .9, .9), there is also substantial number of False Positive Rate (.6, .7, .6, .5); whereas NB + fits in Perfect performance with True Positive Rate as (.9, .9, .9, .9), and minimal False Positive Rate as (.2, .8, .0, 0). Records from 2011 to 2012, classified as "unknown" by NB, are predicted by NB + using influence factor analysis.
|Figure 1: Receiver operating characteristic curve for improved naïve bayes and naive bayes|
Click here to view
|Table 1: Infl uence factor analysis of outcome, disease category, and drug code with dechallenge|
Click here to view
|Table 2: Comparison of performance analysis of error, precision and|
accuracy of NB and NB+
Click here to view
| » Discussion|| |
The FDA uses data mining to screen the AERS database using Bayesian protocol for the presence of disproportionality in large adverse event-drug product pairs, , but the data must be evaluated to determine causality reviews like dechallenge. The performance of any data-mining algorithm depends on the type of attributes and its application. A common means of identifying the association between drug and disease in pharmacovigilance is through disproportionality analysis. This produces the results based on 2 × 2 tables as there are relevant drug and ADR combination. Hence for large amount of data, this method will produce more number of tables which reduces the effectiveness of the approach. It is essential to apply extra mathematical formula in data forecasting methods of pharmacovigilance. 
Several studies reported the need of data mining algorithms to review the data to make authoritative conclusion.Many studies reported the usage of mining algorithms like Proportional Reporting Ratio, Multi-item Gamma-Poisson Shrinker. Further investigation of statistical methods to analyze large amount of data is essential to improve the effectiveness of pharmacovigilance activities.  Hence in this study the data mining algorithms like NB and NB + for determining the performance of algorithms in enormous data for detecting dechallenge have been investigated.
Among the 26 SOC disease categories,  the results presented here are based on 3 SOCs such as gastrointestinal, metabolism and nutrition, renal and urinary disorders. When NB is used to detect the dechallenge, the posterior probability is zero for records with outcome as 'CA' and disease category as gastrointestinal disorder. Hence 72 records of the year 2011 fourth quarter are classified as 'unknown' by NB algorithm. The algorithm fails when the probability of a particular outcome or disease is uniformly distributed. When NB is used, such unknown samples will become inadequate for future analysis. This inadequacy measure may cause fault in the detection. All the records stored in SRS need to be analysed for carrying pharmacovigilance activities. NB + resolved zero probability issue by determining attributes with High Influence Factor and thus reducing the noise present in data for effective detection of dechallenge. NB + can be applied to any dataset which suffers from zero probability exertion.
From the experimental analysis, it is clear that NB + can be used for large data set in detecting causality reviews. For the FDA record sets, NB + produced higher accuracy than NB and detected the dechallenge value as "Yes " for drugs with code 1 and gastrointestinal disorder with outcome as HO and LT.Influence Factor Analysis in NB + proved the usage of this algorithm in pharmacovigilance for predicting unknown samples.
| » Conclusions|| |
Most data available in FDA and World Health Organisation (WHO) have neither brought in health science education, nor trained to utilise for patient care purpose. Post-marketing surveillance techniques like detecting dechallenge will help the practitioners and prescribers to gain knowledge about drugs with various reactions. Hence unknown samples should be classified properly for data analysis. FDA suggests the evidence of dechallenge as the most important criteria for causality reviews. The outcome of the classification algorithms show that NB + outperformed NB in traditional interesting measures like accuracy and minimal error in classifying dechallenge.
| » References|| |
|1.||Talbot J, Waller P. Stephens detection of new adverse drug reactions. 5 th ed. United States: John Wiley and Sons; 2005. p. 173-5. |
|2.||Coulter D, Shanthi N, Falzon D. A practical handbook on the pharmacovigilance of medicines used in the treatment of tuberculosis. Geneva: World Health Organization press; 2012. p. 109-10. |
|3.||MannD, Andrews B. Phamacovigilance. 2 nd ed. United States: John Wiley and Sons; 2007. p. 239-40. |
|4.||Leaman R, Wojtulewicz L, Sullivan R, Skariah A, Yang J, Gonzalez G. Towards Internet Age Pharmacovigilance: Extracting Adverse drug reactions from user posts to health related social networks. Vol. 10. Stroudsburg, PA, USA: Association for Computational linguistics; 2010. p. 117-25. |
|5.||Han J, Kamber M. Data mining concepts and techniques. 2 nd ed. United States: Morgan Kaufmann Publishers; 2006. p. 310-5. |
|6.||Ji Y, Ying H, Dews P, Tran J. An exclusive leverage measure for detecting adverse drug reactions from electronic medical records. Fuzzy Information Processing Society, Institute of electrical and electronics engineers, 2011.p. 1-6. |
|7.||Balamurugan S, Rajaram R, Pramala S, Rajalakhsmi S. NB +: An improved naive bayes algorithm. Knowledge Based Systems. Vol. 24. Netherlands: Elsevier; 2010. p. 563-9. |
|8.||Pearson R, Hauben M, Goldsmith D, Lawrence Gould A. Influence of the MedDRA ® hierarchy on pharmacovigilance data mining results. International journal of medical informatics. Vol. 78. Netherlands: Elsevier; 2009. p. 97-103. |
|9.||United States Food and Drug Administration. FDA adverse event reporting system. Available from: http://www.fda.gov/Drugs/GuidanceComplianceRegulatoryInformation/Surveillance/AdverseDrugEffects/ucm082193.htm [Last accessed on 2012 Oct 03]. |
|10.||Cancer therapy evaluation program. Simplified disease classification V4.0 (MedDRA V 12.0). United States: National Cancer Institute; 2012. Available from: http://www.ctep.cancer.gov. [Last accessed on 2012 Apr 05]. |
|11.||Ji Y, Ying H, Tran J. A method for mining infrequent casual associations and its applications in finding adverse reaction signal pairs. IEEE Trans Knowl Data Eng 2013; 25:721-33. |
|12.||Roy S, Jeffrey S. Data fusion aspects of pharmacovigilance. Institute of electrical and electronics engineers, 2011;11:1-7. |
|13.||Shibata A, Hauben M. Pharmacovigilance signal detection and signal intelligence overview. Chicago, IL: IEEE-International Conference on Information Fusion; 2011;11: 1-7. |
|14.||Ye L, Lu R, Shao Q. Application of Decision tree algorithm to GSP analysis and assessment of drug safety situation. Int Symp Knowl Acquis Model 2009; 9:103-6. |
|15.||Corani G, Zaffalon M. Lazy Naive credal classifier. International workshop on knowledge discovery from uncertain data. Association for Computing Machinery, 2009;9:30-7 . |
|16.|| Denis F, Magnum NC, Ralaivola L. Efficient learning of naive bayes classifiers under class conditional classification noise. International conference on machine learning. Association for Computing Machinery. 2006; 6:265-72. |
|17.||Chen L, Wang S. Automated feature weighting in naive bayes for high dimensional data classification. International conference in information and knowledge management. Association for Computing Machinery 2012; 12:1243-52. |
|18.||Kotsiantis SB, Pintelas PE. Logitboost of simple bayesian classifier. Informatica 2005;29:53-9. |
|19.||Zhang H, Jiang L, Su J. Hidden Naive Bayes. Am Assoc Artif Intell 2005; 5:919-24. |
|20.||Yu T, Stahnikam B. Developing xml applications with oracle xml db. Available from: http://www.oracle.com/technetwork/Database/features/xmldb/s311509-developingxmlapplicationswi-132942.pdf. [Last accessed on 2012 Oct 05]. |
|21.||Banu AB, Balamurugan S, Thirumalaikolundusubramanaian P. Ranking drugs in spontaneous systems by naive bayes. J Biol Sci 2013;13:293-97. |
|22.||Weaver J, Willy M, Avigon M. Informatic tools and approaches in postmarketing pharmacovigilance used by FDA. AAPS J 2008;10:35-41. |
|23.||Ji Y, Ying H, Dews P, Mansour A, Tran J, Miller RE, et al. A potential casual association mining algorithm for screening adverse drug reactions in post marketing surveillance. IEEE Trans Inf Technol Biomed 2011; 15:428-37. |
[Table 1], [Table 2]