Data mining means mining knowledge from large amount of data. Classification is one of the essential role in the field of healthcare. Diagnosis of health conditions is a very important and challenging task in field of medical science. There are various types of diseases are diagnosis in medical science. Heart disease is the leading cause of death in the world over the past ten years. Heart diseases classification is one of the important problems in medical science because it is directly related to health condition of human body, this type of disease can be solved by proper identify and carefully treatment. In this paper Attribute selection, Naive Bayes, Gini index and Bayesian classification are applied for heart disease data. And also compared for classifying the accuracy.