Epicardial adipose tissue is a visceral fat that has remained an entity of concern for decades owing to its high correlation with coronary heart disease. It continues to stump medical practitioners on the pretext of its relevance with pericardial fat and its dependence on a numerous other parameters including ethnicity and physique of an individual. This calls for a fool-proof algorithm that promises accurate classification and segmentation, hence an immaculate prediction. CT is immensely popular and widely preferred for diagnosis. Implementation of an improvised algorithm in CT would be a natural necessity. This research work proposes a Fruitfly Algorithm based Modified region growing algorithm is applied to the acquired CT images to segment fat accurately. The proposed methodology promises image registration and classification in order to segment two cardiac fats namely epicardial, pericardial and mediastinal. The main contributions are (1) Fat feature extraction: Construction of GLCM features CT image (2) Development of GWO based optimal neural network for classification; (3) Modeling the fat segmentation using modified region growing algorithm with Fruitfly optimization. The entire experimentation has been implemented in MATLAB simulation environment and final result is expected to flaunt a definite distinction between cardiac mediastinal and epicardial fats. Parallely, the accuracy, sensitivity, specificity, FPR and FNR have been stated and contrasted methodically with the existing methodology. This venture aims at spurring the healthcare industry towards smarter computational techniques that multiplies efficiency manifold.