Character recognition is the important area in image processing and pattern recognition fields. Handwritten character recognition has received extensive attention in academic and production fields. The recognition system can be either on-line or off-line. Off-line handwriting recognition is the subfield of optical character recognition. India is a multi-lingual and multi-script country, where eighteen official scripts are accepted and have over hundred regional languages. In this paper we propose Zone centroid and Image centroid based Distance metric feature extraction system. The character centroid is computed and the image (character/numeral) is further divided in to n equal zones. Average distance from the character centroid to the each pixel present in the zone is computed. Similarly zone centroid is computed and average distance from the zone centroid to each pixel present in the zone is computed. We repeated this procedure for all the zones/grids/boxes present in the numeral image. There could be some zones that are empty, and then the value of that particular zone image value in the feature vector is zero. Finally 2*n such features are extracted. Nearest neighbor and Feed forward back propagation neural network classifiers are used for subsequent classification and recognition purpose. We obtained 99 %, 99%, 96% and 95 % recognition rate for Kannada, Telugu, Tamil and Malayalam numerals respectively.