In this paper we present a novel and robust algorithm for automatic recognition of road signs by using histogram of oriented gradient (HOG) as the main feature and minimum distance classifier (MDC) to classify numbers written on speed limit road signs. It also describes how other geometrical properties can be added to feature vector in order to increase the robustness of proposed algorithm.