Sketch recognition is one of the most challenging applications of face recognition. Due to the incorrectness of features in the witness description, standard face recognition algorithms are generally not applicable to matching sketches with digital face images. This research designs a patch based face recognition algorithm that generates patches around fiducial features and extracts local information from these patches using Daisy descriptor. The information extracted from these patches are then efficiently matched using GentleBoostKO algorithm. The experiments performed on the PRIP composite face image database show that the proposed algorithm yields promising results and outperforms existing state-of-the-art algorithms and a commercial system. © 2013 IEEE.