The market for smartphones is set for serious expansion. Juniper Research  is predicting the annual sales of smartphones will swell to 300 million by 2013 - up from about 153 million in year 2008, a rise of around 95 percent. Therefore, the development of mobile phone software well deserves wider attention. This paper introduces a real-time face processing application that was tested in Windows Mobile environment. This work is targeted towards the development of an efficient and intelligent face recognition system. The system is capable of locating the face region using derivative-based filtering, and classifying human face through the use of AdaBoost classifier. The motivation behind this work is that we aim to develop a robust model that can help to locate face for a portable face recognition application. The experiments carried out show that we have achieved the features of mobile application: speed and efficiency, that is able to deploy facial recognition into smartphone.