Highway and roadway are usually constructed with materials that exhibit distresses after construction due to various loading, environmental conditions. The distresses are presented in the form of surface cracking in most situations. Successful automation of surface distress survey would reduce the overall cost of performing distress surveys and provide more objective and standardized results for rehabilitation management. For the inspection of the surface distress on pavement, the most widely used method to conduct such surveys is based on human observation. The goal of this paper is to develop a user-assisted method for detection of change of pavement surfaces caused by various loading. As a result, we constructed the computer system for surveying surface distress. And we obtained the databases to identify the relationship between surface images and opinions of inspector.