Are you sure that it is a maginifying glass on the blue icon? Sure it is not an outline of a person? If it has some color tabs on the right side of the blue box and an outline of a person on it, then that is the contacts application. The figure of the person at the bottom of the screen is just a link to the contacts application.
Personally, I just went through all of my contacts and added the important ones to my Contact Favorites. That shortened a huge list into one that is much more manageable.