To investigate the rationality of zirconium tungstate (ZT) with hydrophilia property as the filler of asphalt mixture, the surface energy parameters and work of adhesion for different fillers and binders were investigated based on the surface energy and adhesive work theory. A moisture conditioning test method applied to asphalt mastic was proposed, and then the variations of surface energy and pull-off strength of asphalt mastics were studied. Test results indicate that ZT has larger Lewis basic component and Lifshitz van der Waals component, and 70# asphalt has larger Lewis basic and acid component and Lifshitz van der Waals component when compares to SBS asphalt. ZT presents stronger adhesive bond to asphalt at dry condition than mineral filler. However, water may be easier to enter into the interface between ZT and asphalt, and replace the asphalt film on the surface of filler. Asphalt mastic made with ZT shows the worse moisture damage resistance when compares with asphalt mastic made with normal mineral filler.