The essence of macro rutting of asphalt pavement is the result of the evolution of the meso-structure of the mixture. To understand the development process of rutting behavior, the evolutionary mechanism of rutting in asphalt mixture was investigated based on the Jamming transition theory of particle materials. The image processing technology was used to construct a meso-structure model of the asphalt mixture. Rutting simulation tests were conducted based on the time-temperature equivalence principle. The macro and micro variations of the mixture structure during rutting deformation were analyzed. The influence of Unjamming behavior in asphalt pavement and the evolution mechanism of rutting were investigated. The results show that the rutting evolution process of the asphalt mixture can be explained well by the Jamming transition theory, in which the depth of rutting is closely related to the jamming degree of the asphalt mixture system. With the increase of loading time and loading force, the Jamming degree of the mixture particle system gradually increases, along with the increase of rut depth and area fraction, and eventually tends to a stable state. The Jammed state of the particle system is affected by the joint action of asphalt mortar and aggregate skeleton. With the increase in the test temperature, the particle displacement and displacement difference inside the specimens increased, and the Jamming blockage degree of mixture particle system decreased. The transition of the asphalt pavement particle system from a stable Jammed state to an unstable Unjammed state is the internal mechanism inducing rutting and oil flooding. This study successfully applied the Jamming theory to an amorphous system, providing a new research method for understanding the rutting evolution behavior of asphalt mixture.