Aiming at interactivity based on visitors' behaviors in museum buildings and depending on digital technique such as virtual reality technology, multimedia technology and informational technology, interactive museum building uses unique information exchangeable method to communicate. At first, this paper clarifies merit and demerit of methods, which can improve interactive effect to determine the superiority of video method which can track visitors' dynamic behavior on-the-spot investigation. Then taking walking path, position, duration as basic data of interactive study, this paper analyzes the behavior characteristics of three types of visitors (student groups, family-based collectives, the old in communities). Finally, this paper tries to conclude four strategies of interactive design: exploring the inevitable behaviors of visitors; visualizing sensory interaction; emphasizing connection between unit module deformation; making joint efforts to build virtual and physical environment by virtue of digital technique. Result shows that the relationship among visitors' behaviors, exhibitions and displayed space forms a dialogue on the basis of equality. On the basis of clarifying the interactive relationship among exhibition layout, streamline organization and exhibition space, and adding digital technique, interactive behaviors would strengthen the consciousness visiting, and allow visitors deepen memory of exhibition information through exploration and novelty, and could guide museum building design.