In analyses of spatial interaction data, geographical distances had been used as proxy for costs between origins and destinations. However, it has been pointed out that these data are influenced by invisible geographical and historical factors between two areas as well as simple geographical distances, and there has been a growing literature, which point out the importance and necessity of research on this spatial structure. In this research, the “Odds Ratio Decomposition Method II” developed by Higuchi is applied to the Japanese inter-prefectural telephone traffics data, and they are decomposed to push and pull factors and spatial structure. Characteristics and determinants of push and pull factors are thus successfully examined by panel analysis without effects of spatial structure.