This paper examined the psychological and physiological influences that clothing patterns have on people, and investigated the impact of the psychological reactions on the physiological mechanism. Images of model wearing several patterns of clothing were created by using three-dimensional soft “iD-Fit” colored in achromatic colors. Fifteen subjects viewed one by one the images of 12 patterns of clothing on the screen and their brainwaves (α wave content) and fluctuations in heartbeat (HF component, LF/HF component) were measured for physiological activity. Psychological analysis was performed using the SD method and factor analysis. The results showed that visual impressions of patterns of clothing consisted of five factors: evaluation, activity, potency, simplicity and warmness-coolness. In the case of geometric patterns of clothing, results showed that the higher the α wave content, the higher the evaluation factor. The 1/f fluctuation also influenced the evaluation factor. When the evaluation ranking was low and the activity ranking was plain, quiet etc ., the HF component was high, and the α wave content increased in the frontal region, resulting in a quiet and comfortable sensation. When the factor of simplicity was low, the LF/HF component was low, resulting in high level of comfort.