Many researchers have been developed the technique using high luminance and contrast projection display to control and reproduce the appearance on the various objects. It is important to reproduce glossiness among appearance. However, the shape and the position of the glossiness part is changed by the observer's eye position, it had not been considered. Then, in this research, the glossiness part of the object from each aspect is calculated based on the observing point information acquired with a magnetic positional sensor and it's projected by a projector. With this technique, we can control and reproduce the appearance following to the eye position on real-time.