We previously developed a method for improving a target image quality based on web images. The target image is conventionally improved by using similar blocks for reference that are generated from web images. However, if bordering blocks have the same reference blocks, the improved image might have an unusual pattern. Therefore, we propose a method for selecting reference blocks based on web images for image quality improvement. Experimental results showed that use of the proposed method improves image quality.