Laser ablation inductively coupled plasma mass spectrometry (LA-ICP-MS) was applied to the determination of trace elements in glass fragments by ablating a rough surface of it for the forensic discrimination of extremely small glass fragments of irregular shape by comparison of elemental compositions. Two fragments were taken from each of a glass standard reference material (NIST SRM 612) and five different sheet glass samples and used to make fragments with a flat or rough surface for each of them. Mass spectra of the 5 sheet glass indicated that the comparison of concentrations for 10 elements (Co, Rb, Sr, Zr, Mo, Ba, La, Ce, Nd and Pb) would be useful for the discrimination of the sheet glass sample. The concentrations for these elements in the fragments made from the sheet glasses were determined by LA-ICP-MS using NIST SRM 612 as one-point external standard and compared with those by solution nebulization ICP-MS (SN-ICP-MS), which were validated by analyzing NIST SRM 612. Measured values by LA-ICP-MS using either a flat or rough surface showed satisfactory good agreement with those by SN-ICP-MS with no significant difference between flat and rough surfaces, which demonstrates that analytical results obtained by LA-ICP-MS was as accurate and precise as those by SN-ICP-MS. LA-ICP-MS using either a rough or flat surface allowed complete discrimination of five sheet glasses. From these results, it is strongly recommended that LA-ICP-MS should be applied to extremely tiny fragments of irregular shaped glass in actual cases without any pretreatment such as polishing, to reduce the risk of sample loss.