期刊名称:International Journal of Grid and Distributed Computing
印刷版ISSN:2005-4262
出版年度:2016
卷号:9
期号:7
页码:43-52
DOI:10.14257/ijgdc.2016.9.7.05
出版社:SERSC
摘要:Recent advancement in Internet Technologies has made web browsing increasingly easy and user friendly. From the traditional method of desktop web browsing and the birth of dial up modem connection, users nowadays are able to enjoy a fast and reliable web browsing via high speed wireless Internet connection and portable mobile devices. Browsing a web has become much easier with the state of the art search engines such as Google, which provide much functionalities which could make browsing easier such as improved crawler, easy to use search interface, web personlization, Web 3.0 support and integration and many more. In order to build a robust and reliable search engine, the developer needs to integrate all the data and present them in a meaningful format for user's viewing convenience. Integrating these data is a tedious task as data usually occur in numerous format, and layout. Furthermore, web developers usually present the data content in various languages of their choice, which made the processing of these data increasingly difficult. There is also no standard convention to represent the data format and even a standardize rule to process this data has not been developed. To resolve this issue, researchers develop data extractor which could effectively extract data from web sources, tabulate them, and used it for further processing. However, not all data are correctly extracted, they may either missed certain valuable information or contain additional unnecessary information. In the case of unnecessary information, researchers use a cleaning method to remove them such that the data extracted are free of errors. Removing these data is important as unnecessary information may affect the accuracy of subsequent extractor tools, hence may eventually prevent the tool from performing its task efficiently. In this research proposal, we embark on a data cleaning tool to clean data using ontology tools. Experimental results show that our tool is highly efficient in data cleaning and is able to outperform existing state of the art tools.