Intelligent Web Data Extraction System for E-commerce

Abstract

Data is crucial in today’s world for whichever domain is taken to offer a higher and more intuitive experience for a user, Sometimes data is readily available in raw format, and Sometimes we need to extract the data from other websites/sources using advanced web scraping technologies. However, a web scraper that is based on a set of rules fails in the real world because the website's content dynamically and rapidly changes over time which in turn also changes the HTML contents of the website content. This study investigates a mechanism to allow automated web data extraction, In this study, an intelligent web data extraction using convolutional and Residual Neural Networks (ResNet) is developed. Usage of ResNet in the training layer accelrates the over all learning speed of the model.