Software Engineering

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

Comparison of Extracting Data Using End-user Visual Tools and Traditional Methods


Affiliations
1 Department of Management information systems, Higher Institute of Advanced Studies, Egypt
2 Department of Software Engineering, Faculty of Statistical Studies and Research, Cairo University,, Egypt
     

   Subscribe/Renew Journal


End users including technical and non-technical are facing many problems regarding extracting big amount of data through public websites. Our aim here is that we try to provide a way or solution to extract needed data faster, more accurate, with no code and easy to be used for technical users and nun-technical users as well.

Keywords

Visual Web Scraping Tool, RPA, UiPath, data extraction, Web crawling, Dynamic Websites, Robots
User
Subscription Login to verify subscription
Notifications
Font Size

  • Legaspi Xurxo, “Scraping de sitios web dinámicos para datos económicos,” 2016.

  • Joel Willers, “Methods for extracting data from the Internet,” pp. 9–25, 2019.

  • N. R. Haddaway, “The use of web-scraping software in searching for grey literature,” Grey J., vol. 11, no. February, pp. 186–190, 2016.

  • A. Extract, I. Business-, and C. W. Data, “Robotic Process Automation for Web Data Extraction”.

  • “December 2021,” J. Ubiquitous Comput. Commun. Technol., vol. 3, no. 4, 2021, doi: 10.36548/jucct.2021.4.

  • I. Dongo et al., “A qualitative and quantitative comparison between Web scraping and API methods for Twitter credibility analysis,” Int. J. Web Inf. Syst., vol. 17, no. 6, pp. 580–606, 2021, doi: 10.1108/IJWIS-03-2021-0037.

  • M. A. Khder, “Web scraping or web crawling: State of art, techniques, approaches and application,” Int. J. Adv. Soft Comput. its Appl., vol. 13, no. 3, pp. 144–168, 2021, doi: 10.15849/ijasca.211128.11.

  • J. Kharade and I. Technology, “DATA COLLECTION USING WEB SCRAPPING WITH ROBOTIC PROCESS DATA COLLECTION USING WEB SCRAPPING WITH ROBOTIC,” no. August, 2022.

  • D. Glez-Peña, A. Lourenço, H. López-Fernández, M. Reboiro-Jato, and F. Fdez-Riverola, “Web scraping technologies in an API world,” Brief. Bioinform., vol. 15, no. 5, pp. 788–797, 2013, doi: 10.1093/bib/bbt026.

  • N. Levine, “How to Copy and Select Text on Websites that Don‟t Allow It,” 2022. https://www.wikihow.com/Copy-Text-That-Cannot-Be-Copied

  • F. Polidoro, R. Giannini, R. Lo Conte, S. Mosca, and F. Rossetti, “Web scraping techniques to collect data on consumer electronics and airfares for Italian HICP compilation,” Stat. J. IAOS, vol. 31, no. 2, pp. 165–176, 2015, doi: 10.3233/sji-150901.

  • CFI Team, “Stock Keeping Unit (SKU),” 2021. https://corporatefinanceinstitute.com/resources/knowledge/other/stock-keeping-unit-sku/


Abstract Views: 284

PDF Views: 0




  • Comparison of Extracting Data Using End-user Visual Tools and Traditional Methods

Abstract Views: 284  |  PDF Views: 0

Authors

Atef Raslan
Department of Management information systems, Higher Institute of Advanced Studies, Egypt
Ahmed N.Abdelbaset
Department of Software Engineering, Faculty of Statistical Studies and Research, Cairo University,, Egypt
Al- Hussein A. Galal
Department of Software Engineering, Faculty of Statistical Studies and Research, Cairo University,, Egypt
Mohamed A. Abdelaziz
Department of Software Engineering, Faculty of Statistical Studies and Research, Cairo University,, Egypt

Abstract


End users including technical and non-technical are facing many problems regarding extracting big amount of data through public websites. Our aim here is that we try to provide a way or solution to extract needed data faster, more accurate, with no code and easy to be used for technical users and nun-technical users as well.

Keywords


Visual Web Scraping Tool, RPA, UiPath, data extraction, Web crawling, Dynamic Websites, Robots

References