AIRCC's International Journal of Computer Science and Information Technology

Open Access Open Access  Restricted Access Subscription Access

Web Crawler for Social Network user Data Prediction using Soft Computing Methods


Affiliations
1 Federal University of Goias, Brazil
 

This paper addresses how elementary data from a public user profile in Instagram can be scraped and loaded into a database without any consent. Furthermore, discusses how soft computing methods such neural networks can be used to determine the popularity of a user’s post. Conclusively, raises questions about user’s privacy and how tools like this can be used for better or for worse.

Keywords

Social Network, Instagram, Business Intelligence, Soft Computing, Neural Network, User Privacy, ETL, Database, Node.js, Data Analysis.
User
Notifications
Font Size

  • C. Olston and M. Najork, Web Crawling, in Foundations and Trends in Information Retrieval Vol. 4, No. 3 (2010) 175–246.

  • GraphQL – Get started with a query language for your API [Web page]. Retrieved September 21, 2018, from https://graphql.org/

  • Instagram API [Web page]. Retrieved September 21, 2018, from https://developers.facebook.com/docs/instagram-api/overview/

  • What it is ETL [Web page]. Retrieved September 21, 2018, from https://www.sas.com/en_us/insights/data-management/what-is-etl.html

  • The Face API Service [Web page]. Retrieved September 21, 2018, from https://docs.microsoft.com/en-us/azure/cognitive-services/face/overview

  • What is Power BI [Web page]. Retrieved September 21, 2018, from https://powerbi.microsoft.com/en-us/what-is-power-bi/

  • Ulag, A. M. (2018, February 27). Gartner recognizes Microsoft as a leader in BI [Web blog post]. Retrieved September 21, 2018, from https://powerbi.microsoft.com/pt-br/blog/gartner-recognizes-microsoftas-a-leader-in-analytics-and-bi-platforms-for-11-consecutive-years.

  • Instagram Terms of Use [Web page]. Retrieved September 21, 2018, from https://help.instagram.com/581066165581870/

  • Instagram Data Policy [Web page]. Retrieved September 21, 2018, from https://help.instagram.com/519522125107875/

  • K. Michael and M. G. Michael, Computing Ethics – No Limits to Watching, in Com. of the ACM Magazine Vol. 56, No. 11 (2013) 25-28.

  • C. J. Qian, J. D. Tang, M. A. Penza, C. M. Ferri, in Instagram Popularity Prediction via Neural Networks and Regression Analysis [Web page]. Retrieved September 21, 2018, from http://cjqian.github.io/docs/instagram_paper.pdf


Abstract Views: 369

PDF Views: 161




  • Web Crawler for Social Network user Data Prediction using Soft Computing Methods

Abstract Views: 369  |  PDF Views: 161

Authors

Jose L. V. Sobrinho
Federal University of Goias, Brazil
Gelson da Cruz Junior
Federal University of Goias, Brazil
Cassio Dener Noronha Vinhal
Federal University of Goias, Brazil

Abstract


This paper addresses how elementary data from a public user profile in Instagram can be scraped and loaded into a database without any consent. Furthermore, discusses how soft computing methods such neural networks can be used to determine the popularity of a user’s post. Conclusively, raises questions about user’s privacy and how tools like this can be used for better or for worse.

Keywords


Social Network, Instagram, Business Intelligence, Soft Computing, Neural Network, User Privacy, ETL, Database, Node.js, Data Analysis.

References