Open Access
Subscription Access
Web Crawler for Social Network user Data Prediction using Soft Computing Methods
This paper addresses how elementary data from a public user profile in Instagram can be scraped and loaded into a database without any consent. Furthermore, discusses how soft computing methods such neural networks can be used to determine the popularity of a user’s post. Conclusively, raises questions about user’s privacy and how tools like this can be used for better or for worse.
Keywords
Social Network, Instagram, Business Intelligence, Soft Computing, Neural Network, User Privacy, ETL, Database, Node.js, Data Analysis.
User
Font Size
Information
- C. Olston and M. Najork, Web Crawling, in Foundations and Trends in Information Retrieval Vol. 4, No. 3 (2010) 175–246.
- GraphQL – Get started with a query language for your API [Web page]. Retrieved September 21, 2018, from https://graphql.org/
- Instagram API [Web page]. Retrieved September 21, 2018, from https://developers.facebook.com/docs/instagram-api/overview/
- What it is ETL [Web page]. Retrieved September 21, 2018, from https://www.sas.com/en_us/insights/data-management/what-is-etl.html
- The Face API Service [Web page]. Retrieved September 21, 2018, from https://docs.microsoft.com/en-us/azure/cognitive-services/face/overview
- What is Power BI [Web page]. Retrieved September 21, 2018, from https://powerbi.microsoft.com/en-us/what-is-power-bi/
- Ulag, A. M. (2018, February 27). Gartner recognizes Microsoft as a leader in BI [Web blog post]. Retrieved September 21, 2018, from https://powerbi.microsoft.com/pt-br/blog/gartner-recognizes-microsoftas-a-leader-in-analytics-and-bi-platforms-for-11-consecutive-years.
- Instagram Terms of Use [Web page]. Retrieved September 21, 2018, from https://help.instagram.com/581066165581870/
- Instagram Data Policy [Web page]. Retrieved September 21, 2018, from https://help.instagram.com/519522125107875/
- K. Michael and M. G. Michael, Computing Ethics – No Limits to Watching, in Com. of the ACM Magazine Vol. 56, No. 11 (2013) 25-28.
- C. J. Qian, J. D. Tang, M. A. Penza, C. M. Ferri, in Instagram Popularity Prediction via Neural Networks and Regression Analysis [Web page]. Retrieved September 21, 2018, from http://cjqian.github.io/docs/instagram_paper.pdf
Abstract Views: 367
PDF Views: 161