Open Access
Subscription Access
Clothing Information Collection Based on Theme Web Crawler
With the rapid development of big data technology, many 'sleeping' data can be utilized, but the source of data is the key point. The previous methods of obtaining data can no longer meet the demand. This article uses python web crawler to down jacket of Alibaba International Station. Information (shell material, structure type, fill material, process information, and style information) is crawled and stored in the MongoDB database for data sources for apparel information analysis.
Keywords
Data Mining, Python Web Crawler, Clothing Information Analysis, Down Jacket.
User
Font Size
Information
- Yang Wengang, Han Haitao. Archives Information Collection Based on Topic Web Crawler in Big Data Background [J]. LANT World, 2015, 478 (20):20-21.
- Jia Qiran. Design and Implementation of a Python-Specific Web Crawler [J]. Computer Knowledge and Technology, 2017, 13(12): 47-49.
- Jiang Shanbiao, Huang Kailin, Lu Yujiang, etc. Design and Implementation of Professional Web Crawler Based on Python [J].Enterprise Science and Technology Development, 2016 (8): 17-19.
- Li Daizhen, Xie Liyan, Qian Shenyi, et al. Design and Implementation of Distributed Reptilian System Based on Scapy [J].Journal of Hubei University for Nationalities (Natural Science Edition), 2017, 35 (3): 317-322.
- Sun Bing.Design and Implementation of Python-based Multithread Network Crawler [J].Network Security Technology and Applications, 2018(4).
- Zhang Shuxin. Design and implementation of commodity information collection system based on web crawler[D]. Xiamen University, 2016.
- Zheng Zheng, Zhao Fei, Zhou Xin-hua.Research and Implementation of Enterprise Policy Information Collection Based on Theme Web Crawler[J].Computer Knowledge and Technology, 2017, 13 (5X): 49-51.
- Wang Bin,Zhang Yunwei,Liu Jian,et al.A design of web crawler for agricultural information subject[J].Anhui Agricultural Science,2009,37(20): 9699-9700.
- Liu Zhijie. Topic web crawler search strategy and topic identification method [D]. Wuhan Institute of Technology, 2017.
- Liu Jiancheng, Wu Baoguo, Chen Dong.Research and development of forest management knowledge acquisition system based on Web crawler[J].Journal of Zhejiang Agricultural and Forestry University, 2017, 34 (4): 743-750.
Abstract Views: 260
PDF Views: 0