python Jinjiang literary city novel title crawler + simple data analysis + word cloud visualization

1. Introduction Target site: Jinjiang Literature City Library Crawler Tool: BeautifulSoup Data analysis: pandas, matplotlib Word cloud: wordcloud, re PS.Given that jj boss is very stubborn and has only three servers and only a few offices in the community, it is recommended to slow down the crawl speed by sleep when crawling to reduce the ...

Posted by cbailster on Fri, 08 Oct 2021 11:50:02 -0700

New crawler requests Library

1, Installation of requests Library WIN platform: run cmd with win+R and execute pip install requests Official documents: https://docs.python-requests.org/zh_CN/latest/ Mine is already installed Test after successful installation import requests r = requests.get("http://www.baidu.com") print(r.text) 2, Seven main methods and simpl ...

Posted by javamint on Thu, 07 Oct 2021 18:42:13 -0700

Python crawler tutorial 30: crawling dragnet recruitment data information

preface 💨 The text and pictures of this article come from the network, only for learning and communication, and do not have any commercial purpose. If you have any questions, please contact us in time for handling. Previous content 💨 Introduction to Python crawler 01: Douban Top movie crawling Introduction to Python crawler 02: novel craw ...

Posted by venkyphp on Thu, 07 Oct 2021 11:47:19 -0700

Grabbing the hot review of Changjin lake on Douban, I found these

preface 🔗 Running environment: Python 3🚩 Author: Classmate K📚 From column: Matplotlib tutorial🧿 Excellent column: Introduction to Python 100 questions🔥 Recommended column: Introduction to Xiaobai deep learning🥇 Selected columns: 100 cases of deep learning Everybody, I'm classmate K! Recently, a film "Changjin Lake" ha ...

Posted by spitfire_esquive on Wed, 06 Oct 2021 21:21:59 -0700

pyinstaller packaging selenium + enterprise wechat group sending parameter deployment

catalogue 1. Common errors in waiting and packaging of selenium 2. Call the contents in print and compare the data 3. Enterprise wechat group sending and webhook parameter configuration 4. Summary          1. Common errors in waiting and packaging of selenium         When climbing some dynamic data encrypted by the ...

Posted by mysterio2099 on Tue, 05 Oct 2021 10:44:25 -0700

Python web crawler: a brief introduction to the plot of the Douban movie Top 250

1, Introduction to basic structure of crawling program The first is the library that the program needs to call: import requests import bs4 import os Then write a function to parse the HTML of the web page: headers={'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.61 Safari/537.3 ...

Posted by BluntedbyNature on Sun, 03 Oct 2021 16:40:56 -0700

[recommendation system] research and implementation of personalized recommendation system

1, Search engine and recommendation system         From the perspective of information acquisition, search and recommendation are two main means for users to obtain information. Both search and recommendation coexist on the Internet and offline. Search is an active behavior, and the needs of users are very clear. In the res ...

Posted by thomasgrant on Sun, 03 Oct 2021 15:52:17 -0700

python requests crawler -- crawling for Kai Fu Li's blog information (including some javascript information)

         Today is the second day of the National Day holiday. I've been playing for a day. Today, I'll sort out the ideas of data analysis homework written in the previous two days and type the manuscript for the experimental report. It is a reference for the little partners who are interested in reptiles ...

Posted by dc277 on Sat, 02 Oct 2021 11:33:29 -0700

Use of python crawler selenium

brief introduction - Selenium is one of the most widely used open source Web UI (user interface) automation test suites. ----Let my program connect to the browser and let the browser complete various complex operations. We only accept the final result -----selenium; Automated test tools ----You can open the browser. Then operate the browser l ...

Posted by Jragon on Fri, 01 Oct 2021 13:02:13 -0700

On September 27, 2021, get the names of all books recommended by the new book on the website of the people's post and Telecommunications Publishing House

Title: use the crawler to get all the book names recommended by the new book under this website This is the homework assigned by my teacher after I went online for the reptile course last Thursday. When I did it, I didn't know how to use the cycle. After consulting the students next to me, I probably understood the method used for this problem ...

Posted by woolyg on Mon, 27 Sep 2021 06:40:44 -0700