Basic use of crawler Requests
Basic use of Requests
install
pip install requests
I. Requests module request
Get web page (without parameters)
r = requests.get('http://www.chinahufei.com')
r = requests.post('http://www.chinahufei.com')
r = requests.delete('http://www.chinahufei.com')
r = requests.head('http://www.chinahufei.com')
r = requests.options('http://www.chinahuf ...
Posted by wefollow on Wed, 04 Dec 2019 15:37:24 -0800
Python 3 crawler practice -- Netease technology rolling news crawling
Background needs
At the same time of finishing the task, practice the crawler, and use the Xpath to match the content to be crawled;
News interface to be crawled
Information to be crawled
Implementation code
#!/usr/bin/env python
# -*- coding: utf-8 -*-
# @Time : 2019/3/13 13:08
# @Author : cunyu
# @Site : cunyu1943.github.io
# @File ...
Posted by Mr Chris on Wed, 04 Dec 2019 08:41:03 -0800
Sao operation! Once loved! Using Python to clean up invalid websites in favorites
Preface
The text and pictures of this article are from the Internet, only for learning and communication, not for any commercial purpose. The copyright belongs to the original author. If you have any questions, please contact us in time for handling.
Author: Xiaozhan & Arbor
PS: if you need Python learning materials, you can click the link ...
Posted by motofzr1000 on Wed, 04 Dec 2019 04:04:56 -0800
Using spring's special bean s to complete the distributed configuration
I. foreword
Decentralized configuration idea: create a properties file, add data, configure the properties file in the beans file first, and then use placeholders to reference data in beans
For many processing interfaces in the bean's life cycle, the processing method is spring's own bean, that is, spring's special bean
2. When the property f ...
Posted by amites on Wed, 04 Dec 2019 01:29:06 -0800
Factory method pattern - Design Pattern
The factory method pattern optimizes the simple factory pattern by introducing abstract factory class to make the system more open and close.
Let's use an example to simulate the factory method pattern
Create an abstract factory first
package FactoryMethodPattern;
public interface LoggerFactory {
public Logger createLo ...
Posted by PatelNehal on Tue, 03 Dec 2019 12:13:02 -0800
Remember account number and password of login page
First, configure the login xml file, and set two EditText, a Button and a CheckBox;
The configuration code is as follows:
<?xml version="1.0" encoding="utf-8"?>
<EditText
android:id="@+id/et_userName"
android:layout_width="300dp"
android:layout_height="wrap_content"
/>
</Li ...
Posted by anoopmail on Tue, 03 Dec 2019 08:13:44 -0800
FTP file upload and download
During the development of uploading and downloading files on FTP, you can log in to the FTP server, but the upload and download always report an error. After that, the FTPClient.enterLocalPassiveMode() method is added before the operation. Success.Note: call ftp client. Enterlocalpassivemode(); this method means that before each data connectio ...
Posted by kidsleep on Tue, 03 Dec 2019 03:34:32 -0800
Senior Python programmers teach you how to count the frequency of names in the three countries. It's very simple
Senior Python programmers teach you simple and interesting programs:Using the third-party database, we can count the number of characters' names in the romance of the Three Kingdoms.
Senior Python programmers teach you how to count the frequency of names in the three countries. It's very simpleOne of them is a third-party library which classif ...
Posted by erth on Tue, 03 Dec 2019 03:31:59 -0800
Top 100 cat's eye movies in Python data analysis
Preface
If you often read the Python crawler related public numbers, they will be displayed in the form of crawler + data analysis. This is very interesting and the charts are very good. Today, I will share with you one of the last works in training: cat eye movie crawler and analysis.
Through the crawler of the top 100 list ...
Posted by Jibberish on Tue, 03 Dec 2019 02:25:38 -0800
Scheduled Oracle database backup to remote server
I. demand
Regularly generate dmp from A database in oracle database of server A and back it up to server B (save for 10 days)
II. Configure scheduled database backup
Create A backup directory on server A and give permissions
[root@localhost /]# mkdir -p /home/oraclebak
#Create a new oracle backup directory
[root@localho ...
Posted by ldomingues on Mon, 02 Dec 2019 22:44:58 -0800