python3 crawler grabs job information code of Zhilian
On the code, if you have any questions, please leave a message.
# -*- coding: utf-8 -*-
"""
Created on Tue Aug 7 20:41:09 2018
@author: brave-man
blog: http://www.cnblogs.com/zrmw/
"""
import requests
from bs4 import BeautifulSoup
import json
def getDetails(url):
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:6.0) Geck ...
Posted by sonny on Sun, 05 Jan 2020 10:45:34 -0800
Spring is here, take you home with python!
Unconsciously, the annual Spring Festival ticket grabbing screen has been pulled open, want to grab the ticket home quickly?As a programmer, you must know about these techniques.
In order to make it faster and more convenient for people to grab train tickets, a variety of software for grabbing tickets should be created, most of which are mecha ...
Posted by sirmanson on Sat, 04 Jan 2020 07:40:03 -0800
Get the link of meipai video -- JS analysis
Meipai link: https://www.meipai.com/
Find the label of the video link. This div is not in the source code
adopt Fiddler grabs the bag , find which js file generated the div of class="mp-h5-player-layer-video"
Open the corresponding js file, breakpoint it, and find the way to generate src
Find the src parameter in this position
A ...
Posted by tefuzz on Sat, 04 Jan 2020 01:31:47 -0800
Previous report Highcharts
Data download: http://www.highcharts.com/download
Download File:
Open after decompression:
We can copy all the files under js to our project, for example, I put them in the highcharts folder 1. Import the highcharts file:
<script type="text/javascript" src="../js/jquery-1.8.3.js"></script>
<!--highchart ...
Posted by jitesh on Thu, 02 Jan 2020 01:48:03 -0800
ajax and JSON requests -- encapsulation
ajax:
function ajax(opt) {
//Intercession path
var url;
if(opt.url){
url = opt.url;
}else{
console.log('Please enter the request path');
}
//Request type
var type = opt.type || 'GET';
//Callback function
var callback = opt.callback || function (msg) { };
//Request data
...
Posted by FraXTC on Mon, 30 Dec 2019 08:51:39 -0800
Crawler: XPath, lxml module
1. XPath
1.1 What is XPath
XPath (XML Path Language) is a language for finding information in XML and HTML documents, which can be used to traverse elements and attributes in XML and HTML documents.
1.2 XPath Development Tools
1.2.1 Chrome Plugin XPath Helper
https://jingyan.baidu.com/article/1e5468f94694ac484861b77d.html
1.2.2 Firefox Plugin X ...
Posted by Marsha on Mon, 16 Dec 2019 21:30:53 -0800
Python simulated Login - Conquest verification code 9 weibo.com
Login interface
Http Analyzer and folders can be used for packet capturing analysis, but it seems to be very complex. It's better to use Firefox (chrome is far from Firefox).
First of all, after the user name is entered, the pre login will take place at: http://login.sina.com.cn/sso/prelogin.php?entry=weibo&callback=sinaS ...
Posted by postalservice14 on Sun, 15 Dec 2019 12:27:39 -0800
Python crawler series - Preliminary Exploration: crawling travel review
Python crawler is currently based on the requests package. The following is the documentation of the package. It is more convenient to check some information.
http://docs.python-requests.org/en/master/
Crawling the product reviews of a tourism website, through analysis, it needs POST instructions to get json files. In short:
GET is to add the ...
Posted by newbiez on Fri, 13 Dec 2019 13:31:54 -0800
Record the charging points of AJAX
First of all, what is AJAX?
AJAX = asynchronous JavaScript and XML.
AJAX is a technology for creating fast dynamic web pages.
AJAX enables web pages to be updated asynchronously by exchanging a small amount of data with the server in the background. This means that a part of the page can be updated without reloading the entire page.
Traditional ...
Posted by dinger on Fri, 13 Dec 2019 00:46:48 -0800
JavaScript monitors the change of input median in real time
Code
Method 1:
<!DOCTYPE html>
<html>
<head>
<script src="http://libs.baidu.com/jquery/1.10.2/jquery.min.js"></script>
<title>test</title>
</head>
<body>
<input class="et-name" type="input" name="name">
<script type="text/javascript">
$(funct ...
Posted by mickwaffle on Wed, 11 Dec 2019 09:13:52 -0800