Master slave distributed crawler
Why use distributed Crawlers
It's been a while since learning crawlers were implemented in a python file, without considering performance, efficiency, etc. So as a qualified spider, we need to learn about distributed crawlers.
What distributed crawler? In short, it is to use multiple servers to get data, let these servers cooperate and assign ...
Posted by crash58 on Sat, 30 Nov 2019 07:18:16 -0800
js basis: judgment type
I. common examples
Judge whether it is an object
let obj = {}
// 1.Object.prototype.toString
if (Object.prototype.toString.call(obj) === '[Object Object]') {
console.log('Object!')
}
// 2.constructor
if (obj.constructor === Object) {
console.log('Object!')
}
// 3.$.type()
if ($.type(obj) === 'object') {
console.log('Object!') ...
Posted by thatsgreat2345 on Sat, 30 Nov 2019 04:41:21 -0800
Return non null value according to Date exact query data
Once upon a time, there was such a problem in the analysis of the purchase, sale and stock of goods, including the purchase quantity, sales quantity and stock quantity, which were not carried out or sold in the same day, but the stock quantity remained unchanged; as shown in the following figure:
At the beginning of writi ...
Posted by SephirGaine on Sat, 30 Nov 2019 03:44:40 -0800
Java's new project learning online notes-day8
1.1.3 API interface 1.1.3.1 model class The file information of the system (information of small files such as pictures and documents) is stored in mongodb, and the model class of file information is below.1) the model is as follows:[mw_shl_code=applescript,true] file‐size‐threshold: 0
Temporary directory of uploaded files
location:
Maxi ...
Posted by simple_man_11 on Fri, 29 Nov 2019 23:19:20 -0800
Using Express to develop novel API service 1.0
Using Express to develop novel API service 1.0 (2)
Online access address https://api.langpz.com/
Before the completion of the home page and search interface, now start to write the rest of the interface.
Access to novel sources
Because the original source of Book Chasing artifact is charged and encrypted, it can only use pirated source, so it i ...
Posted by jaronblake on Fri, 29 Nov 2019 23:01:18 -0800
Visualize and modify json data on the front end
In general, front-end and back-end interaction is all we need to extract and use the data we need from json, but if rewriting a very long JSON presentation is undoubtedly painful, two more concise frameworks are recommended for JSON visualization:
jquery.json-viewer (Official website)
This framework import needs to depend on jQ ...
Posted by DirtySnipe on Fri, 29 Nov 2019 20:14:13 -0800
Golang implements requests Library
Simple package, convenient to use, like python's requests library.
Github address
Github
Support
GET,POST,PUT,DELETE
application/json,application/x-www-form-urlencoded
I won't support it:
multipart/form-data
Use
The following are common examples: GET request; POST form submission, json submission, saving files, etc.
Get
func getText() ...
Posted by JamesyBHOY on Fri, 29 Nov 2019 13:23:41 -0800
Java calls Http interface (7,end)--WebClient calls Http interface
WebClient is a non blocking and responsive Http client provided by Spring. It provides synchronous and asynchronous API s, which will replace RestTemplate and AsyncRestTemplate. The software versions used in this paper are Java 1.8.0, SpringBoot 2.2.1.RELEASE.
1. Server
See also Java calls Http interface (1) -- write server
2. Call
The use of ...
Posted by seeker2921 on Fri, 29 Nov 2019 06:03:11 -0800
Vue source notes data driven createElement
Vue version: 2.5.17-beta.0
<Vue source notes - data driven - render >It is recorded in, and the vnode data return is created by the vm.$createElement function. The following records the implementation process of creating vnode by the common node of vm.$createElement.
new Vue({
el: '#app',
render: createElement => createElement('div ...
Posted by badboy1245 on Fri, 29 Nov 2019 02:12:26 -0800
SSM AJAX asynchronous file upload and download + effect implementation diagram
Brief introduction: using tools: IDEA MySQL framework: Spring, Springmvc, Mybatis
Required JAR package: commons IO - *. JAR Commons fileupload.JAR
Implementation effect of asynchronous upload:
1. First, the effect of the interface loading
2. Click "select file", select the file to be uploaded, display the name o ...
Posted by tilde on Thu, 28 Nov 2019 09:55:26 -0800