Master slave distributed crawler

Why use distributed Crawlers It's been a while since learning crawlers were implemented in a python file, without considering performance, efficiency, etc. So as a qualified spider, we need to learn about distributed crawlers. What distributed crawler? In short, it is to use multiple servers to get data, let these servers cooperate and assign ...

Posted by crash58 on Sat, 30 Nov 2019 07:18:16 -0800

js basis: judgment type

I. common examples Judge whether it is an object let obj = {} // 1.Object.prototype.toString if (Object.prototype.toString.call(obj) === '[Object Object]') { console.log('Object!') } // 2.constructor if (obj.constructor === Object) { console.log('Object!') } // 3.$.type() if ($.type(obj) === 'object') { console.log('Object!') ...

Posted by thatsgreat2345 on Sat, 30 Nov 2019 04:41:21 -0800

Return non null value according to Date exact query data

Once upon a time, there was such a problem in the analysis of the purchase, sale and stock of goods, including the purchase quantity, sales quantity and stock quantity, which were not carried out or sold in the same day, but the stock quantity remained unchanged; as shown in the following figure:   At the beginning of writi ...

Posted by SephirGaine on Sat, 30 Nov 2019 03:44:40 -0800

Java's new project learning online notes-day8

1.1.3 API interface 1.1.3.1 model class The file information of the system (information of small files such as pictures and documents) is stored in mongodb, and the model class of file information is below.1) the model is as follows:[mw_shl_code=applescript,true] file‐size‐threshold: 0 Temporary directory of uploaded files location: Maxi ...

Posted by simple_man_11 on Fri, 29 Nov 2019 23:19:20 -0800

Using Express to develop novel API service 1.0

Using Express to develop novel API service 1.0 (2) Online access address https://api.langpz.com/ Before the completion of the home page and search interface, now start to write the rest of the interface. Access to novel sources Because the original source of Book Chasing artifact is charged and encrypted, it can only use pirated source, so it i ...

Posted by jaronblake on Fri, 29 Nov 2019 23:01:18 -0800

Visualize and modify json data on the front end

In general, front-end and back-end interaction is all we need to extract and use the data we need from json, but if rewriting a very long JSON presentation is undoubtedly painful, two more concise frameworks are recommended for JSON visualization: jquery.json-viewer (Official website) This framework import needs to depend on jQ ...

Posted by DirtySnipe on Fri, 29 Nov 2019 20:14:13 -0800

Golang implements requests Library

Simple package, convenient to use, like python's requests library. Github address Github Support GET,POST,PUT,DELETE application/json,application/x-www-form-urlencoded I won't support it: multipart/form-data Use The following are common examples: GET request; POST form submission, json submission, saving files, etc. Get func getText() ...

Posted by JamesyBHOY on Fri, 29 Nov 2019 13:23:41 -0800

Java calls Http interface (7,end)--WebClient calls Http interface

WebClient is a non blocking and responsive Http client provided by Spring. It provides synchronous and asynchronous API s, which will replace RestTemplate and AsyncRestTemplate. The software versions used in this paper are Java 1.8.0, SpringBoot 2.2.1.RELEASE. 1. Server See also Java calls Http interface (1) -- write server  2. Call The use of ...

Posted by seeker2921 on Fri, 29 Nov 2019 06:03:11 -0800

Vue source notes data driven createElement

Vue version: 2.5.17-beta.0 <Vue source notes - data driven - render >It is recorded in, and the vnode data return is created by the vm.$createElement function. The following records the implementation process of creating vnode by the common node of vm.$createElement. new Vue({ el: '#app', render: createElement => createElement('div ...

Posted by badboy1245 on Fri, 29 Nov 2019 02:12:26 -0800

SSM AJAX asynchronous file upload and download + effect implementation diagram

Brief introduction: using tools: IDEA MySQL framework: Spring, Springmvc, Mybatis Required JAR package: commons IO - *. JAR Commons fileupload.JAR Implementation effect of asynchronous upload: 1. First, the effect of the interface loading 2. Click "select file", select the file to be uploaded, display the name o ...

Posted by tilde on Thu, 28 Nov 2019 09:55:26 -0800