Preliminary reptile summary
1, Basic steps of crawling web pages
1.1 determine crawling data
The function of a crawler is to crawl the data needed in a large number of web pages, and determine what data is needed before that. Taking the second-hand house price as an example, if we need to do a cross-sectional regression analy ...
Posted by eagle1771 on Mon, 13 Jan 2020 03:06:21 -0800
waterdrop filtering processing log files
waterdrop filters and processes log files to store data
Installing waterdrop
Download the installation package of waterdrop using wget
wget xxxxx
Extract to the directory you need
Unzip XXX (package location) XXX (decompression location)
If unzip reports an error, please download the corresponding command yourself.
Set the dependency env ...
Posted by PhantomCube on Mon, 13 Jan 2020 01:04:18 -0800
@Difference between RequestParam, @ RequestBody and @ ModelAttribute
1, @ RequestParam
The parameters passed by GET and POST requests are automatically converted to the variables annotated by @ RequestParam
1. @RequestParam (org.springframework.web.bind.annotation.RequestParam) is used to assign the specified request parameter to the parameter in the method.
Example:
...
Posted by alext on Mon, 13 Jan 2020 00:22:29 -0800
Topic mode of RabbitMQ (PHP version)
Topic mode
A message is obtained by multiple consumers. The target queue of the message can be specified by the BindingKey wildcard (ා: zero or more words, *: one word).
There are four types of switches in RabbitMQ: direct fanout topic headers. In routing mode, the switch type is topic.
Class lib ...
Posted by MrQcue on Sun, 12 Jan 2020 23:49:21 -0800
docker local private repository, access controlled by certificate (centos8)
Article Directory
1. Private Warehouse Server 200 Create Certificate
2. Private warehouse server 200 uses certificates to create containers
3. Server 200 Local Test Upload and Download Mirrors
IV. Client 210 Test Upload and Download Mirrors
Server name
IP Address
Explain
Server 200
192.168.1 ...
Posted by mecha_godzilla on Sun, 12 Jan 2020 19:22:10 -0800
Elastic search integrates spring boot to realize search function
Catalog
1 define data structure by mapping of es
Default data type of Es
The mapping structure of es is defined as follows
2 import Jest dependency
3. Import mysql data for es
Configure application.properties
Define the java class corresponding to es data structure
Insert mysql data into es
...
Posted by dubc07 on Sat, 11 Jan 2020 00:08:20 -0800
Github Actions user guide and Android continuous integration example
Preface
Github Actions official document (the general entry of all the official documents below) gives a detailed description of many details, but if you are the first time to contact, you see a lot of details, and you don't know what they are, so you will forget them soon. This article, from the code ...
Posted by markbm on Fri, 10 Jan 2020 23:39:38 -0800
Programmers use Python to pick out UP owners who are "amazed by nature" in Station B!
Preface
!
Recently, the New Year's Eve in Station B has swept over all video websites with its unique ideas, which has had a great positive impact on the company. Stock prices have also risen sharply. We must all regret not buying stocks in Station B earlier:
Today, however, we are not talking about the New Year's Party in Station B, but ...
Posted by genericnumber1 on Thu, 09 Jan 2020 22:12:42 -0800
Angular2.x/Typescript module introduced parsing
First, modules are introduced in two ways:1. Relative import:
import Entry from "./components/Entry";
import { DefaultHeaders } from "../constants/http";
import "/mod";
Relative import resolves relative to the file it was imported into and cannot be resolved to an external module declaration. You should use relative import for your own modules ...
Posted by Crowly on Thu, 09 Jan 2020 11:46:06 -0800
How to send cross domain POST requests through JavaScript?
How to send cross domain POST requests through JavaScript?
Note - it should not refresh the page, after which I need to grab and parse the response.
#1 building
Advanced. ... you need to set up cname on the server so that other-serve.your-server.com points to other-server.com.
Your page dynamically creates an invisible iframe that ...
Posted by ghurtado on Thu, 09 Jan 2020 05:13:05 -0800