Crawler: XPath, lxml module
1. XPath
1.1 What is XPath
XPath (XML Path Language) is a language for finding information in XML and HTML documents, which can be used to traverse elements and attributes in XML and HTML documents.
1.2 XPath Development Tools
1.2.1 Chrome Plugin XPath Helper
https://jingyan.baidu.com/article/1e5468f94694ac484861b77d.html
1.2.2 Firefox Plugin X ...
Posted by Marsha on Mon, 16 Dec 2019 21:30:53 -0800
Android based intent data transmission
Step 1: LoginActivity.xml
The interface is relatively simple, so there is no need to paste the content here, and the renderings are pasted here.
2.LoginActivity.java
The logic processing code is as follows:
public class LoginActivity extends AppCompatActivity {
private EditText et_username;
private EditText ...
Posted by harnacks on Mon, 16 Dec 2019 12:21:24 -0800
How to deploy Mybatis on weblogic in spring boot integration
introduce
In this paper, we refer to How to deploy spring boot gracefully on weblogic Mybatis is deployed on weblogic Server by using springboot.
Environmental Science
Development tool: Eclipseweblogic version: 10.3.6.0weblogic-jdk: 1.8.0_91
Technology realization
Create Maven project and add it to pom file
<project xmlns="http://maven.apac ...
Posted by chuckjones on Sun, 15 Dec 2019 12:28:55 -0800
Android learning - simple custom View (1)
I am not busy recently, so I look back on what I have learned and contacted in this year. I suddenly feel that blogging is a good way, and I hope I can stick to it.
Custom View process
Create a custom class to inherit the View, and override the constructor. There are four constructors in total. We only need to inherit the first ...
Posted by control on Sun, 15 Dec 2019 10:01:48 -0800
Download APP1.0 for image of python crawler
Today, I'd like to give you a little bit of fun. Use python to crawl the pictures to the local area. The website is https://www.pexels.com/
This website is a foreign language network, so the search image should be in English. What we need to do today is search and download the image in python, and make a web APP.
Direct code
from b ...
Posted by Fingers68 on Sun, 15 Dec 2019 06:47:59 -0800
python crawler -- Distributed crawler
Scrapy redis distributed crawler
introduce
By using the set of redis, the request queue and items queue can be realized, and by using the set of redis, the request can be de duplicated, so that the scale of crawler cluster can be realized
Scratch redis is a scratch component based on redis
• distributed Crawlers
Multiple crawler insta ...
Posted by ravnen on Sun, 15 Dec 2019 03:44:35 -0800
SpringBoot profile injection related
SpringBoot configuration related
1. Profile injection
_In SpringBoot you can inject a configuration file with four notes:
@ConfigurationProperties
@Value
@PropertySource
@ImportResource
_1.@ConfigurationProperties usage
_Centered like this in my profile application.yml
person:
lastName: hello
age: 18
boss: false
birth: 2017/12/12 ...
Posted by perpetualshaun on Sat, 14 Dec 2019 17:51:41 -0800
Qt write picture and video TCP/UDP network transmission
I. Preface
Similar projects have been done many years ago. It's just to upload the local pictures to the server. It's so simple. In fact, it's easy to upload with http post. You don't need to customize the protocol. You can directly set the binary data. If you use TCP or UDP communication, you must customize the protocol, because you don't know ...
Posted by thelinx on Sat, 14 Dec 2019 11:24:52 -0800
Introduction to springboot aop
Step 1: add dependency
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-aop</artifactId>
</dependency>
Step 2: define a tangent class
package com.example.demo.aop;
import java.lang.reflect.Method;
import java.util.Arr ...
Posted by morphy on Sat, 14 Dec 2019 09:22:22 -0800
tomcat multi instance deployment
Close main station
[root@dell710 ~]# bash /usr/local/tomcat/bin/shutdown.sh
Using CATALINA_BASE: /usr/local/tomcat
Using CATALINA_HOME: /usr/local/tomcat
Using CATALINA_TMPDIR: /usr/local/tomcat/temp
Using JRE_HOME: /usr/local/javaUsing CLASSPATH: /usr/local/tomcat/bin/bootstrap.jar:/usr/local/tomcat/bin/tomca ...
Posted by Dax on Sat, 14 Dec 2019 07:13:25 -0800