Crawler: XPath, lxml module

1. XPath 1.1 What is XPath XPath (XML Path Language) is a language for finding information in XML and HTML documents, which can be used to traverse elements and attributes in XML and HTML documents. 1.2 XPath Development Tools 1.2.1 Chrome Plugin XPath Helper https://jingyan.baidu.com/article/1e5468f94694ac484861b77d.html 1.2.2 Firefox Plugin X ...

Posted by Marsha on Mon, 16 Dec 2019 21:30:53 -0800

Android based intent data transmission

Step 1: LoginActivity.xml The interface is relatively simple, so there is no need to paste the content here, and the renderings are pasted here.   2.LoginActivity.java The logic processing code is as follows: public class LoginActivity extends AppCompatActivity { private EditText et_username; private EditText ...

Posted by harnacks on Mon, 16 Dec 2019 12:21:24 -0800

How to deploy Mybatis on weblogic in spring boot integration

introduce In this paper, we refer to How to deploy spring boot gracefully on weblogic Mybatis is deployed on weblogic Server by using springboot. Environmental Science Development tool: Eclipseweblogic version: 10.3.6.0weblogic-jdk: 1.8.0_91 Technology realization Create Maven project and add it to pom file <project xmlns="http://maven.apac ...

Posted by chuckjones on Sun, 15 Dec 2019 12:28:55 -0800

Android learning - simple custom View (1)

I am not busy recently, so I look back on what I have learned and contacted in this year. I suddenly feel that blogging is a good way, and I hope I can stick to it. Custom View process Create a custom class to inherit the View, and override the constructor. There are four constructors in total. We only need to inherit the first ...

Posted by control on Sun, 15 Dec 2019 10:01:48 -0800

Download APP1.0 for image of python crawler

Today, I'd like to give you a little bit of fun. Use python to crawl the pictures to the local area. The website is https://www.pexels.com/ This website is a foreign language network, so the search image should be in English. What we need to do today is search and download the image in python, and make a web APP. Direct code from b ...

Posted by Fingers68 on Sun, 15 Dec 2019 06:47:59 -0800

python crawler -- Distributed crawler

Scrapy redis distributed crawler introduce By using the set of redis, the request queue and items queue can be realized, and by using the set of redis, the request can be de duplicated, so that the scale of crawler cluster can be realized Scratch redis is a scratch component based on redis • distributed Crawlers Multiple crawler insta ...

Posted by ravnen on Sun, 15 Dec 2019 03:44:35 -0800

SpringBoot profile injection related

SpringBoot configuration related 1. Profile injection _In SpringBoot you can inject a configuration file with four notes:   @ConfigurationProperties   @Value   @PropertySource   @ImportResource _1.@ConfigurationProperties usage _Centered like this in my profile application.yml person: lastName: hello age: 18 boss: false birth: 2017/12/12 ...

Posted by perpetualshaun on Sat, 14 Dec 2019 17:51:41 -0800

Qt write picture and video TCP/UDP network transmission

I. Preface Similar projects have been done many years ago. It's just to upload the local pictures to the server. It's so simple. In fact, it's easy to upload with http post. You don't need to customize the protocol. You can directly set the binary data. If you use TCP or UDP communication, you must customize the protocol, because you don't know ...

Posted by thelinx on Sat, 14 Dec 2019 11:24:52 -0800

Introduction to springboot aop

Step 1: add dependency <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-aop</artifactId> </dependency> Step 2: define a tangent class package com.example.demo.aop; import java.lang.reflect.Method; import java.util.Arr ...

Posted by morphy on Sat, 14 Dec 2019 09:22:22 -0800

tomcat multi instance deployment

Close main station [root@dell710 ~]# bash /usr/local/tomcat/bin/shutdown.sh Using CATALINA_BASE: /usr/local/tomcat Using CATALINA_HOME: /usr/local/tomcat Using CATALINA_TMPDIR: /usr/local/tomcat/temp Using JRE_HOME: /usr/local/javaUsing CLASSPATH: /usr/local/tomcat/bin/bootstrap.jar:/usr/local/tomcat/bin/tomca ...

Posted by Dax on Sat, 14 Dec 2019 07:13:25 -0800