Scrapy self built IP proxy pool
This blog will realize Worry free agent and National Agency To access and save to Redis database.
The anti crawling measures of worry free agent mainly lie in the inconsistency between the port of the page and the port number of the source code. The reason for the inconsistency is that there is js ...
Posted by kneifelspy on Mon, 16 Mar 2020 06:53:05 -0700
Design of xdh official website based on django and vue
Preface
This project is designed with three-stage separation
Reception
The foreground page built by materialize framework and the interface written by django used by the backend
Backstage
Use the interface built by Amazon UI template to manage the content of each part
Project environment
python3.7.2
django2.2.9
vue
axios
jQuery
materialize
mys ...
Posted by jrws on Sun, 15 Mar 2020 21:25:46 -0700
Basic details of MySQL (the essence of writing sql statements is English translation + mathematical logic!)
MySQL introduction
/*
MySQL database management system (file management system in essence)
Advantages over ordinary files: 1. Easy to manage data; 2. Suitable for complex multi-threaded operations
In MySQL: database database (essentially folder)
Create database: name of create database;
Display dat ...
Posted by adt2007 on Sun, 15 Mar 2020 03:56:00 -0700
Spring Boot 1.5 learn 10 -- Spring Boot caching technology (spring data redis)
1. Integration steps
1.1 introduction of springdataredis starter
<!-- Spring Data Redis Starter -->
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-data-redis</artifactId>
</dependency>
1.2 write the configu ...
Posted by kelseyirene on Sun, 15 Mar 2020 01:57:24 -0700
How to use AbpSettings gracefully
Although it's convenient to use the configuration in Abp, it's a troublesome thing to define the key in each configuration first, define it in the provider, and then use the key to get it from ISetting,
The most important thing is to get changes. For example, to modify user configuration, it is more difficult to get a batch of key/value to retu ...
Posted by klaibert26 on Sun, 15 Mar 2020 01:51:36 -0700
Python starts from scratch - renovation of the blog project on the official website from 0
Verify the Python blog from 0 on, and I don't know what I want to verify.Write whatever you think.First set up the official blog.Record a hole in the middle. Official address
1. Preparation:
Tools: pycharm+Anacondar
Environment: Django3+python3.8
2. Create a project:
pycharm->file->new project ...
Posted by Quinton1337 on Sat, 14 Mar 2020 18:29:40 -0700
07-docker port mapping associated with container
Port mappings are associated with containers
In addition to network access, docker provides two capabilities to meet the basic requirements of service access: one is to allow mapping of service ports applied within containers to local host hosts, and the other is to enable quick access through container names between multiple containers throug ...
Posted by n1tr0b on Fri, 13 Mar 2020 11:16:24 -0700
Advanced features of redis billion level data filtering and bloon filter
1, Brief introduction of bloon filter
Last time, we learned to use HyperLogLog to estimate big data. It is very valuable and can solve many statistical requirements with low accuracy. But if we want to know whether a certain value is already in the HyperLogLog structure, it can't help. It only provi ...
Posted by tywin on Fri, 13 Mar 2020 08:32:34 -0700
Python self study notes - Chapter 6 object oriented programming
3. Magic method
Python's objects naturally have some magical methods. They are always surrounded by double underscores. They are everything of object-oriented python. They are special methods that can add magic to your class. If your object implements (overloads) one of these methods, then this method will be called by Python in a special case. ...
Posted by suspect on Fri, 13 Mar 2020 03:08:30 -0700
[Typical Example] 50 exercises for MySQL database SQL statements
Basic operations and advanced exercises for SQL
Reference resources: https://blog.csdn.net/Fenggms/article/details/83034175
There are now two tables, one for departments and the other for employees, whose table structure is as follows:
Step 1: Create a test database, command: create database test;
The second step is to build the table:
emp ...
Posted by limke on Thu, 12 Mar 2020 09:57:53 -0700