Scrapy self built IP proxy pool

This blog will realize Worry free agent and National Agency To access and save to Redis database. The anti crawling measures of worry free agent mainly lie in the inconsistency between the port of the page and the port number of the source code. The reason for the inconsistency is that there is js ...

Posted by kneifelspy on Mon, 16 Mar 2020 06:53:05 -0700

Design of xdh official website based on django and vue

Preface This project is designed with three-stage separation Reception The foreground page built by materialize framework and the interface written by django used by the backend Backstage Use the interface built by Amazon UI template to manage the content of each part Project environment python3.7.2 django2.2.9 vue axios jQuery materialize mys ...

Posted by jrws on Sun, 15 Mar 2020 21:25:46 -0700

Basic details of MySQL (the essence of writing sql statements is English translation + mathematical logic!)

MySQL introduction /* MySQL database management system (file management system in essence) Advantages over ordinary files: 1. Easy to manage data; 2. Suitable for complex multi-threaded operations In MySQL: database database (essentially folder) Create database: name of create database; Display dat ...

Posted by adt2007 on Sun, 15 Mar 2020 03:56:00 -0700

Spring Boot 1.5 learn 10 -- Spring Boot caching technology (spring data redis)

1. Integration steps 1.1 introduction of springdataredis starter <!-- Spring Data Redis Starter --> <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-data-redis</artifactId> </dependency> 1.2 write the configu ...

Posted by kelseyirene on Sun, 15 Mar 2020 01:57:24 -0700

How to use AbpSettings gracefully

Although it's convenient to use the configuration in Abp, it's a troublesome thing to define the key in each configuration first, define it in the provider, and then use the key to get it from ISetting, The most important thing is to get changes. For example, to modify user configuration, it is more difficult to get a batch of key/value to retu ...

Posted by klaibert26 on Sun, 15 Mar 2020 01:51:36 -0700

Python starts from scratch - renovation of the blog project on the official website from 0

Verify the Python blog from 0 on, and I don't know what I want to verify.Write whatever you think.First set up the official blog.Record a hole in the middle. Official address 1. Preparation: Tools: pycharm+Anacondar Environment: Django3+python3.8 2. Create a project: pycharm->file->new project ...

Posted by Quinton1337 on Sat, 14 Mar 2020 18:29:40 -0700

07-docker port mapping associated with container

Port mappings are associated with containers In addition to network access, docker provides two capabilities to meet the basic requirements of service access: one is to allow mapping of service ports applied within containers to local host hosts, and the other is to enable quick access through container names between multiple containers throug ...

Posted by n1tr0b on Fri, 13 Mar 2020 11:16:24 -0700

Advanced features of redis billion level data filtering and bloon filter

1, Brief introduction of bloon filter Last time, we learned to use HyperLogLog to estimate big data. It is very valuable and can solve many statistical requirements with low accuracy. But if we want to know whether a certain value is already in the HyperLogLog structure, it can't help. It only provi ...

Posted by tywin on Fri, 13 Mar 2020 08:32:34 -0700

Python self study notes - Chapter 6 object oriented programming

3. Magic method Python's objects naturally have some magical methods. They are always surrounded by double underscores. They are everything of object-oriented python. They are special methods that can add magic to your class. If your object implements (overloads) one of these methods, then this method will be called by Python in a special case. ...

Posted by suspect on Fri, 13 Mar 2020 03:08:30 -0700

[Typical Example] 50 exercises for MySQL database SQL statements

Basic operations and advanced exercises for SQL Reference resources: https://blog.csdn.net/Fenggms/article/details/83034175 There are now two tables, one for departments and the other for employees, whose table structure is as follows: Step 1: Create a test database, command: create database test; The second step is to build the table: emp ...

Posted by limke on Thu, 12 Mar 2020 09:57:53 -0700