LVS / ipsadm mode and basic use

LVS Article catalogDocker builds a simple LVS - dz45693 - blog Park (cnblogs.com) Linux Virtual Server, Linux Virtual Server, mainly realizes soft load scheduling 1, Introduction 1.1 three working modes of LVS NAT - network address translation NAT (Network Address Translation) refers to Network Address Translation. The requested data p ...

Posted by ParkerPHP on Sun, 05 Dec 2021 01:23:10 -0800

Usage of Scrapy Middleware - crawling the historical data of Douban top250/PM2.5

Get started with python Programming quickly (continuous update...) python crawler from entry to mastery Scrapy crawler framework 1. Classification and function of the scratch Middleware 1.1 classification of sweep Middleware According to the different locations in the operation process of the sweep, it can be divided into: 1. Downloa ...

Posted by eaglelegend on Thu, 02 Dec 2021 11:18:51 -0800

[message middleware RabbitMQ]: simple patterns and Work queues

In the last article, we successfully built RabbitMQ on the server, which is equivalent to the red box in the middle. If you want to use RabbitMQ, you must also use two roles - Produces and Consumer, so let's specifically implement RabbitMQ to send and receive messages. 1. Working mode RabbitMQ provides six working modes for different sce ...

Posted by rapmonkey on Mon, 29 Nov 2021 11:25:40 -0800

[elasticsearch] learning notes -p8 (realize data synchronization between elasticsearch and mysql)

Video directions 👉 Station B dark horse micro service Super recommended! MQ implements data synchronization between elasticsearch and mysql The hotel data in elasticsearch comes from MySQL database. Therefore, when MySQL data changes, elasticsearch must also change. This is the data synchronization between elasticsearch and mysql. 1. ...

Posted by n5tkn on Sat, 20 Nov 2021 19:39:56 -0800

Complete and detailed Redis learning notes

Learning reference Videos: [crazy God says Java] Redis Redis 1, Overview of redis redis is a non relational database. 1. Introduction to non relational database A non relational database, that is, NoSQL (Not Only SQL). Relational database: column + row. The data structure under the same table is the same. Non relational database: data ...

Posted by tofi84 on Sat, 20 Nov 2021 18:29:15 -0800

The configuration center writes the configuration to the spring environment

preface There are two configuration injections in the configuration center, one is before startup, and the other is dynamic configuration after configuration changes. This article mainly summarizes the pre startup configuration injection spring environment. Pre knowledge spring configuration will store the configuration in the PropertySo ...

Posted by pakenney38 on Thu, 11 Nov 2021 00:29:03 -0800

In depth analysis of RocketMQ source code - message storage module

1, IntroductionRocketMQ is Alibaba's open source distributed messaging middleware. It draws on Kafka's implementation and supports functions such as message subscription and publishing, sequential message, transaction message, timing message, message backtracking, dead letter queue and so on. RocketMQ architecture is mainly divided into four pa ...

Posted by Kold on Mon, 08 Nov 2021 18:12:18 -0800

RocketMQ-Producer Start Process Decryption

The following is the RocketMQ - Producer series article index: 1: Start the process (this article) 2: Routing dynamic updates 3: Send Mode Analysis + Message Type Difference 4: Sending process of producer message 5: Routing queue selection, client redundancy policy (QA) Introduction to Producer Producer is the sender of the Ro ...

Posted by Pi_Mastuh on Tue, 02 Nov 2021 09:18:26 -0700

Pure crawler knowledge, how much do you know about Python scratch download middleware

In this blog, let's talk about Downloader Middleware in graph, that is, Download middleware related knowledge. Downloader Middlerware First, let's take a look at the position of Middleware in the scene data stream. The black arrow in the figure below is to download middleware. It can be seen from the above figure that both Requests and respo ...

Posted by Aretai on Mon, 01 Nov 2021 03:18:14 -0700

Use of current limiting middleware IpRateLimitMiddleware

preface IpRateLimitMiddleware(Github: AspNetCoreRateLimit )It is a flow limiting middleware of ASPNETCore, which is used to control the frequency of API calls by the client. If the client frequently accesses the server, it can limit its frequency and reduce the pressure of accessing the server. Or if a crawler is crawling key data, it can also ...

Posted by ineedhelp on Sun, 31 Oct 2021 18:52:06 -0700