[hard Hive] Hive Foundation (19): Hive function user defined function / user defined UDF function / user defined UDTF function
Welcome to the blog home page: Wechat search: Import_ Bigdata, hard core original author in big data field_ import_bigdata_ CSDN blog Welcome to like, collect, leave messages, and exchange messages!This article was originally written by [Wang Zhiwu] and started on CSDN blog!This article is the first CSDN forum. It is strictly prohibited to ...
Posted by Garcia on Fri, 10 Sep 2021 17:28:17 -0700
[hard hive] hive advanced (15): optimize (15) Explain view execution plan
Welcome to the blog home page: Wechat search: Import_ Bigdata, hard core original author in big data field_ import_bigdata_ CSDN blog Welcome to like, collect, leave messages, and exchange messages!This article was originally written by [Wang Zhiwu] and started on CSDN blog!This article is the first CSDN forum. It is strictly prohibited to repr ...
Posted by Tobeon on Fri, 10 Sep 2021 17:10:49 -0700
Multi thread crawling NCBI database literature
Tip: after the article is written, the directory can be generated automatically. Please refer to the help document on the right for how to generate it
preface
Recently, I followed the dark horse programmer to learn the request crawler and successfully completed the batch processing of NCBI documents. The problem is that the crawling eff ...
Posted by dharprog on Thu, 09 Sep 2021 20:18:19 -0700
Analysis of 5 typical Hive topics
1, Continuous problem
The following data are the low carbon emissions received by users in ant forest
id dt lowcarbon
1001 2021-12-12 123
1002 2021-12-12 45
1001 2021-12-13 43
1001 2021-12-13 45
1001 2021-12-13 23
1002 2021-12-14 45
1001 2021-12-14 230
1002 2021-12-15 45
1001 2021-12-15 23
... ...
Find out the users who have receiv ...
Posted by dixondwayne on Wed, 08 Sep 2021 12:09:56 -0700
FlinkSQL custom function (UDF) dimension table conversion
preface
Relationship between Table and SQL: SQL is the inheritance encapsulation of Table (this point is in Flink concept For example, StreamTableEnvironment can be embodied by inheriting from TableEnvironment. Therefore, the use of tables in official documents can be reflected in SQL, such as user-defined functions, Table API & custom fun ...
Posted by scofansnags on Tue, 07 Sep 2021 19:38:53 -0700
Kakfa Flink hive integration principle and actual combat code
Hello, I'm brother Tu.
At present, he works as a big data algorithm engineer in a large Internet factory.
Today, a fan sent a message in the group asking if there is any information about Flink DDL, saying that he is a new learner.
In order to let this fan quickly learn how to use Flink DDL, I will explain the principle and attach the actu ...
Posted by amazinggrace1983 on Tue, 07 Sep 2021 16:02:28 -0700
SpringCloudAlibabaNacos Discovery--Service Governance
3.1 Introduction to Service Governance
Think about a question first
With the actions in the previous chapter, we can already make calls between micro services.But we take the network address of the service provider
(
ip
Hardcoded into your code, such as ports, has many problems:
Once the service provider address cha ...
Posted by sprocket on Tue, 07 Sep 2021 10:31:38 -0700
mariadb database for Linux
What is a DATABASE
Efficient media for storing and processing data (disk and memory) It is a warehouse built on computer storage equipment to organize, store and manage data according to data structure. In short, it can be regarded as an electronic filing cabinet - the place where electronic files are stored. Users can add, intercept, update, ...
Posted by tbare on Sun, 05 Sep 2021 00:03:40 -0700
Source code analysis of Kafka producer and consumer partition strategy
When I read other blogs before, I found that there are two views in the defect analysis of kafka consumer's RoundRobin. One is that if the themes of consumer consumption in the consumer group are different or the number of consumer threads is different, the number of consumer consumption partitions will be inclined; Another view is that the dis ...
Posted by Joeker on Thu, 02 Sep 2021 15:18:30 -0700
SQL practice: how to calculate user retention with SQL
How to calculate user retention problems with sql
1, Retained
1. Meaning of retention:
Retained: refers to the number of users who arrive at the APP on the base date and return to the APP on the next n days;
Retention rate = number of users returned on the day n days after the base date / number of users on the base date * 100%
Or refers t ...
Posted by punked on Wed, 01 Sep 2021 15:35:54 -0700