[hard Hive] Hive Foundation (19): Hive function user defined function / user defined UDF function / user defined UDTF function

Welcome to the blog home page: Wechat search: Import_ Bigdata, hard core original author in big data field_ import_bigdata_ CSDN blog Welcome to like, collect, leave messages, and exchange messages!This article was originally written by [Wang Zhiwu] and started on CSDN blog!This article is the first CSDN forum. It is strictly prohibited to ...

Posted by Garcia on Fri, 10 Sep 2021 17:28:17 -0700

[hard hive] hive advanced (15): optimize (15) Explain view execution plan

Welcome to the blog home page: Wechat search: Import_ Bigdata, hard core original author in big data field_ import_bigdata_ CSDN blog Welcome to like, collect, leave messages, and exchange messages!This article was originally written by [Wang Zhiwu] and started on CSDN blog!This article is the first CSDN forum. It is strictly prohibited to repr ...

Posted by Tobeon on Fri, 10 Sep 2021 17:10:49 -0700

Multi thread crawling NCBI database literature

Tip: after the article is written, the directory can be generated automatically. Please refer to the help document on the right for how to generate it preface Recently, I followed the dark horse programmer to learn the request crawler and successfully completed the batch processing of NCBI documents. The problem is that the crawling eff ...

Posted by dharprog on Thu, 09 Sep 2021 20:18:19 -0700

Analysis of 5 typical Hive topics

1, Continuous problem The following data are the low carbon emissions received by users in ant forest id dt lowcarbon 1001 2021-12-12 123 1002 2021-12-12 45 1001 2021-12-13 43 1001 2021-12-13 45 1001 2021-12-13 23 1002 2021-12-14 45 1001 2021-12-14 230 1002 2021-12-15 45 1001 2021-12-15 23 ... ... Find out the users who have receiv ...

Posted by dixondwayne on Wed, 08 Sep 2021 12:09:56 -0700

FlinkSQL custom function (UDF) dimension table conversion

preface Relationship between Table and SQL: SQL is the inheritance encapsulation of Table (this point is in Flink concept For example, StreamTableEnvironment can be embodied by inheriting from TableEnvironment. Therefore, the use of tables in official documents can be reflected in SQL, such as user-defined functions, Table API & custom fun ...

Posted by scofansnags on Tue, 07 Sep 2021 19:38:53 -0700

Kakfa Flink hive integration principle and actual combat code

Hello, I'm brother Tu. At present, he works as a big data algorithm engineer in a large Internet factory. Today, a fan sent a message in the group asking if there is any information about Flink DDL, saying that he is a new learner. In order to let this fan quickly learn how to use Flink DDL, I will explain the principle and attach the actu ...

Posted by amazinggrace1983 on Tue, 07 Sep 2021 16:02:28 -0700

SpringCloudAlibabaNacos Discovery--Service Governance

3.1 Introduction to Service Governance Think about a question first  With the actions in the previous chapter, we can already make calls between micro services.But we take the network address of the service provider ( ip Hardcoded into your code, such as ports, has many problems: Once the service provider address cha ...

Posted by sprocket on Tue, 07 Sep 2021 10:31:38 -0700

mariadb database for Linux

What is a DATABASE Efficient media for storing and processing data (disk and memory) It is a warehouse built on computer storage equipment to organize, store and manage data according to data structure. In short, it can be regarded as an electronic filing cabinet - the place where electronic files are stored. Users can add, intercept, update, ...

Posted by tbare on Sun, 05 Sep 2021 00:03:40 -0700

Source code analysis of Kafka producer and consumer partition strategy

When I read other blogs before, I found that there are two views in the defect analysis of kafka consumer's RoundRobin. One is that if the themes of consumer consumption in the consumer group are different or the number of consumer threads is different, the number of consumer consumption partitions will be inclined; Another view is that the dis ...

Posted by Joeker on Thu, 02 Sep 2021 15:18:30 -0700

SQL practice: how to calculate user retention with SQL

How to calculate user retention problems with sql 1, Retained 1. Meaning of retention: Retained: refers to the number of users who arrive at the APP on the base date and return to the APP on the next n days; Retention rate = number of users returned on the day n days after the base date / number of users on the base date * 100% Or refers t ...

Posted by punked on Wed, 01 Sep 2021 15:35:54 -0700