Programmer Group

Welcome to the blog home page: WeChat Search: import_bigdata, original hard core creator of big data domain _import_bigdata_CSDN blog Welcome to comment, collection, message, message exchange!This article was originally created by Wang Zhiwu and first published in the CSDN blog!The first CSDN forum of this article is forbidden to be reproduced ...

1, Continuous problem The following data are the low carbon emissions received by users in ant forest id dt lowcarbon 1001 2021-12-12 123 1002 2021-12-12 45 1001 2021-12-13 43 1001 2021-12-13 45 1001 2021-12-13 23 1002 2021-12-14 45 1001 2021-12-14 230 1002 2021-12-15 45 1001 2021-12-15 23 ... ... Find out the users who have receiv ...

Hello, I'm brother Tu. At present, he works as a big data algorithm engineer in a large Internet factory. Today, a fan sent a message in the group asking if there is any information about Flink DDL, saying that he is a new learner. In order to let this fan quickly learn how to use Flink DDL, I will explain the principle and attach the actu ...

Many data in Hive will be stored in JSON format. For example, when developers embed the page on the APP, they will store multiple fields in a JSON array. Therefore, when the data platform calls the data, it is necessary to analyze the embedded data. Next, let's talk about how JSON data is parsed in Hive. Hive's own json parsing function 1. ge ...

There are many ways to connect hive and impala in python, including pyhive,impyla,pyspark,ibis, etc. in this article, we will introduce how to use these packages to connect hive or impala, and how to pass kerberos authentication. Kerberos If the cluster does not enable kerberos authentication, the ...

1, Syntax description of load statement in Hive Hive Load statement will not do any conversion work when loading data, but simply copy / move the data file to the address corresponding to hive table. The syntax format is as follows: LOAD DATA [LOCAL] INPATH 'filepath' [OVERWRITE] INTO TABLE tablename \ [PARTITION (partcol1=val1, partcol2= ...

Preface The text and pictures of this article are from the Internet, only for learning and communication, not for any commercial purpose. The copyright belongs to the original author. If you have any questions, please contact us in time for handling. Analysis background With the popularity of artificial intelligence and big data in recent years ...

                   . Catalog 1, Hadoop source compilation supports Snappy compression 1.1 resource preparation 1.2 jar package installation 1.3 compiling source code 2, Hadoop compression configuration 2 ...

Lateral view is used with split, expand and other UDTF to split a row of data into multiple rows. On this basis, the split data can be aggregated. Lateral view first calls UDTF for each row of the original table, and UDTF will split a row into one or more rows. Then lateral view combines the results to produce a virtual table that supports alia ...

Window function is often used in work and often asked in interview. Do you know the implementation principle behind it? Starting from the problems encountered in a business, this paper discusses the data flow principle of window function in hsql, and gives a solution to this problem at the end of the article. ​   1, Business background Fi ...