Programmer Group

Article Directory 1. Download the source code 2. Compile support for UDF 2.1 Upload and Unzip 2.2 Add UDF Function Class 2.3 Registration Functions 2.4 Compile hive 3. Deployment and installation 4. Testing UDF Friendly Tip: To reduce the probability of maven compilation errors on the server, you can choose to open the so ...

See: https://gitee.com/imlichao/RocketMQ-example for code examples in this article Apache RocketMQ document: http://rocketmq.apache.org/docs/quick-start/ Aliyun RocketMQ document: https://help.aliyun.com/product/29530.html brief introduction Message Queue RocketMQ is a professional message middleware developed by Alibaba Group. Based on ...

Preface Last article SpringBoot: A Brief Introduction to Integrated Shiro In this article, we briefly describe the basic concepts of Shiro and Shiro's internal process. Next, I will briefly describe the basic content and usage scenarios of this blog. This blog mainly talks about integrating Shiro in SpringBoot 2.0, using IN ...

Use jdk:1.8, maven:3.3.3 How spring gets beans Contents of the pom.xml file: <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0 ...

Case study: Spark SQL load, save Case Practice - > Generic load Save   load and save operations:   For Spark SQL DataFrame, no matter what data source is created from, there are some common load and save operations. The load operation is mainly used to load data and create a DataFrame; the save operation is mainly use ...

Implementation ideas 1. Get input RDD for raw data (HDFS file) 2. The filter operator is used to filter the data in the input RDD and filter out the data that meet the query conditions. 2.1 Common practice: directly in fitler operator function, use the external query condition (Map), but if this is done, the query condition ...

Big Data Learning 06_Hadoop: An Overview of MapReduce Overview of MapReduce MapReduce Core MapReduce Programming Specification MapReduce Case Practice 1: WordCount Hadoop serialization MapReduce Case Practice 2: FlowCount Overview of MapReduce MapReduce Core The MapReduce operator is divided into at least two phases ...

What did you say? JOIN operator is the core operator of data processing. We introduced UnBounded's two-stream JOIN in Apache Flink Talk Series (09) - JOIN Operator earlier. We introduced single-stream and UDTF JOIN operation in Apache Flink Talk Series (10) - JOIN LATERAL. We also introduced single-stream and version table JOI ...

maven packaging Package the plug-in maven-jar-plugin with mavenAdd the following code at the end of the pom.xml file.maven-dependency-plugin refers to copying a dependent jar package to a specified directorymaven-resources-plugin copies dependent resources to the specified directory <build> <plugins> <plu ...

The following methods and codes are for learning purposes only, not for other purposes.The example uses several libraries, including jsoup, HttpClient, net.sf.json, which you can download on your own. 1. Analyse if you can get TOP500 song lists First, open the cool dog homepage to see the cool dog TOP500, say 500, how can ther ...