Java API Operation of Hive in the Big Data Introduction Tutorial Series
To access Hive, Java needs to connect Hive by beeline. hiveserver2 provides a new command-line tool, beeline. hiveserver2 upgrades the previous hive, which has more powerful functions. It adds permission control. To use beeline, you need to start hiverserver2 first, and then use beeline connection.
Operation steps:
(1) Modi ...
Posted by blacklotus on Wed, 30 Jan 2019 02:54:15 -0800
Redis Connect Java Project
1. Create a new Maven Project: Redis2. Allow output folders of source folders3. Modify the pom.xml file
<project xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
<modelVersio ...
Posted by crseader on Tue, 29 Jan 2019 21:45:15 -0800
SparkSQL View Debugging Generated Code
Spark SQL (DataFrame) is introduced in websites and some books to generate final running statements based on the corresponding operations. This article starts with a simple, low-level problem and ends with a look at the generated code to find the root cause of the problem and a brief introduction to how to debug SparkSQL.
Sour ...
Posted by NikkiLoveGod on Tue, 29 Jan 2019 20:51:15 -0800
Remote Driven Printing PDF
Recently received a demand: in order to improve business efficiency when printing PDF forms, packers do not need to download PDF manually and then operate printing manually, to achieve automatic drive printer to print PDF.
Idea: The PDF side exists on the server alone, and the printer is connected to the packer's computer. Install a print inter ...
Posted by overlordhu on Tue, 29 Jan 2019 16:00:14 -0800
Kafka (12): integration of Kafka and flume
I. Realizing Functions
Flume monitors a log file and sends the data to kafka, and then another flume gets the data from kafka.
II. Implementation steps
1. environment
flume1.6.0
kafka_2.10-0.8.2.1
zookeeper3.4.5
2.flume monitors logs and sends them to kafka's configuration file test1_1.6.conf
[reference: http://archive. ...
Posted by cutups on Tue, 29 Jan 2019 11:15:15 -0800
Detailed description of LAMP service architecture
Introduction to LAMP
LAMP: Short for Linux Apache MySQL PHP, which installs Apache, MySQL and PHP on Linux system to form an environment to run PHP scripting language, usually a website.
Apache is the most commonly used web service software, while MySQL is a relatively small database software. Both software and PHP can be installed on one mach ...
Posted by nuttynibbles on Mon, 28 Jan 2019 08:48:14 -0800
Flink Read and Write Series - Read and Write HBase
There are two ways to read HBase. One is to inherit RichSourceFunction, rewrite the parent method, and the other is to implement the OutputFormat interface. The code is as follows:
Way 1: Inherit RichSourceFunction
package com.my.flink.utils.streaming.hbase;
import com.my.flink.utils.config.ConfigKeys;
import org.apache.flin ...
Posted by jallard on Sun, 27 Jan 2019 21:03:14 -0800
storm drpc example
order
This article mainly demonstrates an example of storm drpc
To configure
version: '2'
services:
supervisor:
image: storm
container_name: supervisor
command: storm supervisor -c storm.local.hostname="192.168.99.100" -c drpc.servers='["192.168.99.100"]' -c drpc.port=3772 -c drpc.invocations.port=3773 -c drpc.http.p ...
Posted by temidayo on Sun, 27 Jan 2019 14:33:15 -0800
The first Feign program (Feign is not integrated in this chapter, but used separately)
The first Feign program
1. Feign is integrated into Spring Cloud Netflix module. When Eureka and Ribbon are integrated, Feign has the function of load balancing. Feign itself is easy to use, and the integration with Spring Cloud will greatly reduce the workload of our development.
2. It is an open source project on Github. Its purpose is to s ...
Posted by jib on Sun, 27 Jan 2019 11:18:15 -0800
LAMP Model Building Website
LAMP schema parsing
Components of the LAMP platform:
L: Linux operating system, which is the basic part of the whole LAMP architecture, provides the operating system to support the Web site, and provides better stability and compatibility for other components.
A: Apache website server, as the front end of LAMP architecture, has powerful funct ...
Posted by asukla on Sun, 27 Jan 2019 02:03:14 -0800