Programmer Group

To access Hive, Java needs to connect Hive by beeline. hiveserver2 provides a new command-line tool, beeline. hiveserver2 upgrades the previous hive, which has more powerful functions. It adds permission control. To use beeline, you need to start hiverserver2 first, and then use beeline connection. Operation steps: (1) Modi ...

This article aims to show you how to install ES in windows system and how to use its REST API to operate ES in windows system. (1) Installation of ES under Windows Make sure that the machine has java installed before installing es, preferably a newer version. I have 10 installed on my machine. C:\>java -version java versi ...

[Note] This article refers to learning videos from Calf School. Spark Exercises: Seeking TopN for Teachers of All Subjects Data format: http://bigdata.edu360.cn/laozhang 1. Data segmentation val func=(line:String)=>{   val index=line.lastIndexOf("/")   val teacher=line.substring(index+1)   val httpHost=line.substrin ...

Spark SQL (DataFrame) is introduced in websites and some books to generate final running statements based on the corresponding operations. This article starts with a simple, low-level problem and ends with a look at the generated code to find the root cause of the problem and a brief introduction to how to debug SparkSQL. Sour ...

1. Edit profile file export JAVA_HOME=/usr/lib/jvm/jdk/ export HADOOP_INSTALL=/sur/local/hadoop export PATH=$PATH:$HADOOP_INSTALL/bin export PATH=$PATH:$HADOOP_INSTALL/sbin export HADOOP_MAPRED_HOME=$HADOOP_INSTALL export HADOOP_COMMON_HOMR=$HADOOP_INSTALL export HADOOP_HDFS_HOME=$HADOOP_INSTALL export YARN_HOME-$HADOOP_INSTAL ...

1. Prepare the environment The mapred-site.xml and yarn-site.xml configuration files of Hadoop under Windows are updated as in the virtual machine. Copy mapred-site.xml and yarn-site.xml configuration files to the project. Add dependency packages. 2. Operation mode Run locally (start multiple threads in local eclipse to simul ...

1. What is freemarker? FreeMarker is a template engine written in Java language, which generates text output based on templates. FreeMarker has nothing to do with Web containers, that is, when the Web runs, it does not know about Servlet s or HTTP. It can be used not only as a presentatio ...

I. Realizing Functions Flume monitors a log file and sends the data to kafka, and then another flume gets the data from kafka. II. Implementation steps 1. environment flume1.6.0 kafka_2.10-0.8.2.1 zookeeper3.4.5 2.flume monitors logs and sends them to kafka's configuration file test1_1.6.conf [reference: http://archive. ...

In the last three articles, we used the automated tools to integrate Jenkins Docker Cloud with Robot Framework + Selenium + Chome, and realized the automated testing of the Web in Pipeline, from the installation of the Web automated testing tools under windows to the containerization of the Web automated testing tool Robot Frame ...

Reference to "Recommendation System Practice" Item Liang Concept: Item-based collaborative filtering algorithm, optimization algorithm Contrast: Advantages and Disadvantages of User Collaborative Filtering python coding implementation 1. Algorithmic Definition User-based collaborative filtering algorithm Commod ...