Zookeeper enterprise best practices

1. Course content Today's main contents include: 1,ZooKeeper Core functions of-ZNode data model 2,ZooKeeper Core functions of-Watcher 3,Zookeeper actual combat Application scenario Implementation of actual enterprise case Purpose of enterprise application case: 1,I will realize these needs 2,You should know that some commonly u ...

Posted by marty on Sun, 10 Oct 2021 19:41:14 -0700

Hive's architecture design and SQL statement review summary

1, Hive's architecture design and SQL statement review summary 1.1. Data warehouse The definition put forward by Bill Inmon, the father of data warehouse, in his book "Building the Data Warehouse" published in 1991 is widely accepted. (DW for short) (DM) Data Warehouse is a Subject Oriented, Integrated, non volatile and Time V ...

Posted by Bastern on Sun, 10 Oct 2021 19:39:12 -0700

spark advanced: spark streaming usage Structured Streaming

Spark 2.0 has produced a new stream processing framework Structured Streaming, which is a scalable and fault-tolerant stream processing engine built on Spark SQL Engine. Using Structured Streaming, you can perform streaming computing on static data (Dataset/DataFrame) like batch computing. With the continuous arrival of data, Spark SQL Engine w ...

Posted by kimandrel on Sat, 09 Oct 2021 22:42:45 -0700

Scala learning object oriented

object-oriented Scala's object-oriented thought is consistent with Java's object-oriented thought and concept.The syntax in Scala is different from that in Java, and more functions are added. Scala package Basic syntax: package nameThree functions of Scala package (same as Java) Distinguish between classes with the same nameWhen there ...

Posted by luisluis on Sat, 09 Oct 2021 00:11:15 -0700

Centos6.8 + Hadoop 3.2 + JDK1.8 distributed cluster installation process (real)

These days when I started hadoop, I didn't even mention the installation of hadoop distributed cluster in the video. I started to talk about the concept directly. After thinking about it for a few weeks, I still solved it. There are too many small problems and the data are messy. The blogs speak differently. I have to summarize and find out the ...

Posted by lordfrikk on Fri, 08 Oct 2021 20:16:11 -0700

Linux builds Oracle database and makes remote connection

Project resource requirements   VMVare15 resource link: https://pan.baidu.com/s/1cVzeKjqu0Cmp4qMRDbFx8Q Extraction code: tdn4   CentOS7 image file link: https://pan.baidu.com/s/14QyfiXYYObdynswJlOoI1g Extraction code: 6cxp   oracle11 Linux version link: https://pan.baidu.com/s/16hWmzGudLjUEpkRzHAOGZw Extraction code: y34w &e ...

Posted by Cosizzle on Fri, 08 Oct 2021 12:12:46 -0700

Learning notes Spark - installation and configuration of Spark cluster

1, Spark cluster topology 1.1 cluster scale 192.168.128.10 master 1.5G ~2G Memory, 20 G Hard disk NAT,1~2 Nuclear; 192.168.128.11 node1 1G Memory, 20 G Hard disk NAT,1 nucleus 192.168.128.12 node2 1G Memory, 20 G Hard disk NAT,1 nucleus 192.168.128.13 node3 1G Memory, 20 G Hard disk NAT,1 nucleus 1.2 Spark installation mo ...

Posted by Snewzzer on Thu, 07 Oct 2021 01:32:19 -0700

Linux custom script integration

1. Cluster distribution file Application scenario We often need to copy the newly created and modified files to the same directory of all nodes. It is not so friendly to execute the scp command once. Basic knowledge (a) rsync command original copy: [root@bigdata801 hadoop-3.3.1]# rsync -av /opt/module/hadoop-3.3.1/ bigdata802:/opt/module/h ...

Posted by Dimitri89 on Wed, 06 Oct 2021 16:56:51 -0700

02 - room reservation system database - user and room reservation data operation

02 - room reservation system database - user and room reservation data operation Project description With the increasing popularity of online room reservation, the continuous improvement of policies and regulations and the continuous improvement of technical level, online room reservation will become one of the main means of commercial tr ...

Posted by shinephp on Tue, 05 Oct 2021 15:50:49 -0700

E-commerce data warehouse of data warehouse -- 2. Business data collection platform

1, Introduction to e-commerce business 1.1 e-commerce business process The business process of e-commerce can be illustrated by taking the browsing footprint of an ordinary user as an example. Users click the home page of e-commerce to start browsing. They may find their favorite products through classified query or full-text search. Thes ...

Posted by BANDYCANDY on Mon, 04 Oct 2021 15:39:02 -0700