Programmer Group

1. Basic types of packaging Recall that in the third article, when we learned about the basic data types in Java, we said that there are eight basic data types in Java, but these data are basic data, and it is very difficult to perform complex operations on them. What shall I do? 1.1 Summary of Basic Types of Packaging Classes In the actual ...

1 Overview 1.1 Introduction to Zookeeper Middleware, providing coordination services Acting on the distributed system and giving full play to its advantages, it can serve the big data Support Java, provide Java and C language client API 1.2 what is distributed system? Many computers form a whole, one whole is consistent with the outside worl ...

After Ignite cluster is built, the application can access the cluster for various operations. But the default cluster has no security protection mechanism. Any application and client supporting JDBC can access the cluster as long as they know the IP address of the cluster node, which creates a certain security risk, which is sensitive to holdin ...

1 Demand analysis WebServer/Application Server is scattered across machines, but we still want to do statistical analysis on the Hadoop platform. How do we collect logs on the Hadoop platform? Is that simple? shell cp hadoop Clustered machines; hadoop fs -put ... / Obviously, this method is facing a series of problems such as fault toleranc ...

I. Pre-conditions Hadoop runs on JDK and needs to be pre-installed. The installation steps are as follows: Installation of JDK under Linux Configuration of Secret-Free Login The communication between Hadoop components needs to be based on SSH. 2.1 Configuration Mapping Configure ip address and host name mapping: vim /etc/hosts # Increase at ...

This article only describes IP, virtual IP and scan changes in the same segment of the public network, and will introduce IP changes in different segments later. The experimental environment: 1. Stop RAC Cluster Services Cluster services are stopped at two nodes: [root@odb09 ~]# /u01/app/11.2.0/grid/bin/crsctl stop cluster -all [root@odb09 ~] ...

Preface Recently, when Baidu wants to learn Spark's newer Structured Streaming, all of them are monotonous wordcount s, which are quite speechless.You have to figure out for yourself what you can do with the Select and Filter operations of the Dataframe.Because of using Python, using Pandas, and trying to turn Pandas to process, readStream doe ...

Installation of Hive libraries for large data components: 1. First, download it from the official website of hive. https://hive.apache.org/downloads.html Note that when choosing the hive version, you need to pay attention to the hadoop version. The hive must be based on hadoop before it can be started. The following error is reported in the ...

In version 2.3 of Kafka, the Kafka connector has been greatly improved. First, when adding and deleting connectors, the way Kafka connectors handle tasks is modified. Previously, this action brought the whole system to a standstill, which has been criticized by the development and maintenance personnel. In addition, other problems frequently me ...

1.flume configuration Create a file that flume listens to instead of a kafka producer to transfer content to consumers. The configuration is as follows ###############to sinnsource,channel give a name###############a kafka_agent.sources = kafka_source kafka_agent.sinks = kafka_sink kafka_agent.channels = kafka_channel ##############To ...