spark examples
Spark Streaming is a quasi-real-time stream processing framework. The processing response time is usually in minutes, that is to say, the delay time of processing real-time data is in seconds; Storm is a real-time stream processing framework, and the processing response is in milliseconds. So the selection of flow framework depends on the spec ...
Posted by Frederick on Fri, 21 Jun 2019 14:37:32 -0700
6. Use read to define variables
To illustrate the example below, we first install the Apache server and then start Apache.
[root@localhost ~]# yum install httpd
[root@localhost ~]# systemctl start httpd
[root@localhost ~]# ps aux | grep http
root 3716 0.5 0.0 221936 5000 ? Ss 13:49 0:00 /usr/sbin/httpd -DFOREGROUND
apache 3717 0.0 0.0 224020 3088 ...
Posted by Gokul on Fri, 21 Jun 2019 13:55:33 -0700
Problems with AMQ under Servlet 3.0
Question 1: http status 500
Description:
When the project switched to Tomcat 7, there was a problem with message push implemented by amq. Most of the requests sent by amq.js were 500, only a few were 200.
Analysis:
Under Servlet 2.5 container, the servlet component supports asynchronous communication by default, but it needs to be open ...
Posted by xtops on Tue, 18 Jun 2019 16:52:40 -0700
Spring Cloud Ribbon 5-minute Quick Guide
"It takes about 4 minutes to read this article"
In the previous five-minute guides to Spring Cloud, we have introduced several core components of Spring Cloud in turn, covering the fundamental functions required in a microservice architecture, such as service discovery, melting, centralized configuration.The protagonist ...
Posted by Stasonis on Tue, 18 Jun 2019 09:18:35 -0700
Spring Boot automatically encapsulates and validates form entities with REST API requests
Read Spring.io valid form validation demo and tutorials on the official website. Let me start with the official spring book tutorial, and then briefly talk about some of the ways in which unified validation management is written to facilitate lazy people or code optimization.
Form annotations require that the project rely on the hibernate ...
Posted by fusioneko on Mon, 17 Jun 2019 14:26:25 -0700
Spark SQL Learning Notes
Spark SQL is a module for processing structured data in Spark. Unlike the underlying Park RDD API, the Spark SQL interface provides more information about the structure of data and the runtime of computing tasks. Spark SQL now has three different APIs: the SQL statement, the DataFrame API and the latest Dataset API.One use of Spark SQL is to ex ...
Posted by arunmj82 on Sun, 16 Jun 2019 17:27:38 -0700
Log ic settings for Spring Boot
1. Maven dependence
No additional dependencies need to be introduced, just the starter required by Spring Boot:
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
</dependency>
2. Log format
Without modifying the default settings, Spring Boot ...
Posted by bad_goose on Sat, 15 Jun 2019 17:04:11 -0700
Spring MVC -- Verification by sending short messages on mobile phones when registering
When writing a registration, I want to use the mobile phone number to verify, to ensure the user's safe operation, because the previous use of email verification is too troublesome. So we found a better third party on the Internet to provide short message service.
Try it, the speed is good, basically three seconds or so can receive short ...
Posted by belphegor on Fri, 14 Jun 2019 18:36:51 -0700
OpenSAML usage boot I: Introduction - everything you need to know about OpenSAML
Relevant Reading SAML 2.0 Introduction Guide This article has introduced the basic information of the SAML protocol. Today we will begin to explain OpenSaml, an open source implementation of the SAML protocol.
SAML
What's OpenSAML
OpenSAML is a dependency library that facilitates the use of SAML messages. Its main functions include:
Create S ...
Posted by The.Pr0fess0r on Fri, 14 Jun 2019 17:32:13 -0700
Connection pool (1): Why can I share a database connection when it is closed?
There has always been a question about the use of database connection pools:
During the use of database connection, the exclusive requirement must be met (other threads cannot access it). Close the database connection after use. The problem is that the database connection has been closed. How can other threads use it?
With this in mind, ...
Posted by NeMoD on Thu, 13 Jun 2019 09:26:08 -0700