spark examples

Spark Streaming is a quasi-real-time stream processing framework. The processing response time is usually in minutes, that is to say, the delay time of processing real-time data is in seconds; Storm is a real-time stream processing framework, and the processing response is in milliseconds. So the selection of flow framework depends on the spec ...

Posted by Frederick on Fri, 21 Jun 2019 14:37:32 -0700

6. Use read to define variables

To illustrate the example below, we first install the Apache server and then start Apache. [root@localhost ~]# yum install httpd [root@localhost ~]# systemctl start httpd [root@localhost ~]# ps aux | grep http root 3716 0.5 0.0 221936 5000 ? Ss 13:49 0:00 /usr/sbin/httpd -DFOREGROUND apache 3717 0.0 0.0 224020 3088 ...

Posted by Gokul on Fri, 21 Jun 2019 13:55:33 -0700

Problems with AMQ under Servlet 3.0

Question 1: http status 500 Description: When the project switched to Tomcat 7, there was a problem with message push implemented by amq. Most of the requests sent by amq.js were 500, only a few were 200. Analysis: Under Servlet 2.5 container, the servlet component supports asynchronous communication by default, but it needs to be open ...

Posted by xtops on Tue, 18 Jun 2019 16:52:40 -0700

Spring Cloud Ribbon 5-minute Quick Guide

"It takes about 4 minutes to read this article" In the previous five-minute guides to Spring Cloud, we have introduced several core components of Spring Cloud in turn, covering the fundamental functions required in a microservice architecture, such as service discovery, melting, centralized configuration.The protagonist ...

Posted by Stasonis on Tue, 18 Jun 2019 09:18:35 -0700

Spring Boot automatically encapsulates and validates form entities with REST API requests

Read Spring.io valid form validation demo and tutorials on the official website. Let me start with the official spring book tutorial, and then briefly talk about some of the ways in which unified validation management is written to facilitate lazy people or code optimization. Form annotations require that the project rely on the hibernate ...

Posted by fusioneko on Mon, 17 Jun 2019 14:26:25 -0700

Spark SQL Learning Notes

Spark SQL is a module for processing structured data in Spark. Unlike the underlying Park RDD API, the Spark SQL interface provides more information about the structure of data and the runtime of computing tasks. Spark SQL now has three different APIs: the SQL statement, the DataFrame API and the latest Dataset API.One use of Spark SQL is to ex ...

Posted by arunmj82 on Sun, 16 Jun 2019 17:27:38 -0700

Log ic settings for Spring Boot

1. Maven dependence No additional dependencies need to be introduced, just the starter required by Spring Boot: <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-web</artifactId> </dependency> 2. Log format Without modifying the default settings, Spring Boot ...

Posted by bad_goose on Sat, 15 Jun 2019 17:04:11 -0700

Spring MVC -- Verification by sending short messages on mobile phones when registering

When writing a registration, I want to use the mobile phone number to verify, to ensure the user's safe operation, because the previous use of email verification is too troublesome. So we found a better third party on the Internet to provide short message service. Try it, the speed is good, basically three seconds or so can receive short ...

Posted by belphegor on Fri, 14 Jun 2019 18:36:51 -0700

OpenSAML usage boot I: Introduction - everything you need to know about OpenSAML

Relevant Reading SAML 2.0 Introduction Guide This article has introduced the basic information of the SAML protocol. Today we will begin to explain OpenSaml, an open source implementation of the SAML protocol. SAML What's OpenSAML OpenSAML is a dependency library that facilitates the use of SAML messages. Its main functions include: Create S ...

Posted by The.Pr0fess0r on Fri, 14 Jun 2019 17:32:13 -0700

Connection pool (1): Why can I share a database connection when it is closed?

There has always been a question about the use of database connection pools: During the use of database connection, the exclusive requirement must be met (other threads cannot access it). Close the database connection after use. The problem is that the database connection has been closed. How can other threads use it? With this in mind, ...

Posted by NeMoD on Thu, 13 Jun 2019 09:26:08 -0700