Build records of problems encountered in native hadoop and cdh
hadoop startup error ERROR: Cannot set priority of datanode process
The cluster was not formatted
./bin/hdfs namenode -format
Modify yarn default port After that, it needs to be restarted because it is not hot
database Error reporting 1045
[root@test ~]# systemctl stop mariadb ##Close mysql
[root@test ~]# mysqld_safe --skip-grant-tables ...
Posted by dcooper on Thu, 28 Oct 2021 23:28:19 -0700
DB4AI: enable database native AI computing, and data relocation from complex to simple
DB4AI tries to help users get rid of tedious data handling, export and management by implanting AI computing power into the database. It sounds reasonable to use the database to store massive data, but in the face of a traditional database, users as algorithm engineers or AI beginners have to export the data of the data set and then import it i ...
Posted by crabfinger on Thu, 28 Oct 2021 19:21:52 -0700
[big data Java foundation - Java concurrency 14] J.U.C's blocking queue: LinkedBlockingDeque
The previous BlockingQueue is a one-way FIFO queue, while LinkedBlockingDeque is a two-way blocking queue composed of linked lists. A two-way queue means that elements can be inserted and removed from both ends of the header and tail. It also means that LinkedBlockingDeque supports FIFO and FILO operations.
LinkedBlockingDeque is an optional c ...
Posted by koenigsbote on Thu, 28 Oct 2021 11:08:38 -0700
Destroyorringbuffer multi producer write
Previous chapter This chapter mainly introduces how a single producer writes data to RingBuffer data, how not to make rings overlap, notify consumers after writing, batch processing at one end of the producer, and how multiple producers work together. This chapter mainly introduces how multiple producers write data to RingBuffer data.
1. The M ...
Posted by Beans on Wed, 27 Oct 2021 20:06:08 -0700
DisruptorRingBuffer single producer write
The previous chapter mainly introduces how consumers read data from RingBuffer. This chapter mainly introduces how a single producer writes data to RingBuffer. How to avoid overlapping rings in the process of RingBuffer data writing, notify consumers after writing, batch processing at the producer side, and how multiple producers work together. ...
Posted by The-Last-Escape on Wed, 27 Oct 2021 19:48:18 -0700
[big data Java foundation - Java concurrency 07] J.U.C's blocking queue: ArrayBlockingQueue
ArrayBlockingQueue, a bounded blocking queue implemented by an array. The queue uses the FIFO principle to sort and add elements.
ArrayBlockingQueue is bounded and fixed. Its size is determined by the constructor during construction. It cannot be changed after confirmation. ArrayBlockingQueue supports the optional fair policy of sorting waitin ...
Posted by dcmbrown on Wed, 27 Oct 2021 08:26:28 -0700
Common operators for Spark Core learning (including classic interview questions)
catalogue
preface
Part I: Transformation operator
Value type
map() map
mapPartitions() executes Map in partition units
mapPartitionsWithIndex() with partition number
flatMap() flatten
glom() partition conversion array
groupBy() group
Extension: complex wordcount
Filter
sample()
distinct() de duplication
coalesce() repartition
rep ...
Posted by prawn_86 on Tue, 26 Oct 2021 21:12:41 -0700
How to use the new ES specification in your project
Many articles are teaching us ES6/7/8/9/11/12 Relevant specifications, but how to use these in our project ES standard? What do you need to pay attention to?
This paper combines ES11 Two very useful features in, the null merge operator (?) and the optional chain operator (?) to see how to use the rel ...
Posted by xeq on Tue, 26 Oct 2021 17:54:13 -0700
Haystack extension indexing (Elasticsearch)
Get started with python Programming quickly (continuous update...)
python actual combat project (Django technical point)
Tips: At the bottom of Elasticsearch is the open source library Lucene. However, Lucene cannot be used directly. You must write your own code to call its interface. reflection: How do we connect to Elasticsearch server? Sol ...
Posted by rtadams89 on Tue, 26 Oct 2021 02:51:47 -0700
Graduation project - Title: spam (short message) classification algorithm to realize machine learning and deep learning
1 Preface
Hi, everyone, this is senior Dan Cheng. Today, I'm doing an e-commerce sales forecast analysis. This is just a demo. I'm trying to analyze the film data and visualize the system
Bi design help, problem opening guidance, technical solutions
🇶746876041
2 principle of spam SMS / Email Classification Algorithm
Spam content is oft ...
Posted by phice on Sun, 24 Oct 2021 22:36:19 -0700