Build records of problems encountered in native hadoop and cdh

hadoop startup error ERROR: Cannot set priority of datanode process The cluster was not formatted ./bin/hdfs namenode -format Modify yarn default port After that, it needs to be restarted because it is not hot database Error reporting 1045 [root@test ~]# systemctl stop mariadb ##Close mysql [root@test ~]# mysqld_safe --skip-grant-tables ...

Posted by dcooper on Thu, 28 Oct 2021 23:28:19 -0700

DB4AI: enable database native AI computing, and data relocation from complex to simple

DB4AI tries to help users get rid of tedious data handling, export and management by implanting AI computing power into the database. It sounds reasonable to use the database to store massive data, but in the face of a traditional database, users as algorithm engineers or AI beginners have to export the data of the data set and then import it i ...

Posted by crabfinger on Thu, 28 Oct 2021 19:21:52 -0700

[big data Java foundation - Java concurrency 14] J.U.C's blocking queue: LinkedBlockingDeque

The previous BlockingQueue is a one-way FIFO queue, while LinkedBlockingDeque is a two-way blocking queue composed of linked lists. A two-way queue means that elements can be inserted and removed from both ends of the header and tail. It also means that LinkedBlockingDeque supports FIFO and FILO operations. LinkedBlockingDeque is an optional c ...

Posted by koenigsbote on Thu, 28 Oct 2021 11:08:38 -0700

Destroyorringbuffer multi producer write

Previous chapter This chapter mainly introduces how a single producer writes data to RingBuffer data, how not to make rings overlap, notify consumers after writing, batch processing at one end of the producer, and how multiple producers work together. This chapter mainly introduces how multiple producers write data to RingBuffer data. 1. The M ...

Posted by Beans on Wed, 27 Oct 2021 20:06:08 -0700

DisruptorRingBuffer single producer write

The previous chapter mainly introduces how consumers read data from RingBuffer. This chapter mainly introduces how a single producer writes data to RingBuffer. How to avoid overlapping rings in the process of RingBuffer data writing, notify consumers after writing, batch processing at the producer side, and how multiple producers work together. ...

Posted by The-Last-Escape on Wed, 27 Oct 2021 19:48:18 -0700

[big data Java foundation - Java concurrency 07] J.U.C's blocking queue: ArrayBlockingQueue

ArrayBlockingQueue, a bounded blocking queue implemented by an array. The queue uses the FIFO principle to sort and add elements. ArrayBlockingQueue is bounded and fixed. Its size is determined by the constructor during construction. It cannot be changed after confirmation. ArrayBlockingQueue supports the optional fair policy of sorting waitin ...

Posted by dcmbrown on Wed, 27 Oct 2021 08:26:28 -0700

Common operators for Spark Core learning (including classic interview questions)

catalogue preface Part I: Transformation operator Value type map() map mapPartitions() executes Map in partition units mapPartitionsWithIndex() with partition number flatMap() flatten glom() partition conversion array groupBy() group Extension: complex wordcount Filter sample() distinct() de duplication coalesce() repartition rep ...

Posted by prawn_86 on Tue, 26 Oct 2021 21:12:41 -0700

How to use the new ES specification in your project

Many articles are teaching us   ES6/7/8/9/11/12   Relevant specifications, but how to use these in our project   ES   standard? What do you need to pay attention to? This paper combines   ES11   Two very useful features in, the null merge operator (?) and the optional chain operator (?) to see how to use the rel ...

Posted by xeq on Tue, 26 Oct 2021 17:54:13 -0700

Haystack extension indexing (Elasticsearch)

Get started with python Programming quickly (continuous update...) python actual combat project (Django technical point) Tips: At the bottom of Elasticsearch is the open source library Lucene. However, Lucene cannot be used directly. You must write your own code to call its interface. reflection: How do we connect to Elasticsearch server? Sol ...

Posted by rtadams89 on Tue, 26 Oct 2021 02:51:47 -0700

Graduation project - Title: spam (short message) classification algorithm to realize machine learning and deep learning

1 Preface Hi, everyone, this is senior Dan Cheng. Today, I'm doing an e-commerce sales forecast analysis. This is just a demo. I'm trying to analyze the film data and visualize the system Bi design help, problem opening guidance, technical solutions 🇶746876041 2 principle of spam SMS / Email Classification Algorithm Spam content is oft ...

Posted by phice on Sun, 24 Oct 2021 22:36:19 -0700