Programmer Group

Recently, many small data mining projects have been done, using and comparing N-multiple algorithms, and understanding many machine learning tools, such as R language, Spark machine learning library, Python, Tensorflow and RapidMiner, etc. But I feel that I can't go deep into it, at best I just play with other people's tools. The advantages an ...

I. overview The last article has explained Fragment's life cycle, basic usage methods and the role of some api s. But if you want to use Fragment well in your project, you must be able to clearly manage its status. Here are some scenarios that you will encounter in actual development. 2. Fragment Back Stack Management Activity is managed ...

ServerSocketChannelServer Socket Channel role? What do you do full-time?        1. Monitor the new TCP link channel.        2. Create a new Socket ChannelServer Socket Channel does not have any capabilities    Server Socket Channel does not have ...

spark version 1.6.0, Scala version 2.12, jdk version 1.8. spark has been used recently and is recorded here. One master and three workers, together with Hadoop-2.7.7 cluster, namdenode on master and two datanode s on worker 1 and worker 2.     List-1 192.168.33.30 worker1 master 192.168.33.31 worker2 192.168.33.32 worker3 Modify the h ...

Does 51CTO have no directory function?Good or bad ========Welcome to Penguin for any questions ^-^1176738641 ======== preparation in advance folders creating #Create five folders in the user directory app #Storage application software #Store application packages data #Store test data lib #Store jar pa ...

Referring to ALS, we believe that everyone should not feel strange (not unfamiliar why you click in [cover your face]), it is a kind of collaborative filtering, and is integrated into Spark's MLIB library. This article explains the basic principles of ALS, and hand-in-hand, shoulder-to-shoulder with you to implement this algorithm. Principle ch ...

Case study: Spark SQL load, save Case Practice - > Generic load Save   load and save operations:   For Spark SQL DataFrame, no matter what data source is created from, there are some common load and save operations. The load operation is mainly used to load data and create a DataFrame; the save operation is mainly use ...

Implementation ideas 1. Get input RDD for raw data (HDFS file) 2. The filter operator is used to filter the data in the input RDD and filter out the data that meet the query conditions. 2.1 Common practice: directly in fitler operator function, use the external query condition (Map), but if this is done, the query condition ...

                     The source of this article is: http://blog.csdn.net/bluishglc/article/details/50945032 Reproduction in any form is strictly prohibited, otherwise CSDN will be entrusted to the official protection of rights and interests! Spark's official documentation repeatedly emphasizes operations that will work on RDD, w ...

Introduction to Manifest Manifest is a feature introduced by Scala 2.8 that allows compilers to obtain generic type information at runtime. stay JVM On the other hand, the generic parameter type T is "wiped" off at runtime, and the compiler treats T as an Object. So the specific information of T is not available; in order to get the ...