E-commerce data warehouse of data warehouse -- 2. Business data collection platform

1, Introduction to e-commerce business 1.1 e-commerce business process The business process of e-commerce can be illustrated by taking the browsing footprint of an ordinary user as an example. Users click the home page of e-commerce to start browsing. They may find their favorite products through classified query or full-text search. Thes ...

Posted by BANDYCANDY on Mon, 04 Oct 2021 15:39:02 -0700

Production Optimization Practice of hive3. X on spark 3.0

1 data tilt Most tasks are completed quickly, and only one or a few tasks are executed slowly or even fail. This phenomenon is data skew.The data skew is divided into single table query with GroupBy field and two table (or multi table) Join query. 1.1 single table data skew optimization 1.1.1 the map side performs aggregation - GroupBy opera ...

Posted by ben2k8 on Thu, 16 Sep 2021 14:35:16 -0700