Search Term

Spark - Engine 12 pages

Action Function
Aggregation
(Operations | Functions )
Join
lazy
Optimizer (Catalyst)
Partition
Physical Plan
Logical Plan
Data Structure (DataSet, DataFrame and RDD)
Shuffle
Transformation Function

Home
Db
Spark
Engine
Aggregation

Spark Engine - Aggregation

Table of Contents

About
Articles Related

Spark Engine - Aggregation

About

Before an aggregation, there is a shuffle taking place

Articles Related

Spark Engine - Shuffle

Discover More

Spark Engine - Shuffle

shuffle means moving data rows by rows between partition. spark.sql.shuffle.partitions - Configures the number of partitions to use when shuffling data for joins or aggregations.

Share this page:

Follow us:

Data (State)
Data (State)
DataBase
Data Processing
Data Quality
Data Structure
Data Type
Data Warehouse
Data Visualization
Data Partition
Data Persistence
Data Concurrency

Data Science
Data Analysis
Statistics
Data Science
Linear Algebra Mathematics
Trigonometry

Modeling
Process
Logical Data Modeling
Relational Modeling
Dimensional Modeling
Automata

Data Type
Number
Time
Text
Collection
Relation (Table)
Cube
Tree
Key/Value
Graph
Spatial
Color
Log

Measure Levels
Order
Nominal
Discrete
Distance
Ratio

Code
Compiler
Lexical Parser
Grammar
Function
Testing
Debugging
Shipping
Data Type
Versioning
Design Pattern

Infrastructure
Operating System
Monitoring
Cryptography
Security
File System
Network
Process (Thread)
Computer
Infra As Code

Marketing
Advertising
Analytics
Email

Web
Html
Dom
Http
Url
Css
Javascript
Selector
Browser
Web Services
OAuth

Contact
[email protected]
Privacy Policy
Status