ViewTube

ViewTube
Sign inSign upSubscriptions
Filters

Upload date

Type

Duration

Sort by

Features

Reset

57 results

SS UNITECH
10. pyspark performance tuning interview questions and answers | top 5 pyspark performance killers

azure #azuredatabricks #azuredatabrickswithpyspark #azuredataengineer #ssunitech In this video, we dive deep into the most ...

10:24
10. pyspark performance tuning interview questions and answers | top 5 pyspark performance killers

4,457 views

1 year ago

SS UNITECH
6. what is data skew in pyspark | pyspark interview questions & answers | databricks interview q & a

Handle Data Skewness in Apache Spark? #Databricks #PysparkInterviewQuestions #deltalake Azure Databricks #spark #pyspark ...

6:47
6. what is data skew in pyspark | pyspark interview questions & answers | databricks interview q & a

21,339 views

2 years ago

BigDatapediaAI
Salting Technique to Handle Skewed data in Apache Spark

Salting Technique to Handle Skewed data in Apache Spark Discussion Forum ----------------------------- Telegram ...

6:09
Salting Technique to Handle Skewed data in Apache Spark

7,844 views

3 years ago

SS UNITECH
9. zorder in databrick | z ordering OPTIMIZE Explain | Faster Queries with File Compaction

Discover the power of Z-Ordering in PySpark, a game-changing technique for optimizing spatial data processing and analysis.

6:06
9. zorder in databrick | z ordering OPTIMIZE Explain | Faster Queries with File Compaction

4,885 views

1 year ago

CMU Database Group
A Deep Dive into Spark SQL's Catalyst Optimizer (Cheng Lian + Maryann Xue, DataBricks)

CMU Database Group - Quarantine Tech Talks (2020) Speaker: Cheng Lian + Maryann Xue (DataBricks) A Deep Dive into Spark ...

1:08:50
A Deep Dive into Spark SQL's Catalyst Optimizer (Cheng Lian + Maryann Xue, DataBricks)

6,225 views

5 years ago

SS UNITECH
5. pyspark performance tuning | partitioning and bucketing in pyspark | partitioning vs bucketing

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

10:46
5. pyspark performance tuning | partitioning and bucketing in pyspark | partitioning vs bucketing

2,151 views

1 year ago

SS UNITECH
3. pyspark performance tuning | dynamic partition pruning in apache spark

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

8:10
3. pyspark performance tuning | dynamic partition pruning in apache spark

1,352 views

1 year ago

Master of Machines
PySpark Interview Questions You NEED to Prep For

PySpark Interview Questions You NEED to Prep For Are you preparing for a PySpark interview? Whether you're aiming for a data ...

4:52
PySpark Interview Questions You NEED to Prep For

152 views

1 year ago

SS UNITECH
22. union and unionAll in PySpark | unionbyname in pyspark | pyspark tutorial for beginners

Azure Databricks #spark #pyspark #azuredatabricks #azure In this video, I discussed how to use union, unionall and ...

6:52
22. union and unionAll in PySpark | unionbyname in pyspark | pyspark tutorial for beginners

947 views

3 years ago

Surfalytics | Fast Track to Data Career
How to manage workloads and determine appropriate cluster size? | Surfalytics

Dmitry Anoshin from Surfalytics answers a subscriber question about managing Spark workloads. He covers key considerations ...

12:07
How to manage workloads and determine appropriate cluster size? | Surfalytics

240 views

1 year ago

SS UNITECH
4. pyspark performance tuning | repartitioning and coalesce in pyspark | repartition vs coalesce

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

6:26
4. pyspark performance tuning | repartitioning and coalesce in pyspark | repartition vs coalesce

1,472 views

1 year ago

SS UNITECH
2. pyspark performance tuning | spark query plan practical | wide and narrow transformation

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

12:59
2. pyspark performance tuning | spark query plan practical | wide and narrow transformation

1,608 views

1 year ago

Surfalytics | Fast Track to Data Career
Spark UI and Query plan review project | Surfalytics

This video provides a practical guide to using Apache Spark, focusing on running Spark locally with Docker and Databricks ...

1:00:34
Spark UI and Query plan review project | Surfalytics

235 views

1 year ago

dotconferences
dotScale 2016 - Sean Owen - Scaling Learning on Apache Spark

Filmed at http://2016.dotscale.io on April 25th in Paris. More talks on http://thedotpost.com Scaling up machine learning ...

16:40
dotScale 2016 - Sean Owen - Scaling Learning on Apache Spark

350 views

10 years ago

Sleep Eat Azure
Run your SparkSQL 4x faster  with Native Execution Engine!!!

... SparkSQL Efficiency Apache Spark Optimization Tips Turbocharge SparkSQL with Native Engine Maximizing SparkSQL Speed ...

5:34
Run your SparkSQL 4x faster with Native Execution Engine!!!

300 views

2 years ago

SS UNITECH
25. split function in pyspark | pyspark advanced tutorial | getitem in pyspark | databricks tutorial

Azure Databricks #spark #pyspark #azuredatabricks #azure In this video, I discussed how to use split functions in pyspark. 1. split ...

6:55
25. split function in pyspark | pyspark advanced tutorial | getitem in pyspark | databricks tutorial

2,429 views

2 years ago

BigDatapediaAI
Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Demo

Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Example Discussion Forum ...

54:37
Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Demo

1,411 views

4 years ago

Surfalytics | Fast Track to Data Career
Real Interview Q&A for Senior Data Engineer #1 | Surfalytics

Gain a unique perspective on the technical and problem-solving skills expected of senior data engineers in this very little edited ...

30:26
Real Interview Q&A for Senior Data Engineer #1 | Surfalytics

21,426 views

1 year ago

Plain Schwarz
Prashanth Babu – Simplifying upserts and deletes on Delta Lake tables

Data Engineers face many challenges with Data Lakes. GDPR requests, data quality issues, handling large metadata, merges ...

31:14
Prashanth Babu – Simplifying upserts and deletes on Delta Lake tables

186 views

4 years ago

The ASF
Big Data File Format Cost Efficiency - Millions of Dollars Deal

Big Data File Format Cost Efficiency - Millions of Dollars Deal Xinli Shang, Juncheng Ma A presentation from ApacheCon @Home ...

27:59
Big Data File Format Cost Efficiency - Millions of Dollars Deal

415 views

5 years ago