ViewTube

ViewTube
Sign inSign upSubscriptions
Filters

Upload date

Type

Duration

Sort by

Features

Reset

55 results

SS UNITECH
10. pyspark performance tuning interview questions and answers | top 5 pyspark performance killers

azure #azuredatabricks #azuredatabrickswithpyspark #azuredataengineer #ssunitech In this video, we dive deep into the most ...

10:24
10. pyspark performance tuning interview questions and answers | top 5 pyspark performance killers

2,123 views

11 months ago

SS UNITECH
5. pyspark performance tuning | partitioning and bucketing in pyspark | partitioning vs bucketing

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

10:46
5. pyspark performance tuning | partitioning and bucketing in pyspark | partitioning vs bucketing

1,691 views

1 year ago

BigDatapediaAI
Salting Technique to Handle Skewed data in Apache Spark

Salting Technique to Handle Skewed data in Apache Spark Discussion Forum ----------------------------- Telegram ...

6:09
Salting Technique to Handle Skewed data in Apache Spark

7,110 views

2 years ago

CMU Database Group
A Deep Dive into Spark SQL's Catalyst Optimizer (Cheng Lian + Maryann Xue, DataBricks)

CMU Database Group - Quarantine Tech Talks (2020) Speaker: Cheng Lian + Maryann Xue (DataBricks) A Deep Dive into Spark ...

1:08:50
A Deep Dive into Spark SQL's Catalyst Optimizer (Cheng Lian + Maryann Xue, DataBricks)

6,059 views

5 years ago

SS UNITECH
6. what is data skew in pyspark | pyspark interview questions & answers | databricks interview q & a

Handle Data Skewness in Apache Spark? #Databricks #PysparkInterviewQuestions #deltalake Azure Databricks #spark #pyspark ...

6:47
6. what is data skew in pyspark | pyspark interview questions & answers | databricks interview q & a

16,744 views

1 year ago

SS UNITECH
1. pyspark performance tuning | spark query plan | pyspark interview questions and answers

In this video, we dive deep into PySpark performance tuning, covering essential techniques to optimize your Spark jobs.

6:16
1. pyspark performance tuning | spark query plan | pyspark interview questions and answers

2,706 views

1 year ago

SS UNITECH
3. pyspark performance tuning | dynamic partition pruning in apache spark

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

8:10
3. pyspark performance tuning | dynamic partition pruning in apache spark

997 views

1 year ago

SS UNITECH
4. pyspark performance tuning | repartitioning and coalesce in pyspark | repartition vs coalesce

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

6:26
4. pyspark performance tuning | repartitioning and coalesce in pyspark | repartition vs coalesce

1,082 views

1 year ago

SS UNITECH
22. union and unionAll in PySpark | unionbyname in pyspark | pyspark tutorial for beginners

Azure Databricks #spark #pyspark #azuredatabricks #azure In this video, I discussed how to use union, unionall and ...

6:52
22. union and unionAll in PySpark | unionbyname in pyspark | pyspark tutorial for beginners

845 views

2 years ago

Surfalytics TV
Spark UI and Query plan review project | Surfalytics

This video provides a practical guide to using Apache Spark, focusing on running Spark locally with Docker and Databricks ...

1:00:34
Spark UI and Query plan review project | Surfalytics

213 views

1 year ago

SS UNITECH
2. pyspark performance tuning | spark query plan practical | wide and narrow transformation

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

12:59
2. pyspark performance tuning | spark query plan practical | wide and narrow transformation

1,203 views

1 year ago

GKCodeLabs
Reading SparkSession from main arguments | Big Data Day to Day Work | Work as a team

In last video I have discussed about the program where you can develop big data project, and see big data use cases that include ...

23:16
Reading SparkSession from main arguments | Big Data Day to Day Work | Work as a team

1,323 views

5 years ago

FOSDEM
Maggy: Asynchronous distributed hyperparameter optimization based on Apache Spark Asynchronous algo…

Maggy: Asynchronous distributed hyperparameter optimization based on Apache Spark Asynchronous algorithms on a ...

25:02
Maggy: Asynchronous distributed hyperparameter optimization based on Apache Spark Asynchronous algo…

627 views

5 years ago

SS UNITECH
12. how partition works internally in PySpark | partition by pyspark interview q & a | #pyspark

how partition works internally in Apache Spark? PySpark interview q & a? Databricks interview question and answers?

7:13
12. how partition works internally in PySpark | partition by pyspark interview q & a | #pyspark

6,094 views

1 year ago

Sleep Eat Azure
Run your SparkSQL 4x faster  with Native Execution Engine!!!

... SparkSQL Efficiency Apache Spark Optimization Tips Turbocharge SparkSQL with Native Engine Maximizing SparkSQL Speed ...

5:34
Run your SparkSQL 4x faster with Native Execution Engine!!!

292 views

1 year ago

SS UNITECH
20. orderBy in pyspark | sort in pyspark | difference between orderby and sort in pyspark

Azure Databricks #spark #pyspark #azuredatabricks #azure In this video, I discussed how to use sort & orderby function in ...

4:25
20. orderBy in pyspark | sort in pyspark | difference between orderby and sort in pyspark

1,652 views

2 years ago

Surfalytics TV
Real Interview Q&A for Senior Data Engineer #1 | Surfalytics

Gain a unique perspective on the technical and problem-solving skills expected of senior data engineers in this very little edited ...

30:26
Real Interview Q&A for Senior Data Engineer #1 | Surfalytics

19,006 views

1 year ago

Plain Schwarz
Prashanth Babu – Simplifying upserts and deletes on Delta Lake tables

Data Engineers face many challenges with Data Lakes. GDPR requests, data quality issues, handling large metadata, merges ...

31:14
Prashanth Babu – Simplifying upserts and deletes on Delta Lake tables

182 views

4 years ago

SS UNITECH
7. how to define the schema in pyspark | structtype & structfield in pyspark | Pyspark tutorial

In this video, I discussed about how to define the schema and how to create dataframe in pyspark. 1. How to define the schema in ...

7:55
7. how to define the schema in pyspark | structtype & structfield in pyspark | Pyspark tutorial

2,617 views

2 years ago

BigDatapediaAI
Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Demo

Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Example Discussion Forum ...

54:37
Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Demo

1,409 views

4 years ago