ViewTube

ViewTube
Sign inSign upSubscriptions
Filters

Upload date

Type

Duration

Sort by

Features

Reset

145 results

Alex The Analyst
Intro to Databricks (Free Edition) | UI Walkthrough

Databricks Free Edition allows you to practice and learn to work with big data and AI for Free! It's an amazing platform to use!

10:45
Intro to Databricks (Free Edition) | UI Walkthrough

36,662 views

1 month ago

BigDatapediaAI
How I Automated PySpark with a Single Prompt (MCP Demo) | Future of Data Engineering (PySpark + MCP)

How I Automated PySpark with a Single Prompt (MCP Demo) | Future of Data Engineering (PySpark + MCP) Registration: ...

1:20
How I Automated PySpark with a Single Prompt (MCP Demo) | Future of Data Engineering (PySpark + MCP)

100 views

1 month ago

The Debug Zone
How to Create a Timestamp Column in PySpark: Step-by-Step Guide

In this video, we'll explore the process of creating a timestamp column in PySpark, a powerful tool for big data processing.

1:31
How to Create a Timestamp Column in PySpark: Step-by-Step Guide

0 views

1 month ago

Sharat Manikonda
PySpark with Databricks Bootcamp

Apache Spark Bootcamp with PySpark & Databricks Spark is Super Fast Distributed Computing Framework. Want to Register to ...

0:57
PySpark with Databricks Bootcamp

49 views

6 months ago

The Debug Zone
How to Get DataFrame Info in PySpark: Equivalent to Pandas info()

In this video, we'll explore how to retrieve essential information about DataFrames in PySpark, drawing parallels to the familiar ...

4:47
How to Get DataFrame Info in PySpark: Equivalent to Pandas info()

3 views

11 months ago

The Debug Zone
How to Extract an Element from an Array in PySpark: A Step-by-Step Guide

In this video, we'll dive into the world of PySpark and explore how to efficiently extract elements from an array. Whether you're ...

1:36
How to Extract an Element from an Array in PySpark: A Step-by-Step Guide

2 views

3 months ago

Peter Schneider
Disable PySpark to print info when running

Disable PySpark to print info when running I hope you found a solution that worked for you :) The Content is licensed under ...

4:08
Disable PySpark to print info when running

3 views

11 months ago

The Debug Zone
How to Retrieve Executor ID in PySpark: A Step-by-Step Guide

In this video, we will explore the process of retrieving the Executor ID in PySpark, a crucial aspect for monitoring and optimizing ...

1:53
How to Retrieve Executor ID in PySpark: A Step-by-Step Guide

7 views

7 months ago

The Debug Zone
How to Remove Null Values from a Column in PySpark DataFrame

In this video, we will explore the essential techniques for handling null values in a PySpark DataFrame. Null values can often lead ...

1:37
How to Remove Null Values from a Column in PySpark DataFrame

27 views

7 months ago

The Debug Zone
How to Merge Multiple Columns into One in PySpark DataFrame Using Python

In this video, we will explore the powerful capabilities of PySpark for data manipulation, specifically focusing on how to merge ...

2:18
How to Merge Multiple Columns into One in PySpark DataFrame Using Python

7 views

8 months ago

BigDatapediaAI
PySpark ML in 1 Minute: Linear Regression Made Simple

PySpark ML in 1 Minute: Linear Regression Made Simple.! Ever wondered how to bridge the gap between Pandas-based ML ...

0:54
PySpark ML in 1 Minute: Linear Regression Made Simple

22 views

2 months ago

The Debug Zone
How to Replace Null Values with Arrays in PySpark: A Step-by-Step Guide

In this video, we'll explore a crucial aspect of data processing in PySpark: handling null values. As datasets grow in complexity, ...

1:48
How to Replace Null Values with Arrays in PySpark: A Step-by-Step Guide

0 views

9 months ago

The Debug Zone
How to Perform PCA on Grouped Data with PySpark: Step-by-Step Guide

In this video, we will explore the powerful technique of Principal Component Analysis (PCA) and how to effectively apply it to ...

2:58
How to Perform PCA on Grouped Data with PySpark: Step-by-Step Guide

4 views

3 months ago

The Debug Zone
Python Multiprocessing vs PySpark: Which is Best for Parallel Processing?

In this video, we dive into the world of parallel processing by comparing two powerful tools: Python's multiprocessing module and ...

1:32
Python Multiprocessing vs PySpark: Which is Best for Parallel Processing?

7 views

9 months ago

The Debug Zone
How to Convert PySpark DataFrame Column from List to String: A Step-by-Step Guide

In this video, we will explore a common challenge faced by data engineers and analysts working with PySpark: converting a ...

1:29
How to Convert PySpark DataFrame Column from List to String: A Step-by-Step Guide

4 views

4 months ago

The Debug Zone
How to Calculate Maximum Value Across Columns Per Row in PySpark

In this video, we will explore a powerful technique in PySpark for calculating the maximum value across multiple columns for each ...

1:45
How to Calculate Maximum Value Across Columns Per Row in PySpark

2 views

6 months ago

The Debug Zone
How to Convert Spark DataFrame to JSON Array: Step-by-Step Guide

In this video, we'll explore the process of converting a Spark DataFrame into a JSON array, a crucial skill for data engineers and ...

1:29
How to Convert Spark DataFrame to JSON Array: Step-by-Step Guide

2 views

4 months ago

The Debug Zone
Joining Multiple PySpark DataFrames with Python's reduce() Function

In this video, we delve into the powerful capabilities of PySpark for data manipulation, focusing specifically on how to efficiently ...

2:23
Joining Multiple PySpark DataFrames with Python's reduce() Function

3 views

5 months ago

The Debug Zone
How to Change Column Data Types in PySpark DataFrame: A Step-by-Step Guide

In this video, we will explore the essential process of changing column data types in a PySpark DataFrame. Understanding how to ...

1:57
How to Change Column Data Types in PySpark DataFrame: A Step-by-Step Guide

3 views

2 months ago

BigDatapediaAI
PySpark JOINs using Gemini: Elevate Your Data Engineering using MCP Server

PySpark JOINs using Gemini: Elevate Your Data Engineering using MCP Server Registration: ...

2:20
PySpark JOINs using Gemini: Elevate Your Data Engineering using MCP Server

113 views

1 month ago

The Debug Zone
How to Drop Nested Columns in PySpark DataFrame: A Step-by-Step Guide

In this video, we'll explore the powerful capabilities of PySpark DataFrames, focusing specifically on how to drop nested columns ...

4:17
How to Drop Nested Columns in PySpark DataFrame: A Step-by-Step Guide

1 view

4 months ago

BigDatapediaAI
GenAI for DataEngineers | Free Workshop using WhatsApp & LLM | WhatsApp → AI → Spark → Iceberg Table

GenAI for DataEngineers | Free Workshop using WhatsApp & LLM | WhatsApp → GenAI → Spark → Iceberg Table Workflow: ...

2:17:28
GenAI for DataEngineers | Free Workshop using WhatsApp & LLM | WhatsApp → AI → Spark → Iceberg Table

119 views

1 month ago

The Debug Zone
How to Get Column Data Type in PySpark: A Step-by-Step Guide

In this video, we'll explore the essential techniques for retrieving column data types in PySpark, a powerful tool for big data ...

2:46
How to Get Column Data Type in PySpark: A Step-by-Step Guide

0 views

5 months ago

The Debug Zone
How to Replicate PySpark Logistic Regression Model in Scikit-Learn

In this video, we'll explore the process of replicating a PySpark logistic regression model using Scikit-Learn. As data science ...

1:50
How to Replicate PySpark Logistic Regression Model in Scikit-Learn

3 views

8 months ago

The Debug Zone
How to Replace Column Values in PySpark DataFrame Using a Dictionary

In this video, we will explore a powerful technique for manipulating data in PySpark DataFrames by replacing column values ...

2:05
How to Replace Column Values in PySpark DataFrame Using a Dictionary

4 views

7 months ago