![itversity](/img/default-banner.jpg)
- Видео 3 504
- Просмотров 9 696 102
itversity
США
Добавлен 6 мар 2014
🚨 𝗦𝗨𝗕𝗦𝗖𝗥𝗜𝗕𝗘 𝘁𝗼 𝗹𝗲𝗮𝗿𝗻 𝗗𝗔𝗧𝗔 𝗘𝗡𝗚𝗜𝗡𝗘𝗘𝗥𝗜𝗡𝗚 𝗼𝗻 𝗖𝗟𝗢𝗨𝗗 🎯
A free one-stop shop to learn all tips and techniques about all technologies catering to a wide array of IT professionals or aspirants. At this time focused on Data Engineering on the cloud (Azure, AWS, and GCP)
Our Offering:
* Training Services
* Engineering Services
* Managed Services
* Staffing Services
#DataEngineering #CloudComputing #AWS #Azure #GCP #devops
A free one-stop shop to learn all tips and techniques about all technologies catering to a wide array of IT professionals or aspirants. At this time focused on Data Engineering on the cloud (Azure, AWS, and GCP)
Our Offering:
* Training Services
* Engineering Services
* Managed Services
* Staffing Services
#DataEngineering #CloudComputing #AWS #Azure #GCP #devops
Full Course on ELT using DBT and Postgres
Welcome to our comprehensive tutorial series on getting started with DBT using the DBT CLI! Whether you're new to DBT or looking to refine your skills, this series is designed to guide you through every step of the process on both Windows and Mac platforms.
🔍 What You'll Learn:
* Getting Started: Dive into the basics of DBT and how to use the DBT CLI.
* Official Documentation: An overview of where to find and how to use the official DBT documentation.
* Setup Requirements: Learn all prerequisites needed to set up and develop with DBT CLI.
* Python Setup: Instructions on installing Python 3.8 to use with DBT CLI.
* Workspace Preparation: How to set up your workspace for DBT CLI.
* Installation: S...
🔍 What You'll Learn:
* Getting Started: Dive into the basics of DBT and how to use the DBT CLI.
* Official Documentation: An overview of where to find and how to use the official DBT documentation.
* Setup Requirements: Learn all prerequisites needed to set up and develop with DBT CLI.
* Python Setup: Instructions on installing Python 3.8 to use with DBT CLI.
* Workspace Preparation: How to set up your workspace for DBT CLI.
* Installation: S...
Просмотров: 954
Видео
Interpret Explain Plans for Basic SQL Queries
Просмотров 100Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review Data Storage Internals for Tables and Indexes
Просмотров 56Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Generate Explain Plans for SQL Queries
Просмотров 78Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review key terms used in Explain Plans for SQL Queries
Просмотров 40Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review Tables used for Performance Tuning of SQL Queries
Просмотров 38Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Introduction to Performance Tuning of SQL Queries
Просмотров 34Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Interpreting the explain plan for SQL Queries using Indexes
Просмотров 21Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Conclusion of Performance Tuning of SQL Queries
Просмотров 32Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Performance Testing of SQL Queries using Stored Procedure
Просмотров 29Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Guidelines on adding Indexes on Tables for SQL Queries
Просмотров 18Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Add Required Indexes to tune performance of SQL Queries
Просмотров 77Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review the Common Application Scenarios for Performance Tuning
Просмотров 46Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Write SQL Queries for Customer Orders
Просмотров 54Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Different Types of Constraints on Database Tables
Просмотров 2162 месяца назад
In this video you will understand different types of constraints that can be created on the table. Questions: What are the different types of constraints that can be created on Database tables? Do you have experience in creating or using constraints on the tables? Answer: Different types of constraints are Primary Key, Unique, Not Null, Check, etc. The video also covers explanations withe real ...
Getting Started with SQL: Setup Postgres Database and Tables | Step-by-Step Tutorial with Commands
Просмотров 2425 месяцев назад
Getting Started with SQL: Setup Postgres Database and Tables | Step-by-Step Tutorial with Commands
Install and Manage PostgreSQL on Windows or Mac: Using pgAdmin and Task Manager Guide
Просмотров 1995 месяцев назад
Install and Manage PostgreSQL on Windows or Mac: Using pgAdmin and Task Manager Guide
Understanding Databases: A Simple Guide to Different Types and Their Uses
Просмотров 1925 месяцев назад
Understanding Databases: A Simple Guide to Different Types and Their Uses
Spark Architecture Concepts and Performance Tuning using Adaptive Query Execution using Databricks
Просмотров 4,2 тыс.Год назад
Spark Architecture Concepts and Performance Tuning using Adaptive Query Execution using Databricks
Working with Spark SQL Functions using Databricks and Pyspark
Просмотров 2,1 тыс.Год назад
Working with Spark SQL Functions using Databricks and Pyspark
Partitioning Spark Data Frames using Databricks and Pyspark
Просмотров 1,4 тыс.Год назад
Partitioning Spark Data Frames using Databricks and Pyspark
Writing Data from Files into Spark Data Frames using Databricks and Pyspark
Просмотров 1,1 тыс.Год назад
Writing Data from Files into Spark Data Frames using Databricks and Pyspark
Reading Data from Spark Data Frames into Files using Databricks and Pyspark
Просмотров 1,2 тыс.Год назад
Reading Data from Spark Data Frames into Files using Databricks and Pyspark
Manipulating Columns in Spark Data Frames using Databricks and Pyspark
Просмотров 2,1 тыс.Год назад
Manipulating Columns in Spark Data Frames using Databricks and Pyspark
Joining Spark Data Frames using Databricks and Pyspark
Просмотров 1,6 тыс.Год назад
Joining Spark Data Frames using Databricks and Pyspark
Overview of Automation using Python on Linux
Просмотров 2,4 тыс.Год назад
Overview of Automation using Python on Linux
Performing Aggregations on Spark Data Frames using Databricks and Pyspark
Просмотров 1,4 тыс.Год назад
Performing Aggregations on Spark Data Frames using Databricks and Pyspark
Sorting Data in Spark Data Frames using Databricks and Pyspark
Просмотров 1,4 тыс.Год назад
Sorting Data in Spark Data Frames using Databricks and Pyspark
Dropping Columns from Spark Data Frames using Databricks and Pyspark
Просмотров 1 тыс.Год назад
Dropping Columns from Spark Data Frames using Databricks and Pyspark
Filtering Data from Spark Data Frames using Databricks and Pyspark
Просмотров 2,3 тыс.Год назад
Filtering Data from Spark Data Frames using Databricks and Pyspark
Good❤
can you please provide the link for the notes you are referring for?
hey! where can i get this notes ? is it in github ?
Thanks for sharing this. After 8 years and it's still relevant.
in 17th minute count function is referred as wide transformation. why is count wide transformation since we dont need any shuffling of data for counting??
What course is this , and how can I join ? Thanks
Thanks bro. To the point.
Thanks for the setup video, I was able to install PySpark but facing error while running scrypt sc.textFile("C:\\deckofcards.txt").first() Traceback (most recent call last): File "<stdin>", line 1, in <module> File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 2888, in first rs = self.take(1) ^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 2822, in take totalParts = self.getNumPartitions() ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 952, in getNumPartitions return self._jrdd.partitions().size() ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\lib\py4j-0.10.9.7-src.zip\py4j\java_gateway.py", line 1322, in __call__ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark\errors\exceptions\captured.py", line 179, in deco return f(*a, **kw) ^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\lib\py4j-0.10.9.7-src.zip\py4j\protocol.py", line 326, in get_return_value py4j.protocol.Py4JJavaError: An error occurred while calling o38.partitions. : org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/C:/deckofcards.txt
The location for your file C:/deckofcards.txt seems to be incorrect.
Please explain python model using snowspark
Nice 🙂
Please fix the error in the second last video of apache spark virtual environment Playlist.
Plsssss fix the errrroooo @itversity
Still the video error persists can you pls fix this
Okay. We are any way publishing updated content on Spark using Databricks. Stay tuned!!!
@@itversity no I need the details for on prem environment. Kindly please restore this video. Plssss
@@itversity hi can you pls fix this
Even docker got also error on my windows
thank you, it is very helpful!
if i started learning for now than there are very less data engineering internships(if one has data internship it is easy to get a job ,and that person also get hand on experience ) ,,,,so should i do data analyst first only for internship and after that i will study for data engineering for job because it is also a good way , and i need to do an internship because it is in our college criteria , they do not support much if you do not have done internship??
Thank you.....2013 to 2024....Big Data to DBT.... sad but true....
So clever and intelligent of you to use -ltr here
Amazing
could you plz give me link to the zip file?
Hi Sir, Where is the complete video? Link please
This is a trial video. We are planning to publish the series soon. Please subscribe to our channel and stay tuned.
Thank you
For this do we have to set constraint as unique for the column based on which the update happens?
Thank you!!! short and simple, been having trouble installing pyspark for weeks but i finally came in contact with your video and everything just worked fine now....Thank you
I experienced the same aswell
Where are you attempting to setup the environment? GCP?
No Sir, AWS
I can’t seem to find where to download SQL Workbench for PostgreSQL Instance aswell . 😞
Great information
it should be better to delete this presentation from youtube. You wasted my 17 minutes explaning a shit.
Sir if we are using Cluster mode, is not the driver code will run in any of the worker node
That is right.
bro speed running in 2x by default. Loved it
I'm sorry, but you are so hard to understand
Golden. THANK YOU
Why hurry burry man.
🤣
Whats the rush dude ?
Thank you soo soo much 😊
Most waited database course now available. Thanks for the video series of Postgresql
Can you please share the python code link ? Many thanks !