itversity
itversity
  • Видео 3 504
  • Просмотров 9 696 102
Full Course on ELT using DBT and Postgres
Welcome to our comprehensive tutorial series on getting started with DBT using the DBT CLI! Whether you're new to DBT or looking to refine your skills, this series is designed to guide you through every step of the process on both Windows and Mac platforms.
🔍 What You'll Learn:
* Getting Started: Dive into the basics of DBT and how to use the DBT CLI.
* Official Documentation: An overview of where to find and how to use the official DBT documentation.
* Setup Requirements: Learn all prerequisites needed to set up and develop with DBT CLI.
* Python Setup: Instructions on installing Python 3.8 to use with DBT CLI.
* Workspace Preparation: How to set up your workspace for DBT CLI.
* Installation: S...
Просмотров: 954

Видео

Interpret Explain Plans for Basic SQL Queries
Просмотров 100Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review Data Storage Internals for Tables and Indexes
Просмотров 56Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Generate Explain Plans for SQL Queries
Просмотров 78Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review key terms used in Explain Plans for SQL Queries
Просмотров 40Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review Tables used for Performance Tuning of SQL Queries
Просмотров 38Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Introduction to Performance Tuning of SQL Queries
Просмотров 34Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Interpreting the explain plan for SQL Queries using Indexes
Просмотров 21Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Conclusion of Performance Tuning of SQL Queries
Просмотров 32Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Performance Testing of SQL Queries using Stored Procedure
Просмотров 29Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Guidelines on adding Indexes on Tables for SQL Queries
Просмотров 18Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Add Required Indexes to tune performance of SQL Queries
Просмотров 77Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Review the Common Application Scenarios for Performance Tuning
Просмотров 46Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Write SQL Queries for Customer Orders
Просмотров 54Месяц назад
Join this channel to get access to perks: ruclips.net/channel/UCakdSIPsJqiOLqylgoYmwQgjoin
Different Types of Constraints on Database Tables
Просмотров 2162 месяца назад
In this video you will understand different types of constraints that can be created on the table. Questions: What are the different types of constraints that can be created on Database tables? Do you have experience in creating or using constraints on the tables? Answer: Different types of constraints are Primary Key, Unique, Not Null, Check, etc. The video also covers explanations withe real ...
Getting Started with SQL: Setup Postgres Database and Tables | Step-by-Step Tutorial with Commands
Просмотров 2425 месяцев назад
Getting Started with SQL: Setup Postgres Database and Tables | Step-by-Step Tutorial with Commands
Install and Manage PostgreSQL on Windows or Mac: Using pgAdmin and Task Manager Guide
Просмотров 1995 месяцев назад
Install and Manage PostgreSQL on Windows or Mac: Using pgAdmin and Task Manager Guide
Understanding Databases: A Simple Guide to Different Types and Their Uses
Просмотров 1925 месяцев назад
Understanding Databases: A Simple Guide to Different Types and Their Uses
Spark Architecture Concepts and Performance Tuning using Adaptive Query Execution using Databricks
Просмотров 4,2 тыс.Год назад
Spark Architecture Concepts and Performance Tuning using Adaptive Query Execution using Databricks
Working with Spark SQL Functions using Databricks and Pyspark
Просмотров 2,1 тыс.Год назад
Working with Spark SQL Functions using Databricks and Pyspark
Partitioning Spark Data Frames using Databricks and Pyspark
Просмотров 1,4 тыс.Год назад
Partitioning Spark Data Frames using Databricks and Pyspark
Writing Data from Files into Spark Data Frames using Databricks and Pyspark
Просмотров 1,1 тыс.Год назад
Writing Data from Files into Spark Data Frames using Databricks and Pyspark
Reading Data from Spark Data Frames into Files using Databricks and Pyspark
Просмотров 1,2 тыс.Год назад
Reading Data from Spark Data Frames into Files using Databricks and Pyspark
Manipulating Columns in Spark Data Frames using Databricks and Pyspark
Просмотров 2,1 тыс.Год назад
Manipulating Columns in Spark Data Frames using Databricks and Pyspark
Joining Spark Data Frames using Databricks and Pyspark
Просмотров 1,6 тыс.Год назад
Joining Spark Data Frames using Databricks and Pyspark
Overview of Automation using Python on Linux
Просмотров 2,4 тыс.Год назад
Overview of Automation using Python on Linux
Performing Aggregations on Spark Data Frames using Databricks and Pyspark
Просмотров 1,4 тыс.Год назад
Performing Aggregations on Spark Data Frames using Databricks and Pyspark
Sorting Data in Spark Data Frames using Databricks and Pyspark
Просмотров 1,4 тыс.Год назад
Sorting Data in Spark Data Frames using Databricks and Pyspark
Dropping Columns from Spark Data Frames using Databricks and Pyspark
Просмотров 1 тыс.Год назад
Dropping Columns from Spark Data Frames using Databricks and Pyspark
Filtering Data from Spark Data Frames using Databricks and Pyspark
Просмотров 2,3 тыс.Год назад
Filtering Data from Spark Data Frames using Databricks and Pyspark

Комментарии

  • @ericksonezekiel4104
    @ericksonezekiel4104 День назад

    Good❤

  • @anvithakommineni8775
    @anvithakommineni8775 6 дней назад

    can you please provide the link for the notes you are referring for?

  • @anvithakommineni8775
    @anvithakommineni8775 6 дней назад

    hey! where can i get this notes ? is it in github ?

  • @Ousgaye
    @Ousgaye 11 дней назад

    Thanks for sharing this. After 8 years and it's still relevant.

  • @saileshrachamadugu1537
    @saileshrachamadugu1537 11 дней назад

    in 17th minute count function is referred as wide transformation. why is count wide transformation since we dont need any shuffling of data for counting??

  • @ajproductions7357
    @ajproductions7357 12 дней назад

    What course is this , and how can I join ? Thanks

  • @ognicklausmickaelson
    @ognicklausmickaelson Месяц назад

    Thanks bro. To the point.

  • @sahilmadaan9532
    @sahilmadaan9532 Месяц назад

    Thanks for the setup video, I was able to install PySpark but facing error while running scrypt sc.textFile("C:\\deckofcards.txt").first() Traceback (most recent call last): File "<stdin>", line 1, in <module> File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 2888, in first rs = self.take(1) ^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 2822, in take totalParts = self.getNumPartitions() ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 952, in getNumPartitions return self._jrdd.partitions().size() ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\lib\py4j-0.10.9.7-src.zip\py4j\java_gateway.py", line 1322, in __call__ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark\errors\exceptions\captured.py", line 179, in deco return f(*a, **kw) ^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\lib\py4j-0.10.9.7-src.zip\py4j\protocol.py", line 326, in get_return_value py4j.protocol.Py4JJavaError: An error occurred while calling o38.partitions. : org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/C:/deckofcards.txt

    • @itversity
      @itversity Месяц назад

      The location for your file C:/deckofcards.txt seems to be incorrect.

  • @bharathirajaraj3582
    @bharathirajaraj3582 Месяц назад

    Please explain python model using snowspark

  • @MohammadShazaib-k6k
    @MohammadShazaib-k6k Месяц назад

    Nice 🙂

  • @jaymakam9673
    @jaymakam9673 Месяц назад

    Please fix the error in the second last video of apache spark virtual environment Playlist.

  • @jaymakam9673
    @jaymakam9673 Месяц назад

    Plsssss fix the errrroooo @itversity

  • @jaymakam9673
    @jaymakam9673 Месяц назад

    Still the video error persists can you pls fix this

    • @itversity
      @itversity Месяц назад

      Okay. We are any way publishing updated content on Spark using Databricks. Stay tuned!!!

    • @jaymakam9673
      @jaymakam9673 Месяц назад

      @@itversity no I need the details for on prem environment. Kindly please restore this video. Plssss

    • @jaymakam9673
      @jaymakam9673 Месяц назад

      @@itversity hi can you pls fix this

  • @romymallari9133
    @romymallari9133 Месяц назад

    Even docker got also error on my windows

  • @anikethdeshpande8336
    @anikethdeshpande8336 Месяц назад

    thank you, it is very helpful!

  • @UjjwalSinghPal-um3pb
    @UjjwalSinghPal-um3pb Месяц назад

    if i started learning for now than there are very less data engineering internships(if one has data internship it is easy to get a job ,and that person also get hand on experience ) ,,,,so should i do data analyst first only for internship and after that i will study for data engineering for job because it is also a good way , and i need to do an internship because it is in our college criteria , they do not support much if you do not have done internship??

  • @hubstrangers3450
    @hubstrangers3450 Месяц назад

    Thank you.....2013 to 2024....Big Data to DBT.... sad but true....

  • @AnushkaaBansal
    @AnushkaaBansal Месяц назад

    So clever and intelligent of you to use -ltr here

  • @AnushkaaBansal
    @AnushkaaBansal Месяц назад

    Amazing

  • @ChineduUdeh-s2w
    @ChineduUdeh-s2w Месяц назад

    could you plz give me link to the zip file?

  • @yashwanth5025
    @yashwanth5025 2 месяца назад

    Hi Sir, Where is the complete video? Link please

    • @itversity
      @itversity 2 месяца назад

      This is a trial video. We are planning to publish the series soon. Please subscribe to our channel and stay tuned.

  • @thespecialjuan9996
    @thespecialjuan9996 2 месяца назад

    Thank you

  • @akshaydushyanth9720
    @akshaydushyanth9720 2 месяца назад

    For this do we have to set constraint as unique for the column based on which the update happens?

  • @louisizuchi1626
    @louisizuchi1626 2 месяца назад

    Thank you!!! short and simple, been having trouble installing pyspark for weeks but i finally came in contact with your video and everything just worked fine now....Thank you

  • @onuorjidoris6396
    @onuorjidoris6396 2 месяца назад

    I experienced the same aswell

    • @itversity
      @itversity 2 месяца назад

      Where are you attempting to setup the environment? GCP?

    • @onuorjidoris6396
      @onuorjidoris6396 2 месяца назад

      No Sir, AWS

    • @onuorjidoris6396
      @onuorjidoris6396 2 месяца назад

      I can’t seem to find where to download SQL Workbench for PostgreSQL Instance aswell . 😞

  • @jesminsubrina4188
    @jesminsubrina4188 3 месяца назад

    Great information

  • @elmaddinhuseynli209
    @elmaddinhuseynli209 3 месяца назад

    it should be better to delete this presentation from youtube. You wasted my 17 minutes explaning a shit.

  • @dailydoseofvideos55
    @dailydoseofvideos55 3 месяца назад

    Sir if we are using Cluster mode, is not the driver code will run in any of the worker node

    • @itversity
      @itversity 3 месяца назад

      That is right.

  • @mutyaluamballa
    @mutyaluamballa 4 месяца назад

    bro speed running in 2x by default. Loved it

  • @joshuahamm8869
    @joshuahamm8869 4 месяца назад

    I'm sorry, but you are so hard to understand

  • @erickhar
    @erickhar 4 месяца назад

    Golden. THANK YOU

  • @raj34567-d
    @raj34567-d 5 месяцев назад

    Why hurry burry man.

  • @luckyvaliin
    @luckyvaliin 5 месяцев назад

    Whats the rush dude ?

  • @Madeeha-bd6pl
    @Madeeha-bd6pl 5 месяцев назад

    Thank you soo soo much 😊

  • @palanmondal980
    @palanmondal980 5 месяцев назад

    Most waited database course now available. Thanks for the video series of Postgresql

  • @bacnguyenkim540
    @bacnguyenkim540 5 месяцев назад

    Can you please share the python code link ? Many thanks !