What You Will Learn!
- Data engineering concepts and AWS services
- Fetching data from external Rest Api
- Fetching data from SFTP server
- Ingesting data into a Database
- Creating Serverless Data Lake using S3 and Athena
- Creating Glue ETL jobs and Workflows
- Transforming data into Parquet format
- Learn how to store data in S3 Data lakes using Parquet columnar file formats
Description
A hands on course that covers majority of the typical data engineering / ETL scenarios.
In this course you will learn:
Different services and concepts of AWS data engineering
Creating serverless data lake using S3, Glue and Athena
Ingesting data using Rest Api
Ingesting data using Sftp server
Ingesting data into Database (AWS RDS - Postgre SQL)
Incremental data loading
Prerequisites:
An active AWS account
Python / SQL knowledge
Who Should Attend!
- Beginner python developers curious for data science
- Data engineers
- BI/ ETL Developers
- Data Scientists / Analysts
- Anyone from technical background who wants to learn Data engineering in AWS
- Software developers who want to learn different ways to ingest data into AWS and build a datawarehouse
Tags
- Amazon AWS
- AWS Glue
- Data Engineering
Subscribers
301
Lectures
14
TAKE THIS COURSE
