| 001. Introduction to Metadata-Driven Ingestion.mp4 | 13.6 MB | ||
| 001. Introduction to the Course.mp4 | 24.3 MB | ||
| 001. Introduction.mp4 | 28.6 MB | ||
| 002. High-Level Plan.mp4 | 33 MB | ||
| 002. Introduction to ADF (Azure Data Factory).mp4 | 22.7 MB | ||
| 002. Read from Azure Storage Plan.mp4 | 13.3 MB | ||
| 003. Create Active Directory User.mp4 | 9.2 MB | ||
| 003. Create Finance Container and Upload Files.mp4 | 10.1 MB | ||
| 003. Requirements Discussion and Technical Architecture.mp4 | 8.3 MB | ||
| 004. Assign the Contributor Role to the User.mp4 | 18.2 MB | ||
| 004. Create Source Dataset.mp4 | 18.6 MB | ||
| 004. Register a Free Azure Account.mp4 | 20.5 MB | ||
| 005. Create a Data Factory Resource.mp4 | 30 MB | ||
| 005. Disable Security Defaults.mp4 | 8.7 MB | ||
| 005. Write to Data Lake - Raw Plan.mp4 | 23.3 MB | ||
| 006. Create Finance Container and Directories.mp4 | 8.6 MB | ||
| 006. Create a Storage Account and Upload Data.mp4 | 27.3 MB | ||
| 006. Creating the Metadata Database.mp4 | 35.3 MB | ||
| 007. Create Data Lake Gen 2 Storage Account.mp4 | 21.9 MB | ||
| 007. Create Sink Dataset.mp4 | 15.1 MB | ||
| 007. Install Azure Data Studio.mp4 | 24.4 MB | ||
| 008. Create Metadata Tables and Stored Procedures.mp4 | 37.8 MB | ||
| 008. Data Factory Pipeline Plan.mp4 | 16 MB | ||
| 008. Download Storage Explorer.mp4 | 16.9 MB | ||
| 009. Create Data Factory and Read Metadata.mp4 | 23.5 MB | ||
| 009. Create Your First Azure Pipeline.mp4 | 60.9 MB | ||
| 009. Reconfigure Existing Data Factory Artifacts.mp4 | 28.9 MB | ||
| 010. Add Filter by CSV.mp4 | 22 MB | ||
| 010. Closing Remarks.mp4 | 31.5 MB | ||
| 010. Set Up Logic App to Handle Email Notifications.mp4 | 35.5 MB | ||
| 011. Add Dataset to Read Files.mp4 | 12.4 MB | ||
| 011. Modify the Data Factory Pipeline to Send an Email Notification.mp4 | 46.1 MB | ||
| 012. Add the For Each CSV File Activity and Test Ingestion.mp4 | 36.3 MB | ||
| 012. Create Linked Service for Metadata Database and Email Dataset.mp4 | 17.4 MB | ||
| 013. Adding the Event-Based Trigger Plan.mp4 | 12.4 MB | ||
| 013. Create Utility Pipeline to Send Email Notifications.mp4 | 68.9 MB | ||
| 014. Enable the Event Grid Provider.mp4 | 8.8 MB | ||
| 014. Explaining the Email Recipients Table.mp4 | 27.5 MB | ||
| 015. Delete File and Add Event-Based Trigger.mp4 | 6.8 MB | ||
| 015. Explaining the Get Email Addresses Stored Procedure.mp4 | 13.9 MB | ||
| 016. Create Event-Based Trigger.mp4 | 14.4 MB | ||
| 016. Modify Ingestion Pipeline to Use the Email Utility Pipeline.mp4 | 20.8 MB | ||
| 017. Publish Code to Main Branch and Start Trigger.mp4 | 13.9 MB | ||
| 017. Tracking the Triggered Pipeline.mp4 | 67.1 MB | ||
| 018. Making the Email Notifications Dynamic.mp4 | 73.6 MB | ||
| 018. Trigger Event-Based Ingestion.mp4 | 15 MB | ||
| 019. Closing Remarks.mp4 | 21.4 MB | ||
| 019. Making Logging of Pipeline Information Dynamic.mp4 | 47.8 MB | ||
| 020. Add a New Way to Log the Main Ingestion Pipeline.mp4 | 64.7 MB | ||
| 021. Change the Logging of Pipelines to Send Fail Message Only.mp4 | 34.1 MB | ||
| 022. Creating Dynamic Datasets.mp4 | 39 MB | ||
| 023. Reading from Source to Target - Part 1.mp4 | 33.7 MB | ||
| 024. Reading from Source to Target - Part 2.mp4 | 52.8 MB | ||
| 025. Explaining the Source to Target Stored Procedure.mp4 | 18.9 MB | ||
| 026. Add Orchestration Pipeline - Part 1.mp4 | 31.3 MB | ||
| 027. Add Orchestration Pipeline - Part 2.mp4 | 39.2 MB | ||
| 028. Fixing the Duplicating Batch Ingestions.mp4 | 44.2 MB | ||
| 029. Understanding the Pipeline Log and Related Tables.mp4 | 50.1 MB | ||
| 030. Understanding the GetBatch Stored Procedure.mp4 | 25.9 MB | ||
| 031. Understanding the Set Batch Status and GetRunID.mp4 | 18 MB | ||
| 032. Setting Up an Azure DevOps Git Repository.mp4 | 22.5 MB | ||
| 033. Publishing the Data Factory to Azure DevOps.mp4 | 35 MB | ||
| 034. Closing Remarks.mp4 | 17.6 MB | ||
| 1. Get Free Premium Accounts Daily On Our Discord Server!.txt | 1.3 KB | ||
| 2. OneHack.us Premium Cracked Accounts-Tutorials-Guides-Articles Community Based Forum.url | 409.6 B | ||
| 3. FTUApps.com Download Cracked Developers Applications For Free.url | 204.8 B | ||
| 4. FreeCoursesOnline.me Download Udacity, Masterclass, Lynda, PHLearn, etc Free.url | 307.2 B | ||
| ▲ 67 total files | |||
Lynda and other Courses >>> https://freecoursesonline.me/
Forum for discussion >>> https://onehack.us/
PacktPub - Azure Data Factory for Beginners - Build Data Ingestion [Video] [FCO]
Video Details
ISBN 9781804610329
Course Length 6 hours 29 minutes
About
Building frameworks is now an industry norm and it has become an important skill to know how to visualize, design, plan, and implement data frameworks. The framework that we are going to build together is the Metadata-Driven Ingestion Framework. Metadata-driven frameworks allow a company to develop the system just once and it can be adopted and reused by various business clusters without the need for additional development, thus saving the business time and costs. Think of it as a plug-and-play system.
The first objective of the course is to onboard you onto the Azure Data Factory platform to help you assemble your first Azure Data Factory pipeline. Once you get a good grip on the Azure Data Factory development pattern, then it becomes easier to adopt the same pattern to onboard other sources and data sinks.
Once you are comfortable with building a basic Azure Data Factory pipeline, as a second objective, we then move on to building a fully-fledged and working metadata-driven framework to make the ingestion more dynamic; furthermore, we will build the framework in such a way that you can audit every batch orchestration and individual pipeline runs for business intelligence and operational monitoring.
By the end of this course, you will be able to design, implement, and get production-ready for data ingestion in Azure.
All the resource files are added to the GitHub repository at: https://github.com/PacktPublishing/Azure-Data-Factory-for-Beginners---Build-Data-Ingestion
Author
David Mngadi,
David Mngadi is a data management professional who is influenced by the power of data in our lives and has helped several companies become more data-driven to gain a competitive edge as well as meet the regulatory requirements. In the last 15 years, he has had the pleasure of designing and implementing data warehousing solutions in retail, telco, and banking industries, and recently in more big data lake-specific implementations. He is passionate about technology and teaching programming online.
General Info:
Author
: David Mngadi
Language
: English
Released
: June 2022
Course Source
: https://www.packtpub.com/product/azure-data-factory-for-beginners-build-data-ingestion-video/9781804610329
| torrent name | size | uploader | age | seed | leech |
|---|---|---|---|---|---|
|
PacktPub | Learning Azure Process Automation Using PowerShell [Video] [FCO] Posted by
SunRiseZone in Other
|
3 GB | SunRiseZone | 4 years | 0 | 0 |
| 842.7 MB | SunRiseZone | 5 years | 0 | 0 | |
| 447.2 MB | SunRiseZone | 7 years | 6 | 4 |
All Comments