📄️ Hybrid Cloud?
Hybrid Cloud is the name given to an architecture pattern where a business uses a mix of on-premises resources (i.e. private cloud) and public cloud resources.
📄️ Setting Up Our Data in the Public Cloud with Amazon S3
I designed this workshop to run properly in the AWS us-east-2 and GCP us-central1 regions. You are free to choose a different region, but you may need to do some alterations to my documented steps to complete the labs.
📄️ Examining our Data Pipeline
Our python data pipeline to process our CSV file can be found on GitHub.
📄️ Run our Data Pipeline
What do we have to do before we run our python script?1. Verify our cloud credentials are set2. Install the required python packages (possibly with a virtualenv)3. Set the required environment variable SOURCE_PATH; optionally with a .env file
📄️ Docker Overview
What is Docker?
📄️ Packaging Your Pipeline with Docker
The Container Image Blueprint
📄️ Run your Docker Container
What was the result? Do we need to change anything?