Uber Data Analytics | Modern Data Engineering GCP Project

Introduction

• The goal of this project is to perform data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.

Project requisites

• MAGE: open-source data pipeline tool for transforming and integrating data from multiple sources. it is similar to airflow but with more features and a better UI. https://docs.mage.ai/introduction/overview

Project architecture

Run this command on the console of your GCP VM (ssh)

mage start <your-project-name>

Data Model