Source description
About the role
Technical Skills:-
- Core Data Engineering Skills
Big Data Technologies: Proficiency in using GCP's big data tools like:
BigQuery: For data warehousing and SQL analytics.
Dataproc: For running Spark and Hadoop clusters.
Airflow: For pipeline Orchestration
Dataflow: For stream and batch data processing.(High level Idea)
Pub/Sub: For real-time messaging and event ingestion.(High level Idea)
Data Modeling: Experience/Knowledge on designing scalable, efficient data models for OLAP and OLTP use cases.
ETL/ELT Pipelines:
Expertise in building automated, scalable, and reliable pipelines using custom Python/Scala solutions or Cloud Data Fusion
More at EXL