Source description
About the role
Job Description: GCP Data Engineer Experience: 7–10 Years Roles & Responsibilities Design, develop, and implement scalable data processing solutions using Big Data technologies and distributed system s Strong hands-on experience with Python and PySpar k for developing efficient data pipelines and applications Develop and optimize complex SQL querie s, data models, and database solutions Analyze and improve performance of Apache Spark workload s through optimization techniques such as partitioning, caching, tuning, and resource optimization Design and implement various data processing pattern s including Batch Processing, Near Real-Time (NRT), and Real-Time data pipelines Understand business requirements and translate them into scalable data architecture and technical solution s Work with cloud-based data platforms and services, preferably Google Cloud Platform (GCP ) Hands-on experience with GCP managed services such as: Google Cloud Storage, Dataproc, Dataflow, Pub/Sub, Cloud Functions, Cloud Composer, BigQuery, BigTable . Required Skills 7–10 years of experience i n Data Engineering / Big Data Engineering Strong programming experience i n Python, PySpark, SQL Hands-on experience wit h Spark, Hadoop ecosystem, and distributed computing Experience designing scalable data pipelines and cloud-based solution Strong exposure t o GCP data services and cloud architecture Good understanding of data modeling, ETL/ELT, and data integration pattern Experience with performance tuning and optimization of large-scale data processing workloads Good to Have GCP certification(s) Experience in enterprise cloud migration projects Knowledge of DevOps practices and CI/CD automation Experience working in Agile development environments
More at Impetus Capital