Source description
About the role
Design, develop, and implement data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop and maintain large-scale data processing systems using Python and PySpark. Ensure data quality and integrity by implementing robust testing and validation frameworks. Optimize data pipeline performance for scalability, reliability, and cost-effectiveness. Troubleshoot complex technical issues related to data engineering projects. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
More at SSD Shared Services