Padmi

AWS / GCP Data Engineer

MumbaiPosted 2 months ago
Infrastructure And DatabasesMid-levelFull Time; Regular
Apply at Ishan Technologies

Opens the source posting on shine.com

Source description

About the role

View original

Role Overview: You will be responsible for designing, building, and managing large-scale data pipelines and cloud-based data infrastructure. Your expertise in Google Cloud Platform (GCP) will be crucial in integrating data from web and mobile applications, including systems based on React and Firebase services. Collaborating closely with developers, data scientists, and product teams, you will ensure the reliability, scalability, and efficiency of data pipelines to deliver high-quality, actionable data solutions. Key Responsibilities: - Design, build, and maintain scalable and efficient data pipelines for processing large datasets from web and mobile applications. - Implement ETL processes to integrate data from various sources, including Firebase (Firestore, Firebase Analytics). - Optimize data workflows in cloud environments for improved performance, reliability, and cost-efficiency. - Develop and manage data storage solutions (databases, data warehouses, data lakes) to support backend and analytical needs. - Configure and maintain cloud-based data infrastructure to ensure scalability, security, and high availability. - Build and maintain APIs and data access layers for seamless integration with React-based and cloud-native applications. - Consolidate data from different sources for analytics and product functionalities, ensuring data consistency and integrity. - Implement data quality checks, monitor pipeline performance, and troubleshoot data latency using cloud monitoring tools. - Maintain documentation, metadata, and data lineage for compliance and traceability. Qualifications Required: - Minimum 4 years of professional experience in Data Engineering. - Hands-on experience with at least one public cloud platform, preferably Google Cloud Platform (GCP), AWS, or Azure. - Strong knowledge of ETL development, SQL/NoSQL databases, data modeling, and pipeline orchestration. - Experience with Firebase, Firestore, and React-based data integrations is a strong plus. - Proficiency in Python, SQL, and cloud-native data tools like Dataflow, BigQuery, and Airflow. - GCP certification (Data Engineer or Architect) is desired. - Experience with real-time data streaming and strong analytical and problem-solving skills with a focus on performance optimization. Role Overview: You will be responsible for designing, building, and managing large-scale data pipelines and cloud-based data infrastructure. Your expertise in Google Cloud Platform (GCP) will be crucial in integrating data from web and mobile applications, including systems based on React and Firebase services. Collaborating closely with developers, data scientists, and product teams, you will ensure the reliability, scalability, and efficiency of data pipelines to deliver high-quality, actionable data solutions. Key Responsibilities: - Design, build, and maintain scalable and efficient data pipelines for processing large datasets from web and mobile applications. - Implement ETL processes to integrate data from various sources, including Firebase (Firestore, Firebase Analytics). - Optimize data workflows in cloud environments for improved performance, reliability, and cost-efficiency. - Develop and manage data storage solutions (databases, data warehouses, data lakes) to support backend and analytical needs. - Configure and maintain cloud-based data infrastructure to ensure scalability, security, and high availability. - Build and maintain APIs and data access layers for seamless integration with React-based and cloud-native applications. - Consolidate data from different sources for analytics and product functionalities, ensuring data consistency and integrity. - Implement data quality checks, monitor pipeline performance, and troubleshoot data latency using cloud monitoring tools. - Maintain documentation, metadata, and data lineage for compliance and traceability. Qualifications Required: - Minimum 4 years of professional experience in Data Engineering. - Hands-on experience with at least one public cloud platform, preferably Google Cloud Platform (GCP), AWS, or Azure. - Strong knowledge of ETL development, SQL/NoSQL databases, data modeling, and pipeline orchestration. - Experience with Firebase, Firestore, and React-based data integrations is a strong plus. - Proficiency in Python, SQL, and cloud-native data tools like Dataflow, BigQuery, and Airflow. - GCP certification (Data Engineer or Architect) is desired. - Experience with real-time data streaming and strong analytical and problem-solving skills with a focus on performance optimization.

One address, no account. We’ll tell you when matching roles go live.

More at Ishan Technologies

Related open roles

View all roles