Source description
About the role
Role Overview: You will be responsible for designing, building, and managing large-scale data pipelines and cloud-based data infrastructure. Your expertise in Google Cloud Platform (GCP) will be crucial in integrating data from web and mobile applications, including systems based on React and Firebase services. Collaborating closely with developers, data scientists, and product teams, you will ensure the reliability, scalability, and efficiency of data pipelines to deliver high-quality, actionable data solutions. Key Responsibilities: - Design, build, and maintain scalable and efficient data pipelines for processing large datasets from web and mobile applications. - Implement ETL processes to integrate data from various sources, including Firebase (Firestore, Firebase Analytics). - Optimize data workflows in cloud environments for improved performance, reliability, and cost-efficiency. - Develop and manage data storage solutions (databases, data warehouses, data lakes) to support backend and analytical needs. - Configure and maintain cloud-based data infrastructure to ensure scalability, security, and high availability. - Build and maintain APIs and data access layers for seamless integration with React-based and cloud-native applications. - Consolidate data from different sources for analytics and product functionalities, ensuring data consistency and integrity. - Implement data quality checks, monitor pipeline performance, and troubleshoot data latency using cloud monitoring tools. - Maintain documentation, metadata, and data lineage for compliance and traceability. Qualifications Required: - Minimum 4 years of professional experience in Data Engineering. - Hands-on experience with at least one public cloud platform, preferably Google Cloud Platform (GCP), AWS, or Azure. - Strong knowledge of ETL development, SQL/NoSQL databases, data modeling, and pipeline orchestration. - Experience with Firebase, Firestore, and React-based data integrations is a strong plus. - Proficiency in Python, SQL, and cloud-native data tools like Dataflow, BigQuery, and Airflow. - GCP certification (Data Engineer or Architect) is desired. - Experience with real-time data streaming and strong analytical and problem-solving skills with a focus on performance optimization. Role Overview: You will be responsible for designing, building, and managing large-scale data pipelines and cloud-based data infrastructure. Your expertise in Google Cloud Platform (GCP) will be crucial in integrating data from web and mobile applications, including systems based on React and Firebase services. Collaborating closely with developers, data scientists, and product teams, you will ensure the reliability, scalability, and efficiency of data pipelines to deliver high-quality, actionable data solutions. Key Responsibilities: - Design, build, and maintain scalable and efficient data pipelines for processing large datasets from web and mobile applications. - Implement ETL processes to integrate data from various sources, including Firebase (Firestore, Firebase Analytics). - Optimize data workflows in cloud environments for improved performance, reliability, and cost-efficiency. - Develop and manage data storage solutions (databases, data warehouses, data lakes) to support backend and analytical needs. - Configure and maintain cloud-based data infrastructure to ensure scalability, security, and high availability. - Build and maintain APIs and data access layers for seamless integration with React-based and cloud-native applications. - Consolidate data from different sources for analytics and product functionalities, ensuring data consistency and integrity. - Implement data quality checks, monitor pipeline performance, and troubleshoot data latency using cloud monitoring tools. - Maintain documentation, metadata, and data lineage for compliance and traceability. Qualifications Required: - Minimum 4 years of professional experience in Data Engineering. - Hands-on experience with at least one public cloud platform, preferably Google Cloud Platform (GCP), AWS, or Azure. - Strong knowledge of ETL development, SQL/NoSQL databases, data modeling, and pipeline orchestration. - Experience with Firebase, Firestore, and React-based data integrations is a strong plus. - Proficiency in Python, SQL, and cloud-native data tools like Dataflow, BigQuery, and Airflow. - GCP certification (Data Engineer or Architect) is desired. - Experience with real-time data streaming and strong analytical and problem-solving skills with a focus on performance optimization.
More at Ishan Technologies