Source description
About the role
As a Data Platform Engineer at Gen, you will play a crucial role in ensuring the smooth operation and monitoring of our data platforms and pipelines. Your responsibilities will include: - Operating and monitoring data platforms (Azure and on-prem/legacy) to maintain availability, performance, and reliability. - Running and supporting data processing workflows, handling incidents, troubleshooting failed jobs, and coordinating fixes with development teams. - Implementing and enhancing observability (monitoring, alerting, logging, SLAs/SLOs) for data platforms and pipelines. - Driving continuous improvements in data platform operations by automating recurring tasks, reducing manual interventions, and improving deployment practices. - Collaborating with data engineers and product teams to operationalize new data products and integrate them into existing platform standards. - Contributing to operational documentation, runbooks, standards, and best practices, fostering knowledge sharing across the data organization. You are expected to have hands-on experience in data platform operations or a related role, a strong grasp of data processing concepts, and practical experience with Azure data services and traditional ETL tools. Proficiency in SQL, modern version control workflows, and scripting/programming skills (SQL, Python, Bash) for automation and tooling is essential. Additionally, familiarity with modern data stack components like AWS, Snowflake, Git/GitHub, Kubernetes, Kafka, IaaC, and platform automation will be beneficial. If you are a problem-solver with a focus on stability, reliability, and continuous improvement, possess good communication skills, and are willing to work with both technical and non-technical stakeholders, we invite you to be a part of our team at Gen. As a Data Platform Engineer at Gen, you will play a crucial role in ensuring the smooth operation and monitoring of our data platforms and pipelines. Your responsibilities will include: - Operating and monitoring data platforms (Azure and on-prem/legacy) to maintain availability, performance, and reliability. - Running and supporting data processing workflows, handling incidents, troubleshooting failed jobs, and coordinating fixes with development teams. - Implementing and enhancing observability (monitoring, alerting, logging, SLAs/SLOs) for data platforms and pipelines. - Driving continuous improvements in data platform operations by automating recurring tasks, reducing manual interventions, and improving deployment practices. - Collaborating with data engineers and product teams to operationalize new data products and integrate them into existing platform standards. - Contributing to operational documentation, runbooks, standards, and best practices, fostering knowledge sharing across the data organization. You are expected to have hands-on experience in data platform operations or a related role, a strong grasp of data processing concepts, and practical experience with Azure data services and traditional ETL tools. Proficiency in SQL, modern version control workflows, and scripting/programming skills (SQL, Python, Bash) for automation and tooling is essential. Additionally, familiarity with modern data stack components like AWS, Snowflake, Git/GitHub, Kubernetes, Kafka, IaaC, and platform automation will be beneficial. If you are a problem-solver with a focus on stability, reliability, and continuous improvement, possess good communication skills, and are willing to work with both technical and non-technical stakeholders, we invite you to be a part of our team at Gen.
More at Gen