Source description
About the role
A BE in Computer Science or equivalent with 6+ years of professional experience as a Data Engineer or in a similar role Experience building scalable data pipelines in Spark using Airflow scheduler/executor framework or similar scheduling tools. Experience with Databricks and its APIs. Experience with modern databases (Redshift, Dynamo DB, Mongo DB, Postgres or similar) and data lakes. Proficient in one or more programming languages such as Python/Scala and rock-solid SQL skills. Champion automated builds and deployments using CICD tools like Bitbucket, Git Experience working with large-scale, high-performance data processing systems (batch and streaming) Experience working for SAAS companies Experience with Machine Learning Committed code to open source projects Experience building self-service tooling and platforms In this role, you will: Partner across engineering organizations to spearhead and execute high-impact, company-wide initiatives, Mentor and upskill junior engineers, fostering a culture of technical excellence and continuous growth. Collaborate with leadership, product engineers, program managers, and data scientists to deeply understand and prioritize business data requirements. Leverage deep technical expertise to design and architect scalable, high-performance data solutions. Develop, launch, and optimize highly efficient, reliable ELT/ETL pipelines capable of processing both large-scale and specialized datasets. Intelligently design robust data models optimized for high-speed storage, accessibility, and downstream retrieval. Implement and deploy rigorous data quality frameworks to guarantee data accuracy, freshness, and trust. Maintain full technical ownership of the end-to-end data engineering lifecycle for your teams solutions. Participate in the team s on-call rotation to ensure platform stability and support operational health. Partner with software engineering teams to design and build next-generation data systems that enable rapid, self-service data consumption. Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
More at Atlassian