Lead Data Engineer

Job Description Two Circles Lead Data Engineer What you will do We're looking for a talented Data Engineer to join our squad of >100 Data BI Engineers, working on our Audience Intelligence Platform. You will be helping to build the leading data management and analytics platform for the sports industry. In this role, youll work with cutting-edge technologies to design, build, and optimize scalable data solutions, enabling teams, leagues, and organizations to unlock the full potential of their data. If youre passionate about data engineering, enjoy collaborating in a fast-paced environment, and want to make an impact in the sports industry, we d love to hear from you! Your role will be varied and evolve as quickly as you can learn and develop. Your initial duties will involve: Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python. Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines. Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value. Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards. Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation. Requirements You will have experience with the following: Experience in designing, building, and testing solutions within a data lakehouse environment. Proficiency in Python and PySpark for data processing and analytics. Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps. Familiarity with CI/CD pipelines using Azure DevOps or similar tools. Ability to work within established development frameworks and adhere to coding standards. Excellent communication skills, with an ability to articulate blockers and timelines to non-technical stakeholders. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.