Lead Data Engineer

Roles and Responsibility Two Circles Lead Data Engineer We are Two Circles. We are a Sports & Entertainment Marketing business. We grow audiences and revenues. We do that by knowing fans best. We work with clients to help them understand & influence what their fans are doing the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. What you will do Were looking for a talented Data Engineer to join our squad of >100 Data & BI Engineers, working on our Audience Intelligence Platform. You will be helping to build the leading data management and analytics platform for the sports industry. In this role, youll work with cutting-edge technologies to design, build, and optimize scalable data solutions, enabling teams, leagues, and organizations to unlock the full potential of their data. Your role will be varied and evolve as quickly as you can learn and develop. Your initial duties will involve: Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python. Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines. Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value. Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards. Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation. Requirements You will have experience with the following: Experience in designing, building, and testing solutions within a data lakehouse environment. Proficiency in Python and PySpark for data processing and analytics. Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps. Familiarity with CI/CD pipelines using Azure DevOps or similar tools. Ability to work within established development frameworks and adhere to coding standards. Excellent communication skills, with an ability to articulate blockers and timelines to non-technical stakeholders. While the above skills are important to this role, we believe that attitude and ability to learn new skills are the most important factors for success in this team. If you are missing some of the experience listed above but this sounds like you, we d love to hear from you. Strong teamwork skills, with a collaborative mindset and desire to learn from others. Strong SQL skills for querying and managing data.