Data Engineer - Lead

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services. Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Working with Us At Iris, every role is more than a job — it's a launchpad for growth. Our Employee Value Proposition, Build Your Future. Own Your Journey. reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it. We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally. Curious what it's like to work at Iris Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here. Job Description Mandatory Skills Databricks Apache Spark Python and SQL 8+ years strong hands-on experience with: Experience building scalable ETL/ELT data ingestion, Transformation and curation pipelines Strong understanding of Delta Lake (ACID, schema evolution, versioning) Experience with Lakehouse architecture (ingestion + curated layers) Ability to implement source-to-target mappings and physical schemas Experience implementing data quality, validation, and monitoring frameworks Strong understanding of distributed data processing Experience with CI/CD, Git, and pipeline automation Strong banking/financial services domain experience Ability to deliver production-grade, scalable data products end-to-end Experience working in Agile, cross-functional teams Great interpersonal and communication skills Can work independently with minimum supervision Flexible and adaptable working style to work with multiple stakeholders Open to work in UK Shift (10 AM to 9 PM IST with 8 hours of productive work) Good to Have Skills Exposure to Snowflake (hybrid environments) Knowledge of Scala Experience with data governance and catalog tools Exposure to workflow orchestration tools (Airflow, etc.) Experience in regulated environments Familiarity with financial domains (Payments, FX, Accounts) Experience in data product-oriented delivery approaches AI-assisted data product development experience Mandatory Competencies Data & AI - Data Engineering - Data Quality & Validation Big Data - Big Data - Pyspark Data & AI - MLOPS - Python Database - Database Programming - SQL Data & AI - Data Engineering - Apache Kafka Beh - Communication and collaboration Perks And Benefits For Irisians Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.