Padmi

Lead Data Engineer (Ahmedabad)

IndiaPosted 1 month ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at Azilen Technologies Pvt. Ltd.

Opens the source posting on shine.com

Source description

About the role

View original

Job Purpose: Design, build, and optimize scalable data engineering solutions that enable reliable, high-performance data platforms. Lead the development of modern data pipelines, cloud-native architectures, and data infrastructure while collaborating with cross-functional teams to deliver robust, client-focused data solutions. Who You Are: - 8+ years of experience in Data Engineering, with at least 2+ years in a Technical Lead or supervisory role - Prior experience working in software services, IT consulting, or agency environments, managing multiple client engagements - Strong proficiency in Python, SQL, and PySpark or Scala for large-scale data processing - Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and its data ecosystem (e.g., AWS Glue, Redshift, EMR, Azure Data Factory, Synapse, GCP BigQuery) - Advanced experience working with contemporary data platforms such as Snowflake, Databricks, or Delta Lake - Strong expertise in designing and building scalable ETL/ELT pipelines and data transformation workflows - Experience with workflow orchestration tools such as Apache Airflow, dbt, or Prefect - Hands-on experience with real-time data streaming technologies like Apache Kafka or Spark Streaming - Good understanding of software engineering best practices, version control, testing, and CI/CD processes - Excellent communication and stakeholder management skills with the ability to lead technical discussions and mentor engineering teams What Will Excite Us: - Experience designing enterprise-scale data platforms and modern cloud data architectures - Strong expertise in Databricks, Snowflake, or Delta Lake implementations - Experience building real-time data pipelines using Kafka, Spark Streaming, or similar technologies - Hands-on experience with DevOps and Infrastructure-as-Code tools such as Docker, Kubernetes, Terraform, GitHub Actions, Azure DevOps, or Jenkins - Experience optimizing data pipeline performance, scalability, reliability, and cost efficiency - Strong understanding of data governance, data quality, security, and performance optimization - Experience leading technical teams, conducting code reviews, and mentoring data engineers - Exposure to modern DataOps practices and automation frameworks - Ability to work across multiple client projects while ensuring high-quality delivery What Will Excite You: - Opportunity to architect and build large-scale cloud-native data platforms for global clients - Work with modern technologies including Databricks, Snowflake, Kafka, Airflow, and leading cloud ecosystems - Lead technical initiatives while mentoring and growing high-performing engineering teams - Solve complex data engineering challenges involving large-scale data processing and real-time analytics - Collaborate with cross-functional teams in a fast-paced, innovation-driven environment - Competitive compensation, continuous learning opportunities, and significant career growth Location: Ahmedabad (Work From Office) .

One address, no account. We’ll tell you when matching roles go live.

More at Azilen Technologies Pvt. Ltd.

Related open roles

View all roles