Lead - Data Engineer

Lead - Data Engineer Location: Noida, UP, India Company: Iris Software Job Description Python: Advanced proficiency PySpark: Production-level experience Big Data Architecture: Solid understanding of big data concepts Advanced SQL: Expert-level SQL proficiency including complex query writing ETL Pipeline Development: Proven experience designing, building, and maintaining robust ETL workflows Nice to have: Snowflake: Hands-on experience with Snowflake architecture, and query optimization Mandatory Competencies Data AI - Data Engineering - Apache Kafka Data AI - Data Engineering - Data Quality Validation Data AI - Data Engineering - Stream Processing Data Science and Machine Learning - Data Science and Machine Learning - Databricks Big Data - Big Data - Pyspark Programming Language - Python - Apache Airflow Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark Data AI - ETL OTHERS - Snowflake Data AI - ETL OTHERS - SQL