Data Engineer

As a Python Data Engineer at HCLTech, you will be responsible for designing, building, and resolving problems across the Apache Airflow data orchestration and movement platform. Your role will involve working with a broad technology stack and utilizing Python-based testing to ensure the quality of data processing tasks including ETL/ELT, SQL, data validation, and transformation. Additionally, your expertise in Financial Service products and processes, as well as Cloud native technologies such as Kubernetes, Docker, REST APIs, S3, and Spark, will be instrumental in contributing to the success of the projects. Key Responsibilities: - Minimum 4 years of Python development experience across a broad technology stack - Experience with Python-based testing - Proven experience in Data processing including ETL/ELT, SQL, data validation, and transformation - Proven experience in designing, building, and resolving problems across the Apache Airflow data orchestration and movement platform - Broad knowledge of Financial Service products and processes - Broad knowledge of Cloud native technologies such as Kubernetes, Docker, REST APIs, S3, and Spark Qualifications Required: - Minimum 4 years of Python development experience - Experience in Data processing and manipulation - Familiarity with Apache Airflow or similar data orchestration tools - Knowledge of Financial Service products and processes - Understanding of Cloud native technologies like Kubernetes, Docker, REST APIs, S3, and Spark As a Python Data Engineer at HCLTech, you will be responsible for designing, building, and resolving problems across the Apache Airflow data orchestration and movement platform. Your role will involve working with a broad technology stack and utilizing Python-based testing to ensure the quality of data processing tasks including ETL/ELT, SQL, data validation, and transformation. Additionally, your expertise in Financial Service products and processes, as well as Cloud native technologies such as Kubernetes, Docker, REST APIs, S3, and Spark, will be instrumental in contributing to the success of the projects. Key Responsibilities: - Minimum 4 years of Python development experience across a broad technology stack - Experience with Python-based testing - Proven experience in Data processing including ETL/ELT, SQL, data validation, and transformation - Proven experience in designing, building, and resolving problems across the Apache Airflow data orchestration and movement platform - Broad knowledge of Financial Service products and processes - Broad knowledge of Cloud native technologies such as Kubernetes, Docker, REST APIs, S3, and Spark Qualifications Required: - Minimum 4 years of Python development experience - Experience in Data processing and manipulation - Familiarity with Apache Airflow or similar data orchestration tools - Knowledge of Financial Service products and processes - Understanding of Cloud native technologies like Kubernetes, Docker, REST APIs, S3, and Spark