AWS Data Engineer

As a Data Engineer (AWS) in our company, your role will involve Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, preferably on AWS. You will be responsible for ingesting batch and streaming data from various data sources. Additionally, you will be writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.) and developing ETL, OLAP based, and Analytical Applications. Your ability to quickly learn and develop expertise in existing highly complex applications and architectures will be crucial. Moreover, you should be comfortable working in Agile projects. Your Desirable skills should include Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.), Knowledge of DevOps and CD/CD tools, Experience in handling unstructured data, and Knowledge of the Financial Markets domain. Please note that this position requires the following qualifications: - Experience in Developing Data Pipelines using Python, PySpark, Pandas etc, preferably on AWS - Experience in ingesting batch and streaming data from various sources - Proficiency in writing complex SQL using any RDBMS - Experience in developing ETL, OLAP based, and Analytical Applications - Ability to quickly learn and develop expertise in existing highly complex applications and architectures - Comfortable working in Agile projects Keywords: Data Engineer, Data Pipelines, Data Ingestion, AWS Lambda, AWS Athena Please refer to (ref:hirist.tech) for more information about our company. As a Data Engineer (AWS) in our company, your role will involve Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, preferably on AWS. You will be responsible for ingesting batch and streaming data from various data sources. Additionally, you will be writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.) and developing ETL, OLAP based, and Analytical Applications. Your ability to quickly learn and develop expertise in existing highly complex applications and architectures will be crucial. Moreover, you should be comfortable working in Agile projects. Your Desirable skills should include Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.), Knowledge of DevOps and CD/CD tools, Experience in handling unstructured data, and Knowledge of the Financial Markets domain. Please note that this position requires the following qualifications: - Experience in Developing Data Pipelines using Python, PySpark, Pandas etc, preferably on AWS - Experience in ingesting batch and streaming data from various sources - Proficiency in writing complex SQL using any RDBMS - Experience in developing ETL, OLAP based, and Analytical Applications - Ability to quickly learn and develop expertise in existing highly complex applications and architectures - Comfortable working in Agile projects Keywords: Data Engineer, Data Pipelines, Data Ingestion, AWS Lambda, AWS Athena Please refer to (ref:hirist.tech) for more information about our company.