Data Engineer

Role Overview: You will be responsible for implementing and delivering data solutions and pipelines on the AWS Cloud Platform. Your role will involve designing, implementing, and maintaining the data architecture for all AWS data services. You will work closely with stakeholders to identify business needs and requirements for data-related projects. Additionally, you will collaborate with software engineers to design and implement data-driven features while ensuring data security measures are in place. Key Responsibilities: - Utilize your strong understanding of data modelling, data structures, databases (Redshift), and ETL processes to optimize data models for performance and efficiency. - Create data models that can extract information from various sources and store it in a usable format. - Write SQL queries to support data analysis and reporting. - Monitor and troubleshoot data pipelines, performing root cause analysis on data issues. - Maintain documentation of the data architecture and ETL processes. - Identify opportunities to improve performance by enhancing database structure or indexing methods. - Maintain and update existing applications to meet new requirements. - Recommend infrastructure changes to enhance capacity or performance. Qualifications Required: - 5-8 years of experience in Data Engineering, Integration Engineering, or Support Specialist roles. - Proficiency in SQL and Python/PySpark. - Experience with AWS Services such as Glue, Appflow, and Redshift. - Strong knowledge of data warehousing and data modelling. - Experience in the Process industry is preferred. Role Overview: You will be responsible for implementing and delivering data solutions and pipelines on the AWS Cloud Platform. Your role will involve designing, implementing, and maintaining the data architecture for all AWS data services. You will work closely with stakeholders to identify business needs and requirements for data-related projects. Additionally, you will collaborate with software engineers to design and implement data-driven features while ensuring data security measures are in place. Key Responsibilities: - Utilize your strong understanding of data modelling, data structures, databases (Redshift), and ETL processes to optimize data models for performance and efficiency. - Create data models that can extract information from various sources and store it in a usable format. - Write SQL queries to support data analysis and reporting. - Monitor and troubleshoot data pipelines, performing root cause analysis on data issues. - Maintain documentation of the data architecture and ETL processes. - Identify opportunities to improve performance by enhancing database structure or indexing methods. - Maintain and update existing applications to meet new requirements. - Recommend infrastructure changes to enhance capacity or performance. Qualifications Required: - 5-8 years of experience in Data Engineering, Integration Engineering, or Support Specialist roles. - Proficiency in SQL and Python/PySpark. - Experience with AWS Services such as Glue, Appflow, and Redshift. - Strong knowledge of data warehousing and data modelling. - Experience in the Process industry is preferred.