Source description
About the role
As a Data Engineer at our company, you will be responsible for leading the design, development, and optimization of ETL/ELT pipelines and workflows. You will play a crucial role in API design and development, including RESTful services for first-party and third-party consumers. Your focus will be on developing Java Spring Boot-based microservices with a strong emphasis on scalability, reliability, and performance. Additionally, you will be writing, tuning, and optimizing advanced SQL queries for large-scale data processing. Building and maintaining data warehouses and data models will also be part of your responsibilities. Key Responsibilities: - Lead the design, development, and optimization of ETL/ELT pipelines and workflows - Lead and contribute to API design and development, including RESTful services - Design, develop, and maintain Java Spring Boot-based microservices with scalability and reliability in mind - Write, tune, and optimize advanced SQL queries - Build and maintain data warehouses and data models - Develop full-stack applications for on-premises and cloud-based applications - Translate business requirements into robust and reusable data solutions - Implement and maintain unit tests, integration tests, and validation frameworks - Document workflows and design decisions - Apply coding standards, CI/CD practices, and peer code reviews - Monitor, optimize, and troubleshoot pipelines for performance and scalability - Support deployments and post-production monitoring - Mentor associate engineers Qualifications Required: - Bachelor's degree in computer science, Information Systems, Engineering, or a related field - 5+ years of experience in Data Engineering - 3+ years of experience with Snowflake or any cloud Data warehouse - 2+ years of experience with RESTful APIs, Java Springboot, and API Integration - 1+ years of experience with Python Additional Details: The company values strong communication and stakeholder management skills, along with the ability to lead and mentor teams while managing multiple priorities effectively. Additionally, hands-on experience with DBT (Data Build Tool), familiarity with DevOps and CI/CD best practices, exposure to real-time/streaming platforms, and understanding of the e-commerce domain are preferred qualifications. This job will provide you with the opportunity to work on cutting-edge technologies and be a part of a dynamic and innovative team that is committed to delivering high-quality solutions to meet business needs. As a Data Engineer at our company, you will be responsible for leading the design, development, and optimization of ETL/ELT pipelines and workflows. You will play a crucial role in API design and development, including RESTful services for first-party and third-party consumers. Your focus will be on developing Java Spring Boot-based microservices with a strong emphasis on scalability, reliability, and performance. Additionally, you will be writing, tuning, and optimizing advanced SQL queries for large-scale data processing. Building and maintaining data warehouses and data models will also be part of your responsibilities. Key Responsibilities: - Lead the design, development, and optimization of ETL/ELT pipelines and workflows - Lead and contribute to API design and development, including RESTful services - Design, develop, and maintain Java Spring Boot-based microservices with scalability and reliability in mind - Write, tune, and optimize advanced SQL queries - Build and maintain data warehouses and data models - Develop full-stack applications for on-premises and cloud-based applications - Translate business requirements into robust and reusable data solutions - Implement and maintain unit tests, integration tests, and validation frameworks - Document workflows and design decisions - Apply coding standards, CI/CD practices, and peer code reviews - Monitor, optimize, and troubleshoot pipelines for performance and scalability - Support deployments and post-production monitoring - Mentor associate engineers Qualifications Required: - Bachelor's degree in computer science, Information Systems, Engineering, or a related field - 5+ years of experience in Data Engineering - 3+ years of experience with Snowflake or any cloud Data warehouse - 2+ years of experience with RESTful APIs, Java Springboot, and API Integration - 1+ years of experience with Python Additional Details: The company values strong communication and stakeholder management skills, along with the ability to lead and mentor teams while managing multiple priorities effectively. Additionally, hands-on experience with DBT (Data Build Tool), familiarity with DevOps and CI/CD best practices, exposure to real-time/streaming platforms, and understanding of the e-commerce domain are preferred qualifications. This job will provide you with the opportunity to work on cutting-edge technologies and be a part of a dynamic and innovative team that is committed to delivering high-quality so
More at Sampoorna Consultants