Source description
About the role
Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team. Requirements 5+ years of experience in data engineering, analytics, or backend development Design, build, and optimize scalable data pipelines and cloud-based data solutions using AWS and Databricks to support advanced analytics and business needs. Develop and refactor reusable data pipelines leveraging AWS and Databricks Design and implement data lakes, data warehouses, ETL processes, and backend services for structured and unstructured data Collaborate with business analysts, data scientists, architects, developers, and stakeholders to deliver fit-for-purpose solutions Optimize data pipelines for performance, scalability, cost efficiency, reliability, and security Implement robust testing and monitoring frameworks Identify and resolve performance bottlenecks, ensuring efficient workload execution Participate in code reviews and maintain high-quality documentation Stay updated with emerging data engineering trends and apply best practices Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field Hands-on experience with AWS Cloud and Databricks Strong proficiency in:, Serverless and orchestration workflows (AWS Lambda, Step Functions), Programming and scripting (Python, Bash, Make), Query languages (SQL, SPARQL) Experience with diverse data models: Relational databases (Amazon Redshift), NoSQL databases (DynamoDB), Object storage (Amazon S3), Graph databases (Amazon Neptune) Experience with version control and CI/CD tools (Git, GitLab preferred) Infrastructure as Code experience, preferably using AWS CDK Strong passion for data engineering and solving real-world problems Customer-focused and value-driven mindset Excellent analytical and problem-solving skills Strong collaboration and communication abilities Familiarity with Agile/Scrum methodologies Proactive approach to continuous improvement and innovation Benefits A challenging, innovating environment. Opportunities for learning where needed.
More at GeekSoft Consulting