Data Engineer

Databricks Module Lead Job Description The individual will be leading the design and implementation of build release and deployment of applications This job will require developing and building platforms and frameworks to allow consistent traceable and automated management of application and infrastructure releases between NonProd and Production environments Will focus on the infrastructure and middleware aspects of the overall solution Skills Experience with CI CD concepts tools and process preferably Jenkins Proficient with Release Management and Application deployment lifecycle and process Mentor and direct others in their technology evaluations designs and implementations Assist internal customer organizations in solving complex issues Analyze and improve stability scalability and the performance Comfortable in Agile Processes Problem solving skills and hands on attitude Eager to never stop learning Strong interpersonal and communication skills Tools AWS Cloud Databricks solutions Strong fundamental knowledge of Datawarehouse DataLakes Lakehouse Relational Database Knowledge and or experience using AWS cloud products Hands on experience in managing Setup of various AWS services such as EC2 EBS ELB S3VPC NACL Route SSL Security Groups RDS IAM etc Experience creating andor maintaining production software delivery pipelines using common CICD tools eg GitHub Actions Jenkins GoCD CircleCI Experience working with Agile methodologies Scrum Kanban Extensive experience in using DevOps concepts and usage of CI CD tools in previous engagements Should Have Databricks Pyspark Python Data Management ETL Design Basic knowledge on Alteryx tools Atlassian Tools JIRA Confluence Agile Scrum methodology Soft Skills Process Oriented Excellent verbalwritten communication skills including communicating technical issues to nontechnical audiences and presentation skills Experience with team management