Source description
About the role
Role: Python Data Engineer, Location: 100% Remote Duration: LongTerm, CANDIDATES MUST HAVE KUBERNETES OR AIRFLOW WITH STRONG PYTHON OR AZURE DATABRICKS WITH STRONG PYTHON. Project Scope / Components: Moving things out of ODI and orchestrating in Airflow + maintain the environment in Kubernetes (Airflow servers rolling out of Airflow pods). High-Level Individual Duties: Framework is built…they are moving them slowly from ODI to airflow New product development as well for ‘new’ clients (work with Azure components) ex. Move from one service bus to another Must-Haves (Concepts & Tools): Senior level Python experience – specifically looking for 9-10 years Kubernetes – Containerization/Docker SQL – must have strong SQL skills Oracle DB experience Nice-to-Haves (Concepts & Tools): AirFlow – really nice to have Description: ● Solid understanding of software engineering and processes: design patterns, algorithms, data structures, schemas and queries, systems design, unit testing, code reviews, Agile practices and DevOps culture. ● Experience working with teams that leveraged two or more of the following: CI/CD pipelines, APIs, serverless/microservices architecture, IaC on public/private cloud, application observability and/or messaging/streaming architecture. ● Strong written, verbal and interpersonal communication skills ● Must be resourceful, have a proactive attitude and be a great collaborator Required Qualifications: ● 5+ years of combined experience with various programming languages such as C++, Java, C# or Python ● 3+ years writing Python 3 for production ● 3+ years exp. writing performant and complex SQL statements (Preferably PL/SQL) ● 2+ years exp. with GIT, preferably GitHub ● 2+ years exp. with Docker and CI/CD pipelines Nice to Have: ● Apache AirFlow experience ● Instrumenting apps with Prometheus/Grafana, and creating effective alarms and dashboards ● SRE principles (reliability engineering, error budgets, alarming practices, etc) ● Experience engineering data pipelines using modern toolsets ● Experience with ETL tools ● Experience driving or being key player in agile transformations ● Healthcare domain background Thanks & Regards Syam B, 630-923-6952 syam@thoughtwavesoft.com
More at Thoughtwave Software and Solutions