Databricks Engineer

Role:Databricks Engineer

Duration:12 Months Location:Remote

DUTIES: Take a lead role for analyzing, designing, coding, testing and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates and budgets with minimal or no defects Utilize and participate in the more complex full system development life cycle, per current client SDLC standards. Lead collaboration with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions. Concentrates on providing innovative solutions to more complex business needs Perform work in compliance with all client and client IT standards, policies and procedures. Actively takes a leading role and participates on project teams in various project roles, including, but not limited to: Developer, Technical Lead and Project Manager, based upon level of experience. Effectively communicates with team members, customers, partners and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions and providing accurate and concise documentation

REQUIRED: Bachelor’s degree in Information Technology, Computer Science or closely related field 5 years of experience as a developer 3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows Deep understanding of Spark and its core concepts. Proficient in Spark programming Python, PySpark Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation. Familiar with ETL and have hands-on experience with data pipelines and data orchestration tools Expertise with GCP, including services like Google Cloud Storage, Big Query, Pub/Sub, and Dataflow Problem solving, root cause analysis, and issue resolution Demonstrated leadership skills Experience in Healthcare or Health Insurance Industry Experience with Databricks, GCP, application development tools, business processes, software development life cycle used by our client's enterprise

Preferred: Master’s degree in Information Technology, Computer Science or closely related field 5 years of experience as a developer with demonstrated skills in: Databricks, Python/PySpark, GCP: Big Query and PostgreSQL Certifications such as Python, Databricks, GCP