AWS/DATABRICKS

Role: AWS / Databricks

Location: Plano, TX (Only) 12 month Contract.

DATABRICKS Expert Must Have: Python, Advanced Apache Spark, AWS, CI/CD Pipelines Java is a Nice to have Data Engineering background is a plus Re-write application from scratch

Must have experience implementing at least 2 end to end projects with Databricks which includes components like

Delta lake Unity Catalog Databricks Connect DataBricks API Databricks workflow Orchestration

Job Description:

Expert in in Amazon Web Services and Microsoft Azure technology and design technique as well as experience working across large environments with multiple operating systems or infrastructure for large-scale programs (e.g., Expert Engineers) starting to be firm-wide resources working on projects across client Is multi-skilled with expertise across software development lifecycle and toolset May be recognized as a leader in Agile and cultivating teams working in Agile frameworks Sought out as coach for at least one technical skill Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test Driven Development, Cloud Development, resiliency, security Stays abreast of cutting edge technologies/trends and uses experience to influence application of those technologies/trends to support the business; may give speeches and outside the firm, writes articles

Technologies:

Databricks Apache Spark Python(and/or Scala) AWS SQL Java CI/CD Pipeline tools Minimum Industry experience:

10 years Additional Skills:

Bachelor’s degree or equivalent work experience Must be well-versed with Databricks Lakehouse concepts and its implementation in large scale enterprise environments Must have good understanding to create complex data pipelines and use of data ingestion tools like nifi Must be well versed in using Apache Spark framework and strong in SQL and spark-SQL Must have excellent coding skills in Python(and/or Scala), preferably Python Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing Must have worked on AWS and should have working experience of AWS services like S3, Lambda, DynamoDB, SQS, CloudWatch Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirements Must have strong written and verbal communication skills Must have experience in an Agile environment Data engineering background is a plus

Thanks & Regards, Ramyasree US IT RECRUITER Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6302164696 Email:ramyasree@thoughtwavesoft.com LinkedIn: https://www.linkedin.com/in/ramya-sree-kolla-519839221/

A Certified Minority Business Enterprise, Disadvantaged Business Enterprise, SAM.gov, SOC2 & ISO2005, Vendors for: · STATES: IL, PA, TN, AK, OR, CT, GA, VA, ID, IA, UT, FL, MN & CO, · NATIONAL LABS: ARGONNE & FERMI, · COUNTIES: HENNEPIN, MN, FULT