Source description
About the role
Hi, Greetings from Team Thoughtwave Software and Solutions, Please find below the exciting Job opening with our esteem client with details Job description and if you are looking for a new Job opening here is the position and you respond with the latest/updated resume to email enclosed or feel free call us. You can also review the requirement in detail and apply directly here on our website. Job Title: Data Engineer Job Location: Remote Duration: 6 Months Work Authorization: US Citizen, GC, GC-EAD, H4-EAD Contract Type: W2 Rate: open Interview Mode: One and Done interview Job Description: Experience in Data modeling and advanced SQL techniques • Experience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data services • Expert in SQL, Python, Spark, Databricks • Experience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation • Experience with DevOps process and understanding of Terraform scripting • Understanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design • Experience designing and implementing ingestion processes for unstructured and structured data sets • Experience designing and developing data cleansing routines utilizing standard data operations • Knowledge of data, master data, metadata related standards, and processes • Experience working with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queries • Experience using Azure DevOps/Github actions CI/CD pipelines to deploy code • Microsoft Azure certifications are a plus • Minimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms
More at Thoughtwave Software and Solutions