Source description
About the role
Role: Azure Data Engineer Location: Remote Duration: 12 months Top 3 Needs- • Data engineering – ingest and curate data • Databricks – strong pyspark, spark, python coding exp • Delta lake/delta tables Required: • Strong verbal and written communication skills to effectively articulate messages to internal and external teams. • Hands on experience with Azure data platform stack (Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions) • Experience with dimensional modeling and data warehousing concepts • Experience with designing, building, optimizing, troubleshooting end-to-end big data pipelines using structured (relational and files) and semi-structured data • Experience with building metadata driven data processing frameworks • Strong experience in Spark, SQL, python, Pyspark, shell scripting. • Ability to work in an agile team. • Ability to take ownership of a request from initial requirements, design, development and production deployment Nice to have: • PowerShell, Scala, java • Apache Airflow • Azure EventHub’s • Apace Kafka • Streaming data • CosmosDB/NoSQL Database Thanks & Regards, Gousia Syed - Technical IT Recruiter Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6305669398 EXTN: 108 Email: gousia@wavsols.com Website: www.thoughtwavesoft.com LinkedIn: https://www.linkedin.com/in/syed-gousia-5ba007221/
More at Thoughtwave Software and Solutions