Source description
About the role
Role: Azure Data Engineer
Location: Remote Duration: 12 months Needs: o Data engineering – ingest and curate data o Databricks – strong pyspark, spark, python coding exp o Delta lake/delta tables Required: o Strong verbal and written communication skills to effectively articulate messages to internal and external teams. o Hands on experience with Azure data platform stack (Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions) o Experience with dimensional modeling and data warehousing concepts o Experience with designing, building, optimizing, troubleshooting end-to-end big data pipelines using structured (relational and files) and semi-structured data o Experience with building metadata driven data processing frameworks o Strong experience in Spark, SQL, python, Pyspark, shell scripting. o Ability to work in an agile team. o Ability to take ownership of a request from initial requirements, design, development and production deployment Nice to have: o Powershell, scala, java o Apache Airflow o Azure EventHubs o Apace Kafka o Streaming data o CosmosDB/NoSQL Database
-- Thanks & Regards, Krishnasree | US IT Recruiter Thought wave software and solutions 314 N, Lake St, Suite 6, Aurora IL 60506 Mobile:6305668710 Email: krishnasree@wavsols.com Website: www.thoughtwavesoft.com LinkedIn: linkedin.com/in/krishnasree-kolla-7582a01a3
More at Thoughtwave Software and Solutions