Source description
About the role
Role: Sr. Data Engineer
Location: 100% Remote Duration: 12+ months
Required: Strong verbal and written communication skills to effectively articulate messages to internal and external teams. Hands on experience with Azure data platform stack (Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions) Experience with dimensional modeling and data warehousing concepts Experience with designing, building, optimizing, troubleshooting end-to-end big data pipelines using structured (relational and files) and semi-structured data Experience with building metadata driven data processing frameworks,PySpark Strong experience in Spark, SQL, python, Pyspark, shell scripting. Ability to work in an agile team. Ability to take ownership of a request from initial requirements, design, development and production deployment
Nice to have: Powershell, scala, java Apache Airflow Azure EventHubs Apace Kafka Streaming data
Bhargavi Ankam IT Recruiter Staffing | Thoughtwave Software and Solutions Limited 6306891366 bhargavi@thoughtwavesoft.com www.thoughtwavesoft.com 314 N. Lake St, Suite 6, Aurora IL 60506
More at Thoughtwave Software and Solutions