Source description
About the role
Roles & Responsibilities: 12+ years of experience in Data Engineering platform. Architecting expertise - Data Architecture, ADF, ADLS, Hands on experience on Azure cloud and Pyspark Expert in ETL Knowledge and Handson Experience (min 6 months) on Data cataloguing, Data Governance Azure cloud/Azure services Nice to have Medical /Healthcare Domain Experience Excellent communication skills Technical Skills (Must-Have) Applied experience with distributed data processing frameworks - Spark and Databricks with Python. Proficiency in programming language- Python , PySpark Applied experience with AZURE services ADLS , Delta Lake , Delta Live Tables ,Delta Sharing and Unity Catalog Applied experience with SQL scripting, CRUD operations on time series databases Applied experience with Unit Testing and System Integration Testing using Python framework Applied experience with Devops to design and deploy CI/CD pipelines using Jenkins AZURE Data Engineering(DP203) or DATABRICKS certification Prior working experience with high performance agile team - Scrum , JIRA ,JFrog and Confluence
More at Glauben Technologies