Azure Data Engineer - Databricks/PySpark

As an Azure Databricks Developer with 6-8 years of experience, your role involves designing and developing scalable data pipelines using Azure Databricks. You will work with large datasets using PySpark for data transformation and processing. Your responsibilities also include implementing data storage and retrieval solutions using Azure Data Lake Storage (ADLS). Furthermore, you will optimize and tune data processing jobs for performance and efficiency. Collaboration with data architects and stakeholders to define data solutions is crucial, along with integrating data pipelines with Azure services and external systems. Troubleshooting and resolving data-related issues in production environments and following best practices for coding, testing, and deployment are also part of your responsibilities. Qualifications Required: - Strong hands-on experience with Azure Databricks (Python-based development), PySpark, and Azure Data Lake Storage (ADLS) - Experience in building and optimizing big data pipelines - Strong analytical and problem-solving skills - Knowledge of data processing frameworks and distributed systems Please note that the job description also includes the company reference (ref:hirist.tech). As an Azure Databricks Developer with 6-8 years of experience, your role involves designing and developing scalable data pipelines using Azure Databricks. You will work with large datasets using PySpark for data transformation and processing. Your responsibilities also include implementing data storage and retrieval solutions using Azure Data Lake Storage (ADLS). Furthermore, you will optimize and tune data processing jobs for performance and efficiency. Collaboration with data architects and stakeholders to define data solutions is crucial, along with integrating data pipelines with Azure services and external systems. Troubleshooting and resolving data-related issues in production environments and following best practices for coding, testing, and deployment are also part of your responsibilities. Qualifications Required: - Strong hands-on experience with Azure Databricks (Python-based development), PySpark, and Azure Data Lake Storage (ADLS) - Experience in building and optimizing big data pipelines - Strong analytical and problem-solving skills - Knowledge of data processing frameworks and distributed systems Please note that the job description also includes the company reference (ref:hirist.tech).