Source description
About the role
Job Title: AI & Big Data Engineering Specialist ---Pharma Domain(MUST) 100% Remote Opportunity Location: Remote India Shift: 2:30 PM 11:00 PM IST Type: Contract / Freelance / Second Job Joining: Immediate Joiner Mandatory Requirements - 5+ years of experience in Data Engineering & Cloud Technologies - Solid hands-on experience in Data Pipeline Development (Must Have) - Pharmaceutical domain experience (Must Have) - Expertise in Python, Spark, ETL/ELT, and Big Data technologies - Experience with data pipeline performance and cost optimization - Strong communication and collaboration skill - Experience with Databricks. - Exposure to AI/ML data engineering workflows. - Experience with CI/CD processes using GitHub Actions Key Responsibilities - Design, develop, and maintain robust and scalable data pipelines for large-scale data processing. - Build and optimize ETL/ELT workflows to ensure data quality, reliability, and performance. - Develop data engineering solutions using Python, Spark, and Big Data technologies. - Work with cloud-based storage solutions, including Blob Storage and other data platforms. - Monitor, troubleshoot, and optimize data pipeline performance and operational costs. - Collaborate with cross-functional teams using Jira, Confluence, GitHub, and GitHub Actions. - Support AI and analytics initiatives by delivering high-quality, well-structured datasets. - Ensure adherence to data governance, security, and compliance standards within the pharmaceutical industry Work Setup - Remote - Afternoon Shift (2:30 PM 11:00 PM IST) - Open to work Contract, Freelance, and Second-Job candidates Job Title: AI & Big Data Engineering Specialist ---Pharma Domain(MUST) 100% Remote Opportunity Location: Remote India Shift: 2:30 PM 11:00 PM IST Type: Contract / Freelance / Second Job Joining: Immediate Joiner Mandatory Requirements - 5+ years of experience in Data Engineering & Cloud Technologies - Solid hands-on experience in Data Pipeline Development (Must Have) - Pharmaceutical domain experience (Must Have) - Expertise in Python, Spark, ETL/ELT, and Big Data technologies - Experience with data pipeline performance and cost optimization - Strong communication and collaboration skill - Experience with Databricks. - Exposure to AI/ML data engineering workflows. - Experience with CI/CD processes using GitHub Actions Key Responsibilities - Design, develop, and maintain robust and scalable data pipelines for large-scale data processing. - Build and optimize ETL/ELT workflows to ensure data quality, reliability, and performance. - Develop data engineering solutions using Python, Spark, and Big Data technologies. - Work with cloud-based storage solutions, including Blob Storage and other data platforms. - Monitor, troubleshoot, and optimize data pipeline performance and operational costs. - Collaborate with cross-functional teams using Jira, Confluence, GitHub, and GitHub Actions. - Support AI and analytics initiatives by delivering high-quality, well-structured datasets. - Ensure adherence to data governance, security, and compliance standards within the pharmaceutical industry Work Setup - Remote - Afternoon Shift (2:30 PM 11:00 PM IST) - Open to work Contract, Freelance, and Second-Job candidates
More at Virtual Labs