Source description
About the role
Roles and Responsibilities : Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Cloud services such as Data Factory, Synapse Analytics, and Stream Analytics. Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business objectives. Develop scalable and efficient data architectures on AWS/GCP/Azure platforms to support real-time data ingestion, transformation, storage, and analytics workloads. Troubleshoot complex issues related to data pipeline failures or performance degradation by analyzing logs, debugging techniques, and collaborating with stakeholders. Job Requirements : 5-10 years of experience in Data Engineering with expertise in Scala programming language. Strong understanding of big data technologies like Hadoop ecosystem (HDFS), Spark (Scala), Kafka etc. . Experience working with cloud-based platforms like AWS/GCP/Azure Cloud Services (Data Factory). Proficiency in developing scalable architecture designs for large-scale data processing systems.
More at IONIDEA INC