Source description
About the role
Role Overview As a Big Data Engineer you will be responsible for architecting developing and maintaining scalable data platforms You will work on complex data migration projects particularly transitioning from MySQL to NoSQL while leveraging AWS cloud-based big data tools Key Responsibilities Design develop and maintain large-scale data processing pipelines using AWS Glue Spark and Scala Implement scalable and efficient workflows with AWS Step Functions and EMR Lead and execute data migration projects from MySQL to NoSQL databases Collaborate with data scientists analysts and business teams to deliver clean and reliable data solutions Optimize big data processes for performance scalability and cost-efficiency Ensure data security compliance and governance best practices are followed Required Skills Qualifications 5 years of proven experience as a Big Data Engineer Strong expertise in AWS Glue Spark Scala AWS Step Functions and EMR Solid hands-on experience with data migration from MySQL to NoSQL e g DynamoDB MongoDB Cassandra Proficiency in designing and maintaining ETL pipelines and data integration solutions Strong problem-solving and debugging skills in large-scale data environments Familiarity with modern data architectures and best practices Good to Have Optional Experience with Python or Java for big data applications Knowledge of CI CD practices for data workflows Exposure to data warehousing and analytics tools Why Join Us Opportunity to work on cutting-edge big data projects Collaborative and cutting-edge work culture Career growth and continuous learning environment Competitive salary and benefits package Job Types Full-time Permanent Pay Up to 2 000 000 00 per year Benefits Health insurance Provident Fund Work Location In person Role Overview As a Big Data Engineer you will be responsible for architecting developing and maintaining scalable data platforms You will work on complex data migration projects particularly transitioning from MySQL to NoSQL while leveraging AWS cloud-based big data tools Key Responsibilities Design develop and maintain large-scale data processing pipelines using AWS Glue Spark and Scala Implement scalable and efficient workflows with AWS Step Functions and EMR Lead and execute data migration projects from MySQL to NoSQL databases Collaborate with data scientists analysts and business teams to deliver clean and reliable data solutions Optimize big data processes for performance scalability and cost-efficiency Ensure data security compliance and governance best practices are followed Required Skills Qualifications 5 years of proven experience as a Big Data Engineer Strong expertise in AWS Glue Spark Scala AWS Step Functions and EMR Solid hands-on experience with data migration from MySQL to NoSQL e g DynamoDB MongoDB Cassandra Proficiency in designing and maintaining ETL pipelines and data integration solutions Strong problem-solving and debugging skills in large-scale data environments Familiarity with modern data architectures and best practices Good to Have Optional Experience with Python or Java for big data applications Knowledge of CI CD practices for data workflows Exposure to data warehousing and analytics tools Why Join Us Opportunity to work on cutting-edge big data projects Collaborative and cutting-edge work culture Career growth and continuous learning environment Competitive salary and benefits package Job Types Full-time Permanent Pay Up to 2 000 000 00 per year Benefits Health insurance Provident Fund Work Location In person
More at Firminiq systems