Padmi

Big Data Engineer

ChennaiPosted 3 months ago
Software engineeringSeniorFull Time; Regular
Apply at Newt Global Consulting LLC

Opens the source posting on shine.com

Source description

About the role

View original

As a Data Solutions Developer in our company, your role will involve developing and implementing data solutions using big data technologies and cloud infrastructure. Responsibilities: - Build and maintain data pipelines using the Hadoop ecosystem and Spark. - Develop scalable data solutions on AWS and Snowflake. - Automate deployments and manage infrastructure using DevOps practices and containerization. - Collaborate within an agile scrum environment to deliver data-driven features. Required Skills: - 5-8 years of experience with Hadoop and big data technologies. - 3+ years of hands-on experience with Spark. - Proficiency in Python, PySpark, or Scala. - Experience with HDFS, MapReduce, Hive, Pig, Impala, Kafka, Kudu, and Solr. - 1+ years of experience with Snowflake and AWS cloud development. - Experience with OpenShift, Docker, and Kubernetes. - Strong DevOps skills including source control, continuous integration, and automated deployments. - Any Graduate degree. Preferred Skills: - Relevant industry certifications. - Experience with Agile (Scrum) development methodologies. As a Data Solutions Developer in our company, your role will involve developing and implementing data solutions using big data technologies and cloud infrastructure. Responsibilities: - Build and maintain data pipelines using the Hadoop ecosystem and Spark. - Develop scalable data solutions on AWS and Snowflake. - Automate deployments and manage infrastructure using DevOps practices and containerization. - Collaborate within an agile scrum environment to deliver data-driven features. Required Skills: - 5-8 years of experience with Hadoop and big data technologies. - 3+ years of hands-on experience with Spark. - Proficiency in Python, PySpark, or Scala. - Experience with HDFS, MapReduce, Hive, Pig, Impala, Kafka, Kudu, and Solr. - 1+ years of experience with Snowflake and AWS cloud development. - Experience with OpenShift, Docker, and Kubernetes. - Strong DevOps skills including source control, continuous integration, and automated deployments. - Any Graduate degree. Preferred Skills: - Relevant industry certifications. - Experience with Agile (Scrum) development methodologies.

One address, no account. We’ll tell you when matching roles go live.

More at Newt Global Consulting LLC

Related open roles

View all roles