Big Data Engineer

Job Description: You will be utilizing your 9+ years of hands-on experience in designing and developing enterprise-scale applications and systems. Additionally, you will leverage your 7+ years of expertise in Big Data technologies within the AWS EMR and Hadoop ecosystem, including Spark, Scala, PySpark, Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce. Your responsibilities will involve designing, building, managing, and operating the infrastructure as a service layer on cloud-based platforms to support various platform services. Furthermore, you will be expected to have experience with Scala, Python, AWS cloud ecosystem, and ideally with MongoDB. A strong understanding of data analytics and data visualization will be essential for this role. Familiarity with AI Machine Learning (Python/Keras/TensorFlow) and platforms like Splunk and Dynatrace will be advantageous. Your analytical and problem-solving skills will be put to good use, along with your excellent one-on-one communication and presentation abilities to effectively convey technical information. Proficiency in the Linux operating system, Bash, and other scripting languages will also be beneficial. Qualifications Required: - Hands-on experience with Spark/PySpark - Mandatory experience in Scala and Python - Good to have experience with Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce - Good to have knowledge in AI Machine Learning, Splunk, Dynatrace, and Linux Education: - Bachelor's degree in computer science, Engineering, Math, etc. Job Description: You will be utilizing your 9+ years of hands-on experience in designing and developing enterprise-scale applications and systems. Additionally, you will leverage your 7+ years of expertise in Big Data technologies within the AWS EMR and Hadoop ecosystem, including Spark, Scala, PySpark, Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce. Your responsibilities will involve designing, building, managing, and operating the infrastructure as a service layer on cloud-based platforms to support various platform services. Furthermore, you will be expected to have experience with Scala, Python, AWS cloud ecosystem, and ideally with MongoDB. A strong understanding of data analytics and data visualization will be essential for this role. Familiarity with AI Machine Learning (Python/Keras/TensorFlow) and platforms like Splunk and Dynatrace will be advantageous. Your analytical and problem-solving skills will be put to good use, along with your excellent one-on-one communication and presentation abilities to effectively convey technical information. Proficiency in the Linux operating system, Bash, and other scripting languages will also be beneficial. Qualifications Required: - Hands-on experience with Spark/PySpark - Mandatory experience in Scala and Python - Good to have experience with Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce - Good to have knowledge in AI Machine Learning, Splunk, Dynatrace, and Linux Education: - Bachelor's degree in computer science, Engineering, Math, etc.