Big Data Engineer with AWS

As an experienced professional with 9+ years of hands-on experience in design and development of enterprise-scale applications and systems, you will be responsible for leveraging your expertise in Big Data technologies within the AWS EMR and Hadoop ecosystem. This includes utilizing tools such as Spark, Scala, PySpark, Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce. Your role will involve designing, building, managing, and operating the infrastructure as a service layer on cloud-based platforms to support various platform services. Additionally, your strong understanding of data analytics and data visualization will be crucial in this position. Key Responsibilities: - Utilize your expertise in Scala and Python to contribute to the development of complex applications and systems - Collaborate with cross-functional teams to implement and maintain data infrastructure on cloud-based platforms - Utilize Big Data technologies such as Airflow, Kafka, and Delta Tables to optimize data processing and analysis - Stay updated on the latest trends in AI Machine Learning, particularly in Python, Keras, and TensorFlow - Optional: Experience with MongoDB, Splunk, and Dynatrace for enhanced data management and analytics Qualifications Required: - Hands-on experience with Spark/PySpark - Mandatory experience in Scala and Python - Good to have experience with Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce - Good to have knowledge in AI Machine Learning, Splunk, Dynatrace, and Linux - Bachelor's degree in Computer Science, Engineering, Mathematics, or related field In addition to the technical qualifications, your excellent analytical and problem-solving skills, along with strong one-on-one communication and presentation abilities, will be valuable assets in this role. Moreover, your working knowledge of the Linux operating system, Bash, and other scripting languages will contribute to your success within the team. As an experienced professional with 9+ years of hands-on experience in design and development of enterprise-scale applications and systems, you will be responsible for leveraging your expertise in Big Data technologies within the AWS EMR and Hadoop ecosystem. This includes utilizing tools such as Spark, Scala, PySpark, Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce. Your role will involve designing, building, managing, and operating the infrastructure as a service layer on cloud-based platforms to support various platform services. Additionally, your strong understanding of data analytics and data visualization will be crucial in this position. Key Responsibilities: - Utilize your expertise in Scala and Python to contribute to the development of complex applications and systems - Collaborate with cross-functional teams to implement and maintain data infrastructure on cloud-based platforms - Utilize Big Data technologies such as Airflow, Kafka, and Delta Tables to optimize data processing and analysis - Stay updated on the latest trends in AI Machine Learning, particularly in Python, Keras, and TensorFlow - Optional: Experience with MongoDB, Splunk, and Dynatrace for enhanced data management and analytics Qualifications Required: - Hands-on experience with Spark/PySpark - Mandatory experience in Scala and Python - Good to have experience with Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, and MapReduce - Good to have knowledge in AI Machine Learning, Splunk, Dynatrace, and Linux - Bachelor's degree in Computer Science, Engineering, Mathematics, or related field In addition to the technical qualifications, your excellent analytical and problem-solving skills, along with strong one-on-one communication and presentation abilities, will be valuable assets in this role. Moreover, your working knowledge of the Linux operating system, Bash, and other scripting languages will contribute to your success within the team.