Bigdata Engineer

Role Overview: Utilize your software engineering skills including Java, Spark, Python, Scala to analyze disparate, complex systems and collaboratively design new products and services. Integrate new data sources and tools. Implement scalable and reliable distributed data replication strategies. Ability to mentor and provide direction in architecture and design to onsite/offshore developers. Collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases. Perform analysis of large data sets using components from the Hadoop ecosystem. Own product features from development, testing through to production deployment. Evaluate big data technologies and prototype solutions to improve our data processing architecture. Automate everything. Key Responsibilities: - Utilize software engineering skills in Java, Spark, Python, Scala to analyze complex systems and design new products and services - Integrate new data sources and tools - Implement scalable and reliable distributed data replication strategies - Mentor and provide direction in architecture and design to onsite/offshore developers - Collaborate with other teams to design, develop, and deploy data tools for operations and product use cases - Perform analysis of large data sets using Hadoop ecosystem components - Own product features throughout development, testing, and production deployment - Evaluate big data technologies and prototype solutions for data processing architecture improvement - Automate processes Qualifications Required: - Minimum of 5 6 years of experience delivering enterprise software solutions - Proficient in Java, Spark, Scala, Python, AWS Cloud technologies - 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala - Flair for data, schema, data model, and improving efficiency in the big data lifecycle - Ability to quickly understand technical and business requirements and translate them into technical implementations - Experience with Agile Development methodologies - Experience with data ingestion and transformation - Solid understanding of secure application development methodologies - Experience with Airflow and Python preferred - Understanding of automated QA needs related to Big data - Strong object-oriented design and analysis skills - Excellent written and verbal communication skills Note: No additional details of the company were present in the provided job description. Role Overview: Utilize your software engineering skills including Java, Spark, Python, Scala to analyze disparate, complex systems and collaboratively design new products and services. Integrate new data sources and tools. Implement scalable and reliable distributed data replication strategies. Ability to mentor and provide direction in architecture and design to onsite/offshore developers. Collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases. Perform analysis of large data sets using components from the Hadoop ecosystem. Own product features from development, testing through to production deployment. Evaluate big data technologies and prototype solutions to improve our data processing architecture. Automate everything. Key Responsibilities: - Utilize software engineering skills in Java, Spark, Python, Scala to analyze complex systems and design new products and services - Integrate new data sources and tools - Implement scalable and reliable distributed data replication strategies - Mentor and provide direction in architecture and design to onsite/offshore developers - Collaborate with other teams to design, develop, and deploy data tools for operations and product use cases - Perform analysis of large data sets using Hadoop ecosystem components - Own product features throughout development, testing, and production deployment - Evaluate big data technologies and prototype solutions for data processing architecture improvement - Automate processes Qualifications Required: - Minimum of 5 6 years of experience delivering enterprise software solutions - Proficient in Java, Spark, Scala, Python, AWS Cloud technologies - 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala - Flair for data, schema, data model, and improving efficiency in the big data lifecycle - Ability to quickly understand technical and business requirements and translate them into technical implementations - Experience with Agile Development methodologies - Experience with data ingestion and transformation - Solid understanding of secure application development methodologies - Experience with Airflow and Python preferred - Understanding of automated QA needs related to Big data - Strong object-oriented design and analysis skills - Excellent written and verbal communication skills Note: No additional