Source description
About the role
Job Summary: We are seeking a skilled Java Spark Engineer to join our Data & Analytics team. The ideal candidate will work on building next-generation data products on Hadoop and Spark platforms, handling large-scale datasets, and collaborating with cross-functional teams to deliver high-quality data solutions. Roles & Responsibilities: Data Processing & Transformation: Prototype and implement data transformations and entity resolutions on petabyte-scale data using Hadoop and Spark clusters. Debug and optimize Spark code for performance improvements. Machine Learning Support: Understand, code, and debug ML models in Spark for analytics and data processing workflows. Data Quality & Analytics: Analyze data errors and identify root causes to improve overall data quality. Work with relational, NoSQL, and graph databases to extract, transform, and query data efficiently. Collaboration & Communication: Collaborate closely with teams generating and consuming data to ensure accurate and reliable data outputs. Communicate findings and solutions clearly, both in writing and orally, to stakeholders and team members.
More at Arise Global Services