Source description
About the role
We are looking for a highly skilled Data Engineer. The ideal candidate will have hands-on expertise in Big Data technologies, with a strong foundation in distributed data processing, real-time pipelines, and large-scale data systems. You will design, build, and optimize data solutions that power insights, reporting, and decision-making for our advertising ecosystem. Key Responsibilities Design, develop, and maintain large-scale data pipelines to support Ads reporting, attribution, and analytics use cases. Work extensively with Hive, Spark, SQL, Scala, and Kafka to process and manage petabyte-scale datasets. Optimize data workflows for performance, scalability, and cost efficiency Partner with data scientists, product managers, and platform engineers to deliver high-quality, reliable datasets and APIs Ensure data quality, integrity, and consistency across multiple data sources. Troubleshoot and resolve issues in real-time streaming pipelines and batch data jobs Continuously evaluate new technologies to enhance the Ads Data platform Requirements Strong programming experience in Scala (preferred), Java, or Python Hands-on experience with Apache Spark (batch & streaming) for large-scale data processing. Proficiency in Hive, SQL, and data modeling for analytical workloads. Experience working with Kafka for real-time event streaming Solid understanding of Big Data ecosystems (S4, Hive, Presto, Delta etc.) Strong debugging, performance tuning, and problem-solving skills Bachelor's or Master's degree in Computer Science, Engineering, or related field Nice to Have Experience in AdTech, Attribution, or Campaign Analytics. Familiarity with cloud-based big data solutions (AWS EMR, GCP BigQuery, Databricks, etc.) Familiarity with scheduling services like AirFlow Knowledge of data governance, security, and compliance best practices. Benefits Best in class salary: We hire only the best, and we pay accordingly Proximity Talks: Meet other designers, engineers, and product geeks — and learn from experts in the field Keep on learning with a world-class team: Work with the best in the field, challenge yourself constantly, and learn something new every day
More at Proximity Works