Source description
About the role
Key Responsibilities: Data Pipeline Development: Build and optimize large-scale data pipelines, architectures, and datasets for efficient data processing and analytics. Infrastructure Scalability: Enhance and automate infrastructure to support data scalability, performance, and reliable delivery across systems. Real-time & Batch Processing: Design and implement both real-time and batch data processing solutions using Kafka , Spark , and Airflow . Data Governance & Security: Ensure compliance with data governance, privacy, and security standards while maintaining system availability and reliability. Collaboration: Work closely with product, analytics, and business teams to translate requirements into scalable data solutions. System Optimization: Continuously improve data architecture, processing speed, and data accessibility to support advanced analytics and reporting needs.
More at Gameskraft