Lead Data Infrastructure Engineer

As a Senior Data Platform Engineer at our company, you will play a crucial role in designing, implementing, and optimizing our cloud-native data platform. Your responsibilities will involve: - Designing, developing, and deploying scalable Data Platform with real-time and batch processing solutions - Writing highly scalable code following best practices in concurrency, resource optimization, and fault tolerance - Building and maintaining the infrastructure with the best IoC practices - Identifying and implementing internal process improvements, automating manual tasks, optimizing data flows, and redesigning infrastructure for greater scalability and resilience - Developing automated monitoring, alerting, and logging systems for pipelines to ensure reliability, uptime, and data quality - Building and maintaining data tools enabling analytics, BI, and data science teams to experiment and optimize their workflows - Ensuring end-to-end data governance by implementing policies for data quality, security, and compliance - Optimizing data models and architectures to support machine learning, reporting, and real-time analytics - Collaborating closely with data scientists and product engineers to integrate ML models into production systems and enhance system functionality - Working with stakeholders across the organization to align data infrastructure with business needs Qualifications required for this role include: - 4+ years of hands-on experience in building and managing large-scale data platforms - Experience with version control, CI/CD pipelines, Kubernetes, Docker, and IaC tools - Strong experience in building and maintaining data-intensive APIs and distributed data processing systems - Strong programming skills in Scala, Java, and optimizing SQL queries - Expertise in Spark, Flink, Iceberg, Delta Trino, Kafka - Experience with both relational SQL and NoSQL databases - Understanding of REST APIs, Microservices, event-driven architectures, and Stream processing frameworks - Experience working in cross-functional, agile environments - Open-source contributions or active participation in developer communities - Prior experience in a product-based company is highly preferred Join our dynamic and growing team to redefine our data infrastructure and drive innovative data initiatives! As a Senior Data Platform Engineer at our company, you will play a crucial role in designing, implementing, and optimizing our cloud-native data platform. Your responsibilities will involve: - Designing, developing, and deploying scalable Data Platform with real-time and batch processing solutions - Writing highly scalable code following best practices in concurrency, resource optimization, and fault tolerance - Building and maintaining the infrastructure with the best IoC practices - Identifying and implementing internal process improvements, automating manual tasks, optimizing data flows, and redesigning infrastructure for greater scalability and resilience - Developing automated monitoring, alerting, and logging systems for pipelines to ensure reliability, uptime, and data quality - Building and maintaining data tools enabling analytics, BI, and data science teams to experiment and optimize their workflows - Ensuring end-to-end data governance by implementing policies for data quality, security, and compliance - Optimizing data models and architectures to support machine learning, reporting, and real-time analytics - Collaborating closely with data scientists and product engineers to integrate ML models into production systems and enhance system functionality - Working with stakeholders across the organization to align data infrastructure with business needs Qualifications required for this role include: - 4+ years of hands-on experience in building and managing large-scale data platforms - Experience with version control, CI/CD pipelines, Kubernetes, Docker, and IaC tools - Strong experience in building and maintaining data-intensive APIs and distributed data processing systems - Strong programming skills in Scala, Java, and optimizing SQL queries - Expertise in Spark, Flink, Iceberg, Delta Trino, Kafka - Experience with both relational SQL and NoSQL databases - Understanding of REST APIs, Microservices, event-driven architectures, and Stream processing frameworks - Experience working in cross-functional, agile environments - Open-source contributions or active participation in developer communities - Prior experience in a product-based company is highly preferred Join our dynamic and growing team to redefine our data infrastructure and drive innovative data initiatives!