Data Engineer - Streaming (India)

Location: India Experience Required: 6+ Years About the Role - We are looking for an experienced Data Engineer with over 6 years of experience to design, build, and optimize event-driven architectures for high-throughput, low-latency data flows across distributed systems to deliver business insights. The ideal candidate has strong expertise in SQL, Python, Snowflake, and hands-on experience with Streaming ETL - any of Flink, Kafka, Spark Streaming Key Responsibilities: - Design, develop, and maintain scalable and reliable data pipelines using up-to-date cloud data platforms. - Architect and implement real-time data streaming pipelines using Apache Kafka / Apache Flink / Spark Streaming - Design event-driven architectures for high-throughput, low-latency data flows across distributed systems - Build stateful and stateless Flink jobs for complex event processing, windowed aggregations, and stream joins - Contribute to data architecture and modeling discussions to enhance data platform scalability and performance. - Contribute to CI/CD pipeline setup, containerized deployments, and infrastructure-as-code practices Required Skills: Mandatory skill set for consideration - Python, SQL, Streaming ETL 6+ years of hands-on experience in data engineering, backend engineering, or distributed systems Deep understanding of ETL/ELT processes and data warehousing concepts. Snowflake: Proficiency in Snowflake data warehouse including architecture, data warehousing, security, and performance optimization will be an added plus Proven expertise in Streaming ETL stack - Any one of - Flink / Kafka / Spark streaming across 2 or 3 projects : Apache Kafka: production experience with topic design, consumer groups, offset management, Kafka Streams or Kafka Connect Apache Flink: experience building streaming jobs, managing checkpoints, windowed computations, and state backends Alternatives considered: Apache Spark Structured Streaming, AWS Kinesis, Google Dataflow / Apache Beam Good hands-on experience with data pipeline orchestration tools (e.g., Airflow, Prefect, Dagster). Experience working with cloud platforms such as AWS, Azure, or GCP. Experience in NoSQL DB - MongoDB, Cassandra, DynamoDB will be an added advantage Soft Skills: - Strong analytical and problem-solving abilities - Excellent communication skills with experience working in consulting or client-facing roles - Strong attention to detail and commitment to data quality .