Data Engineer (Big Data)

As a Data Engineer at Delhivery, you will be responsible for designing, optimizing, and managing the high-throughput data infrastructure. Your role will involve developing and optimizing Streaming ETL applications, collaborating with cross-functional teams to implement data-driven solutions, and troubleshooting performance issues in ETL pipelines. Key Responsibilities: - Develop and optimize Streaming ETL applications to efficiently process large-scale data - Collaborate with cross-functional teams to design and implement data-driven solutions - Troubleshoot and resolve performance issues in ETL pipelines Qualifications Required: - Proficiency in Kafka Connect, data pipelines, Kafka, Real-time streaming, connectors, etc. - Minimum of 1+ years of professional experience with Big Data systems, pipelines, and data processing - Solid understanding of distributed systems, Spark, Databases, System design, and big data processing frameworks - Familiarity with Hadoop ecosystem components (HDFS, Hive, HBase) is a plus Delhivery, India's leading fulfillment platform for digital commerce, aims to become the operating system for commerce in India by combining world-class infrastructure, robust logistics operations, and technology excellence. Since 2011, Delhivery has fulfilled over 550 million transactions and empowered 10,000+ businesses, ranging from startups to large enterprises. With a vast logistics network spanning 18,000+ pin codes and over 2,500 cities, Delhivery provides a comprehensive suite of services including express parcel transportation, freight solutions, reverse logistics, cross-border commerce, warehousing, and cutting-edge technology services. As a Data Engineer at Delhivery, you will be responsible for designing, optimizing, and managing the high-throughput data infrastructure. Your role will involve developing and optimizing Streaming ETL applications, collaborating with cross-functional teams to implement data-driven solutions, and troubleshooting performance issues in ETL pipelines. Key Responsibilities: - Develop and optimize Streaming ETL applications to efficiently process large-scale data - Collaborate with cross-functional teams to design and implement data-driven solutions - Troubleshoot and resolve performance issues in ETL pipelines Qualifications Required: - Proficiency in Kafka Connect, data pipelines, Kafka, Real-time streaming, connectors, etc. - Minimum of 1+ years of professional experience with Big Data systems, pipelines, and data processing - Solid understanding of distributed systems, Spark, Databases, System design, and big data processing frameworks - Familiarity with Hadoop ecosystem components (HDFS, Hive, HBase) is a plus Delhivery, India's leading fulfillment platform for digital commerce, aims to become the operating system for commerce in India by combining world-class infrastructure, robust logistics operations, and technology excellence. Since 2011, Delhivery has fulfilled over 550 million transactions and empowered 10,000+ businesses, ranging from startups to large enterprises. With a vast logistics network spanning 18,000+ pin codes and over 2,500 cities, Delhivery provides a comprehensive suite of services including express parcel transportation, freight solutions, reverse logistics, cross-border commerce, warehousing, and cutting-edge technology services.