Source description
About the role
Profile Summary: Experienced Data Engineer with a strong focus on real-time data ingestion and streaming solutions . Skilled in designing and implementing robust, scalable pipelines for high-velocity data using Apache Kafka , AWS Cloud streaming tools , and ETL frameworks . Proven expertise in handling semi-structured data formats such as JSON and XML , and integrating data across cloud platforms with a keen eye on performance and reliability. Core Competencies: Real-time Data Ingestion & Stream Processing Apache Kafka – Topic configuration, producers/consumers, stream integration AWS Streaming Services – EventBridge, Lambda, (optionally Kinesis, SQS) ETL Design and Implementation – Batch and real-time Data Transformation – Working with Talend for orchestration and transformation Semi-structured Data Handling – Proficient with JSON and XML parsing SQL – Advanced queries, tuning, and data validation Python – Scripting for automation, transformation, and data pipeline development
More at Sonata Software