Data Engineer (Adobe AEP)

As a Data Engineer (Adobe AEP) at TechBiz Global, you will play a crucial role in building and maintaining ingestion pipelines into AEP, ensuring data quality, and optimizing data pipelines for performance and cost efficiency. Key Responsibilities: - Build and maintain ingestion pipelines into AEP (batch, streaming, APIs). - Map and transform source data (CRM, billing, OCS, channels) into XDM schemas. - Ensure data quality, deduplication, and reconciliation across datasets. - Optimize data pipelines for performance, scale, and cost efficiency. - Support debugging of ingestion issues and coordinate fixes with Adobe/vendor teams. - Document data pipelines, mappings, and transformation logic for sustainability. Qualifications Required: - Strong SQL, Python/Scala, and ETL/ELT development skills. - Hands-on experience with APIs, JSON, Kafka, and cloud data platforms (AWS, Azure, GCP). - Familiarity with Adobe AEP XDM schemas and Identity Service. - Strong problem-solving and debugging ability. - Experience in data quality frameworks and reconciliation processes. If you are looking for an opportunity to work in a dynamic and innovative environment where you can utilize your skills in data engineering and contribute to the success of top clients, this role could be the perfect fit for you. As a Data Engineer (Adobe AEP) at TechBiz Global, you will play a crucial role in building and maintaining ingestion pipelines into AEP, ensuring data quality, and optimizing data pipelines for performance and cost efficiency. Key Responsibilities: - Build and maintain ingestion pipelines into AEP (batch, streaming, APIs). - Map and transform source data (CRM, billing, OCS, channels) into XDM schemas. - Ensure data quality, deduplication, and reconciliation across datasets. - Optimize data pipelines for performance, scale, and cost efficiency. - Support debugging of ingestion issues and coordinate fixes with Adobe/vendor teams. - Document data pipelines, mappings, and transformation logic for sustainability. Qualifications Required: - Strong SQL, Python/Scala, and ETL/ELT development skills. - Hands-on experience with APIs, JSON, Kafka, and cloud data platforms (AWS, Azure, GCP). - Familiarity with Adobe AEP XDM schemas and Identity Service. - Strong problem-solving and debugging ability. - Experience in data quality frameworks and reconciliation processes. If you are looking for an opportunity to work in a dynamic and innovative environment where you can utilize your skills in data engineering and contribute to the success of top clients, this role could be the perfect fit for you.