Source description
About the role
As an Adobe Experience Platform (AEP) Data Engineer, you play a crucial role in building and maintaining the data infrastructure that drives the customer experience platform. Your responsibilities include owning the pipelines, schemas, and systems that ensure clean, consistent, governed data ready for real-time personalization, audience segmentation, and analytics. You will work at the intersection of data engineering and marketing technology, collaborating with various teams to deliver a trusted and scalable data foundation. Key Responsibilities: - Design, build, and maintain XDM schemas such as ExperienceEvent, Individual Profile, and Lookup class datasets. - Define custom field groups, data types, and mixin libraries aligned with business use cases and best practices. - Govern schema versioning, backward-compatibility rules, and deprecation policies. - Collaborate with solution architects to map source system data structures to standardized XDM fields. - Build and maintain a schema registry catalog documenting all datasets and field definitions. - Develop batch and streaming ingestion pipelines using AEP Source Connectors, HTTP API, and Adobe I/O. - Configure and monitor Adobe Experience Platform Tags (Launch) and Web SDK (Alloy). - Configure and maintain IdentityMap fields for accurate cross-device and cross-channel identity resolution. - Write complex SQL queries in AEP Query Service for data validation and exploration. - Apply DULE labels to datasets and fields in alignment with data governance policies. - Manage AEP sandbox environments and monitor platform-level health metrics. - Automate AEP configuration tasks using Adobe I/O Runtime and Experience Platform APIs. Required Qualifications: AEP Platform Skills: - XDM schema design and batch & streaming ingestion. - AEP Identity Service and Query Service proficiency. - DULE labels, data usage policies, and AEP Sandbox management. Data Engineering Skills: - 4+ years in data engineering or ETL/ELT development. - Strong SQL proficiency and experience with streaming platforms. - Proficiency in Python or Node.js for automation and API scripting. - Cloud data platform experience and REST API design. Data Governance & Privacy: - Knowledge of GDPR, CCPA data rights obligations. - Experience with consent management platforms and data lineage documentation. - PII handling, data masking, and anonymization techniques. Collaboration & Communication: - Ability to explain complex data concepts to non-technical stakeholders. - Experience in Agile/Scrum delivery teams and strong documentation habits. - Comfortable collaborating across Engineering, Analytics, Marketing, and Legal departments. This job requires a solid technical foundation in Adobe Experience Platform, data engineering skills, and a strong understanding of data governance and privacy principles. Preferred qualifications include certifications, experience with related Adobe tools, and familiarity with data transformation and integration techniques. As an Adobe Experience Platform (AEP) Data Engineer, you play a crucial role in building and maintaining the data infrastructure that drives the customer experience platform. Your responsibilities include owning the pipelines, schemas, and systems that ensure clean, consistent, governed data ready for real-time personalization, audience segmentation, and analytics. You will work at the intersection of data engineering and marketing technology, collaborating with various teams to deliver a trusted and scalable data foundation. Key Responsibilities: - Design, build, and maintain XDM schemas such as ExperienceEvent, Individual Profile, and Lookup class datasets. - Define custom field groups, data types, and mixin libraries aligned with business use cases and best practices. - Govern schema versioning, backward-compatibility rules, and deprecation policies. - Collaborate with solution architects to map source system data structures to standardized XDM fields. - Build and maintain a schema registry catalog documenting all datasets and field definitions. - Develop batch and streaming ingestion pipelines using AEP Source Connectors, HTTP API, and Adobe I/O. - Configure and monitor Adobe Experience Platform Tags (Launch) and Web SDK (Alloy). - Configure and maintain IdentityMap fields for accurate cross-device and cross-channel identity resolution. - Write complex SQL queries in AEP Query Service for data validation and exploration. - Apply DULE labels to datasets and fields in alignment with data governance policies. - Manage AEP sandbox environments and monitor platform-level health metrics. - Automate AEP configuration tasks using Adobe I/O Runtime and Experience Platform APIs. Required Qualifications: AEP Platform Skills: - XDM schema design and batch & streaming ingestion. - AEP Identity Service and Query Service proficiency. - DULE labels, data usage policies, and AEP Sandbox management. **Data Engineering Skills:
More at Aionos