Data Engineer - AEP Competency

Data Engineer - AEP Comptency Position Summary Experienced software engineer utilizing Big Data & Cloud technologies to program for custom solutions for Adobe Experience Cloud customers and frameworks. What you ll do Develop low level design as per approved Tech Specification or equivalent inputs provided. Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs. Build and delivery technology deliverables compliant with functional requirements. Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc. Process technology deliverables through full development lifecycle. Maintain and support existing solutions and technology frameworks. Attend regular scrum events of equivalent and provide update on the deliverables. Work independently with none or minimum supervision. Requirements 6+ years(6 year) of professional software engineering mostly focused on the following: Developing ETL pipelines involving big data. Developing data processinganalytics applications primarily using PySpark. Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming. Clear understanding and ability to implement distributed storage, processing and scalable applications. Experience of working with SQL and NoSQL database. Ability to write and analyze SQL, HQL and other query languages for NoSQL databases. Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries. Data Engineer - AEP Comptency Experience of developing applications that consume the services exposed as ReST APIs. Special Consideration given for Experience of working with Container-orchestration systems like Kubernetes. Experience of working with any enterprise grade ETL tools. Experience & knowledge with Adobe Experience Cloud solutions. Experience & knowledge with Web Analytics or Digital Marketing. Experience & knowledge with Google Cloud platforms. Experience & knowledge with Data Science, ML/AI, R or Jupyter