Source description
About the role
We are seeking a skilled and motivated ETL Developer with 4+ years of experience in designing, developing, and supporting enterprise data integration solutions. The ideal candidate will have strong expertise in Informatica PowerCenter and Informatica Intelligent Data Management Cloud (IDMC), along with hands-on experience in AWS and Google Cloud Platform (GCP) environments. This role involves building scalable ETL/ELT pipelines, integrating data across on-premise and cloud platforms, orchestrating workflows using Google Cloud Composer (Apache Airflow), and supporting data quality, governance, and modernization initiatives. The successful candidate will work closely with data architects, analysts, business stakeholders, and cloud engineering teams to deliver reliable and high-performing data solutions. Key Responsibilities ETL Design & Development Design, develop, and maintain ETL/ELT pipelines using Informatica PowerCenter and Informatica IDMC.Build and optimize mappings, workflows, sessions, and reusable components for large-scale data processing.Implement complex data transformations using Joiner, Aggregator, Lookup, Router, Expression, Update Strategy, and custom SQL.Develop batch and near real-time integration solutions using CDC, incremental load, and full-load methodologies.Troubleshoot and resolve ETL performance and data integration issues. Cloud Data Integration Design and implement cloud-native data pipelines integrating AWS and GCP services.Develop integrations with AWS services such as S3, Redshift, Glue, RDS, and Lambda.Develop integrations with GCP services such as BigQuery, Cloud Storage, Dataflow, Cloud SQL, and Cloud Functions.Build and manage IDMC connections for cloud platforms, databases, APIs, and third-party applications.Support hybrid architectures involving both on-premise PowerCenter and cloud-based IDMC environments. Workflow Orchestration Design, develop, and maintain Apache Airflow DAGs using Google Cloud Composer.Orchestrate end-to-end ETL workflows across cloud and hybrid environments.Implement scheduling, monitoring, dependency management, branching, SLA handling, and alerting mechanisms.Integrate Airflow with Informatica IDMC tasks, BigQuery jobs, Dataflow pipelines, and cloud services.Develop custom Python-based Airflow operators and automation scripts where required. Data Quality & Governance Implement data quality rules, profiling, validation, cleansing, and standardization processes.Support metadata management, data lineage, and governance initiatives.Collaborate with Data Governance teams to maintain compliance and data quality standards.Utilize Informatica Data Quality (IDQ), AXON, or Enterprise Data Catalog (EDC) where applicable. Performance Optimization & DevOps Optimize ETL workflows and mappings through partitioning, pushdown optimization, cache management, and session tuning.Participate in CI/CD implementation using Git, Jenkins, Cloud Build, or similar tools.Support code migrations, deployments, and release management activities.Follow development standards, documentation practices, and coding best practices. Required Skills & Qualifications 4+ years of experience in ETL/Data Integration development.Strong hands-on experience with Informatica PowerCenter.Experience working with Informatica Intelligent Data Management Cloud (IDMC), including Cloud Data Integration (CDI).Hands-on experience with Google Cloud Composer and Apache Airflow.Experience developing data pipelines in AWS and GCP environments.Strong SQL skills including complex queries, performance tuning, CTEs, and window functions.Knowledge of Data Warehousing concepts including Star Schema, Snowflake Schema, and Slowly Changing Dimensions (SCD).Experience integrating data from databases, cloud storage, APIs, and enterprise applications.Proficiency in Python for workflow automation and orchestration.Familiarity with Git and CI/CD processes.Strong analytical, troubleshooting, and problem-solving skills.Excellent communication and stakeholder management abilities. Preferred Qualifications Informatica PowerCenter Developer Certification.Informatica IDMC / CDI Certification.Google Cloud Professional Data Engineer Certification.Experience with cloud migration and modernization projects.Experience with Informatica Data Quality (IDQ), AXON, or Enterprise Data Catalog (EDC).Exposure to Data Lake architectures and file formats such as Parquet, ORC, Avro, and Delta Lake. Key Technologies ETL & Integration Informatica PowerCenter, Informatica IDMC, Cloud Data Integration (CDI), Mass Ingestion Cloud Platforms AWS, GCP AWS Services S3, Redshift, Glue, RDS, Lambda GCP Services BigQuery, Cloud Storage, Dataflow, Cloud SQL, Cloud Composer, Cloud Functions Programming & Scripting SQL, Python Orchestration Apache Airflow, Google Cloud Composer DevOps & Version Control Git, Jenkins, Cloud Build, CI/CD Data Governance & Quality IDQ, AXON, Enterprise Data Catalog (EDC) Data Warehousing Star
More at Zorba AI