Source description
About the role
Job Summary : We are seeking an experienced Informatica Intelligent Cloud Services (IICS) Developer with hands-on expertise in Databricks to design, develop, and support cloud-based data integration and ETL solutions. The ideal candidate should have strong experience in building scalable data pipelines, integrating multiple cloud and on-premises data sources, and working with modern cloud data platforms. Key Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Informatica Intelligent Cloud Services (IICS). - Build and optimize data integration workflows using Cloud Data Integration (CDI), Mass Ingestion, and Cloud Data Integration services. - Develop and support scalable data pipelines using Databricks (PySpark & Spark SQL). - Integrate data from cloud and on-premises sources including Oracle, SQL Server, Snowflake, Azure Data Lake, AWS S3, Google Cloud Storage, PostgreSQL, MySQL, and REST/SOAP APIs. - Perform data extraction, transformation, cleansing, validation, and loading (ETL/ELT). - Develop reusable mappings, parameterized mappings, taskflows, mapping templates, and workflow automation. - Optimize ETL jobs for performance, scalability, reliability, and maintainability. - Collaborate with business analysts, data engineers, architects, and stakeholders to understand business requirements and deliver high-quality solutions. - Monitor production jobs, troubleshoot failures, perform root cause analysis, and implement preventive measures. - Participate in code reviews, unit testing, deployment, release management, and production support. - Prepare technical documentation and facilitate knowledge transfer sessions. - Follow ETL development standards, data governance, and best practices. Mandatory Skills : - 5+ years of experience in ETL/Data Integration development. - 3+ years of hands-on experience with Informatica Intelligent Cloud Services (IICS). - Strong expertise in : 1. IICS Cloud Data Integration (CDI) 2. Mapping Designer 3. Taskflows 4. Dynamic Mapping 5. Parameter Files 6. Reusable Mappings 7. Scheduling & Monitoring 8. REST & SOAP API Integration 9. Error Handling and Logging - Hands-on experience with Databricks. - Strong knowledge of PySpark and Spark SQL. - Experience working with Delta Lake. - Strong SQL programming and query optimization skills. - Experience with cloud storage platforms : 1. Azure Data Lake Storage (ADLS) 2. AWS S3 3. Google Cloud Storage (GCS) - Experience working with relational databases such as : 1. Oracle 2. SQL Server 3. PostgreSQL 4. MySQL - Good understanding of ETL best practices, performance tuning, data quality, and metadata management. - Experience in production support, incident management, and troubleshooting. Preferred Skills : - Experience with Snowflake integration. - Knowledge of Azure Data Factory (ADF) or other cloud ETL tools. - Familiarity with CI/CD pipelines and Git version control. - Experience working in Agile/Scrum environments. - Exposure to cloud platforms such as Azure, AWS, or Google Cloud Platform (GCP). - Knowledge of data warehousing concepts and dimensional modeling. - Familiarity with Informatica Mass Ingestion and Cloud Application Integration (CAI) is an added advantage. Qualifications : - Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. - Informatica IICS Certification is a plus. Nice to Have : - Experience with Delta Live Tables (DLT). - Exposure to Unity Catalog. - Experience with Apache Spark optimization techniques. - Understanding of Data Lakehouse architecture. - Knowledge of DevOps tools such as Azure DevOps, Jenkins, or GitHub Actions. Job Summary : We are seeking an experienced Informatica Intelligent Cloud Services (IICS) Developer with hands-on expertise in Databricks to design, develop, and support cloud-based data integration and ETL solutions. The ideal candidate should have strong experience in building scalable data pipelines, integrating multiple cloud and on-premises data sources, and working with modern cloud data platforms. Key Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Informatica Intelligent Cloud Services (IICS). - Build and optimize data integration workflows using Cloud Data Integration (CDI), Mass Ingestion, and Cloud Data Integration services. - Develop and support scalable data pipelines using Databricks (PySpark & Spark SQL). - Integrate data from cloud and on-premises sources including Oracle, SQL Server, Snowflake, Azure Data Lake, AWS S3, Google Cloud Storage, PostgreSQL, MySQL, and REST/SOAP APIs. - Perform data extraction, transformation, cleansing, validation, and loading (ETL/ELT). - Develop reusable mappings, parameterized mappings, taskflows, mapping templates, and workflow automation. - Optimize ETL jobs for performance, scalability, reliability, and maintainability. - Collaborate with business analysts, data engineers,
More at Zorba Consulting