Source description
About the role
Role Overview We are seeking an experienced Data Engineer with strong expertise in cloud data warehousing, iPaaS integrations, and modern ETL/ELT pipeline development. The ideal candidate will design scalable data platforms, build high-quality data pipelines, and ensure data governance, quality, and security across the organization. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines for data ingestion, transformation, and integration across multiple systems. Work with Snowflake or similar cloud data warehouse platforms to design schemas, optimize performance, and manage data workflows. Utilize SnapLogic or similar iPaaS tools to integrate applications, APIs, and data sources. Build and orchestrate pipelines using Snowpipe, Streams, Tasks, and other Snowflake automation features. Develop high-performance SQL using Snowflake SQL for transformations, modeling, and validation. Implement data modeling, schema design, metadata management, and scalable warehouse structures. Integrate with APIs using REST, JSON/XML processing, and manage API-based ingestion. Ensure end-to-end source-to-target mapping (STTM), data quality checks, validation, and data governance compliance. Apply data security, access control, and encryption standards across data systems. Build workflow orchestration and automation for pipelines using cloud data tools. Leverage Python for data transformation, automation, and integration tasks. Manage DevOps for data, including CI/CD pipelines, version control, and environment management. Implement logging, monitoring, error handling, and recovery strategies for pipelines and integrations. Collaborate with cross-functional teams to support analytics, reporting, and business use cases. Required Skills & Experience Strong experience in Snowflake or similar cloud data platform (BigQuery, Redshift, Databricks). Hands-on experience with iPaaS solutions such as SnapLogic, Boomi, Mulesoft, or Informatica Cloud. Expertise in ETL/ELT pipelines, data integration, and cloud-native pipeline orchestration. Advanced proficiency in SQL and Snowflake SQL. Experience with Snowpipe, Streams, Tasks, and other Snowflake automation components. Strong knowledge of data modeling, schema design, metadata management, and data lifecycle management. Experience with API integrations, REST APIs, JSON/XML, and automation frameworks. Proficiency in Python for scripting and data workflows. Understanding of data governance, data quality, data validation, and security standards. Experience with DevOps for data, including CI/CD, code repositories, testing automation, and workflow automation. Strong debugging, performance tuning, and error-handling skills. Preferred Qualifications Experience with cloud platforms (AWS, Azure, or GCP). Familiarity with orchestration tools such as Airflow, Prefect, Dagster, or Control-M. Knowledge of integration patterns and microservices-based architecture. Skills: data governance,data,integration,management,sql,automation,snowflake
More at cg-vak software & exports ltd.