Source description
About the role
Job Description: Role: Data Engineer Experience: 7 to 10 Years Location: PAN India (Remote) Notice Period: Immediate to 15 days (Who are serving notice period preferred) Job Type: Contract Requirements: • Bachelors in technology with 7+ years of data engineering experience. • Design complex ETL requirements and design. Identify, recommend, and implement ETL process and architecture improvements. • Ability to design, test, debug and migrate Informatica code. • Ability to develop test cases based on test matrix including test data preparation for Data Completeness, Data Transformations, Data quality, Performance, and scalability. • Good analytical and problem-solving skills. • Must have experience in IICS / Informatica Powercenter etc. • Must have experience working with Snowflake as a data warehouse . • Experience with Data Warehousing skills/concepts. • Proficiency in SQL. • Proficiency in Python and its supporting libraries for data processing. • Experience with building cloud data solutions [ AWS is preferred , but familiarity with other cloud environments like Azure or GCP is also acceptable]. Preferred Requirements: • Experience building solutions utilizing streaming or event processing (Kafka, Spark Streaming, Pulsar , etc.) is a plus. • Experience with cloud SDKs and programmatic access services. • Working knowledge of agile development, including DevOps concepts ( IAC, CI/CD , etc.). Responsibilities: • Play a key role in our advanced analytics team - developing data-driven solutions, and responsible for driving Growth. • Design and develop scalable streaming data integration frameworks to move and transform a variety of data sets. • Develop on the data platform by building applications using a mix of best in breed SaaS tools ( Informatica Cloud, Snowflake, Domo, etc.) & open-source frameworks ( Py-Spark, Kubernetes, Airflow , etc.) • Implement and manage production support processes around data lifecycle, data quality, coding utilities, storage, reporting and other data integration points.
More at Cerebra