Source description
About the role
Job Description : Data Engineer - ETL/ELT with Python , Bigdata and Informatica Responsibilities • Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support scalability of business solutions • Craft and implement data pipelines utilizing Lambda, Spark, and Python • Define and deliver reusable components for ETL/ELT framework. • Define optimal data flow for system integration and data migration • Integrate new data management technologies and software engineering tools into existing structures Qualifications • 7+ years' experience with ETL/ELT Pipelines, • Strong knowledge and experience of SQL, Python • Experience with Big Data/distributed frameworks such as Spark, SQOOP, Hadoop, and Hive • Ability to design ETL/ELT solutions based on user reporting and archival requirements • Strong sense of customer service to consistently and effectively address client needs • Self-motivated; comfortable working independently under general direction
More at Thoughtwave Software and Solutions