GCP, Hadoop Data Engineer (Pune)

Role & responsibilities - Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau - Proven ability to define and build architecturally sound solution designs. - Demonstrated ability to rapidly build relationships with key stakeholders. - Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. - Must have the ability to understand and develop the logical flow of applications on technical code level. - Strong interpersonal skills and ability to work in a team and in global environments. - Should be proactive, have learning attitude & adjust to work in dynamic work environments. - Exposure in Enterprise Data Warehouse technologies - Exposure in a customer facing role working with enterprise clients. - Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA. - Exposure to DevOps & Agile Project methodology such as Scrum and Kanban. - Understanding of big data modelling techniques using relational and non-relational techniques - Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects. - Understanding or experience of Cloud design patterns - Good to have Google Cloud Certification. - Must have understanding Scala Preferred Skills - Must have positive experience in below tech stack - Hadoop - Hive - HDFS - Apache Spark - Scala - GCP - Jenkins - Airflow - SQL - Hands on experience on Data migration and data processing on the Google Cloud stack, specifically: - Big Query - Cloud Dataflow - Cloud DataProc - Cloud Storage - Cloud DataPrep - Cloud PubSub - Cloud Composer & Airflow .