Senior Data Engineer IRC284311

Description Work directly with the Client teams to understand the requirements/needs and rapidly prototype data and analytics solutions based upon business requirements Requirements Total of 7+ years of development/design experience with a minimum of 5 years experience in Big Data technologies on-prem or on cloud. Experience with architecting, building, implementing and managing Big Data platforms On Cloud, covering ingestion (Batch and Real time), processing (Batch and Realtime), Polyglot Storage, Data Analytics and Data Access Good understanding of Data Governance, Data Security, Data Compliance, Data Quality, Meta Data Management, Master Data Management, Data Catalog Proven understanding and demonstrable implementation experience of big data platform technologies on cloud (AWS and Azure) including surrounding services like IAM, SSO, Cluster monitoring, Log Analytics etc Experience working with Enterprise Data Warehouse technologies, Multi-Dimensional Data Modeling, Data Architectures or other work related to the construction of enterprise data assets Strong Experience implementing ETL/ELT processes and building data pipelines including workflow management, job scheduling and monitoring Experience building stream-processing systems, using solutions such as Apache Spark, Databricks, Kafka etc… Experience with Spark/Databricks technology is a must Experience with Big Data querying tools Solid skills in Python Strong experience with data modelling and schema design Strong SQL programming background Excellent interpersonal and teamwork skills Experience to drive solution/enterprise-level architecture, collaborate with other tech leads Strong problem solving, troubleshooting and analysis skills Experience working in a geographically distributed team Experience with leading and mentorship of other team members Good knowledge of Agile Scrum Good communication skills Job responsibilities Design, implement and manage large scale data platform/applications including ingestion, processing, storage, data access, data governance capabilities and related infrastructure Support Design and development of solutions for the deployment of data analytics notebooks, tools, dashboards and reports to various stakeholders Communication with Product/DevOps/Development/QA team Architect data pipelines and ETL/ELT processes to connect with various data sources Design and maintain enterprise data warehouse models Take part in the performance optimization processes Guide on research activities (PoC) if necessary Manage cloud based data & analytics platform Establishing best practices with CICD under BigData scope #LI-YZ3 What we offer Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives. Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success. DE&I Matters: At GlobalLogic, we deeply value and embrace diversity . We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment. Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm. Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment. Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company. About GlobalLogic GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.