Padmi

Data Engineer/Architect EDGE|ML (Noida)

Delhi NCRPosted 1 month ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at Topcoder

Opens the source posting on shine.com

Source description

About the role

View original

Data Engineer/Architect EDGE|ML Description EDGE|ML is an end-to-end analytics and solutions platform aiming to supply SCM, logistics, store and category managers with data, insights, and solutions to optimize their processes. EDGE|ML is built on a state-of-the-art, scalable technology leveraging Google Cloud Platform managed services. The ideal candidate for the Data engineer/architect role is an experienced data pipeline/architecture builder who enjoys building from the ground up and optimizing data systems. Your challenges - Augment EDGE|ML offerings by enhancing, extending, optimizing, and operationalizing the analytic services. - Data Architecture - Optimally design and work with large, complex datasets in BigQuery. - Data Engineering - Design, build, maintain, productionize, and operate data pipelines in GCP using Python, SQL, and Google managed services. - Deploy machine learning models. - Collaborate closely with business stakeholders, data analysts/scientists, software engineers, and platform operations staff. You should bring in - Data architecture - 5+ years of experience in Data Warehousing, Business Intelligence, Big Data. - Advanced working SQL knowledge and experience (CTE, window functions) working with relational databases, as well as working familiarity with a variety of databases. - Extensive knowledge of data modelling approaches and best practices. Experience in implementation of a data mesh architecture in Google Cloud is a robust plus. - Extensive knowledge of techniques for query optimization in BigQuery. - Data Engineering - 5+ years of experience in a Data Engineering role - Extensive experience building, optimizing, and productionizing big data data pipelines, in Google Cloud Platform. - Experience designing and deploying high performance systems with reliable monitoring and logging practices. - Experience with source control systems (GitHub) and continuous integration & deployment tools e.g. Jenkins - Experience using application .

One address, no account. We’ll tell you when matching roles go live.

More at Topcoder

Related open roles

View all roles