Padmi

Data Architect - Scala & Cloud Data Engineering

HyderabadPosted 3 months ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at NR Consulting

Opens the source posting on shine.com

Source description

About the role

View original

As an experienced Data Architect with expertise in Scala, Data Engineering, and Cloud Technologies (AWS/Azure/GCP), your role will involve designing and implementing scalable, secure, and high-performance data platforms while providing architectural leadership for enterprise data transformation initiatives. Key Responsibilities: - Architect and design enterprise-scale data platforms and solutions on major cloud platforms (AWS, Azure, or GCP). - Lead the design and implementation of large-scale batch and real-time data processing solutions using Scala and Apache Spark. - Define enterprise data architecture, models, integration patterns, and governance frameworks. - Design and optimize Data Lakes, Data Warehouses, and Lakehouse architectures. - Develop scalable ETL/ELT pipelines for processing structured and unstructured data. - Drive cloud migration and modernization initiatives. - Collaborate with stakeholders to translate business requirements into technical solutions. - Establish best practices for data quality, security, governance, and performance optimization. - Provide technical leadership, mentoring, and guidance to engineering teams. - Evaluate emerging technologies to improve scalability, reliability, and efficiency. Required Skills & Experience: Technical Skills: - 14+ years of IT experience with a strong Data Engineering background. - 3+ years of experience in Data or Solution Architecture roles. - Hands-on expertise in Scala programming. - Extensive experience with Apache Spark (Scala). - Working experience on major cloud platforms (AWS, Azure, or GCP). - Expertise in building and optimizing ETL/ELT pipelines. - Experience with real-time and streaming data processing. - Strong SQL and data modeling skills. - Familiarity with Data Lakes, Data Warehouses, and modern analytics platforms. - Knowledge of Kafka, Airflow, Databricks, or similar data ecosystem tools. - Experience with CI/CD, DevOps practices, and Infrastructure as Code. - Familiarity with Docker and Kubernetes is a plus. Architecture & Leadership Skills: - Experience in designing enterprise-wide data architectures and cloud strategies. - Ability to create High-Level Design (HLD) and Low-Level Design (LLD) documents. - Strong stakeholder management and communication skills. - Experience leading data engineering teams and cloud transformation programs. - Strong analytical and problem-solving abilities. Preferred Qualifications: - Experience in AWS, Azure, or GCP cloud-native data services. - Cloud certifications (AWS, Azure, or GCP) preferred. - Exposure to modern Data Lakehouse architectures. - Familiarity with AI/ML data platforms and advanced analytics solutions. Education: - Bachelor's or master's degree in computer science, Information Technology, Engineering, or related field. As an experienced Data Architect with expertise in Scala, Data Engineering, and Cloud Technologies (AWS/Azure/GCP), your role will involve designing and implementing scalable, secure, and high-performance data platforms while providing architectural leadership for enterprise data transformation initiatives. Key Responsibilities: - Architect and design enterprise-scale data platforms and solutions on major cloud platforms (AWS, Azure, or GCP). - Lead the design and implementation of large-scale batch and real-time data processing solutions using Scala and Apache Spark. - Define enterprise data architecture, models, integration patterns, and governance frameworks. - Design and optimize Data Lakes, Data Warehouses, and Lakehouse architectures. - Develop scalable ETL/ELT pipelines for processing structured and unstructured data. - Drive cloud migration and modernization initiatives. - Collaborate with stakeholders to translate business requirements into technical solutions. - Establish best practices for data quality, security, governance, and performance optimization. - Provide technical leadership, mentoring, and guidance to engineering teams. - Evaluate emerging technologies to improve scalability, reliability, and efficiency. Required Skills & Experience: Technical Skills: - 14+ years of IT experience with a strong Data Engineering background. - 3+ years of experience in Data or Solution Architecture roles. - Hands-on expertise in Scala programming. - Extensive experience with Apache Spark (Scala). - Working experience on major cloud platforms (AWS, Azure, or GCP). - Expertise in building and optimizing ETL/ELT pipelines. - Experience with real-time and streaming data processing. - Strong SQL and data modeling skills. - Familiarity with Data Lakes, Data Warehouses, and modern analytics platforms. - Knowledge of Kafka, Airflow, Databricks, or similar data ecosystem tools. - Experience with CI/CD, DevOps practices, and Infrastructure as Code. - Familiarity with Docker and Kubernetes is a plus. Architecture & Leadership Skills: - Experience in designing enterprise-wide data architectures and cloud strategies. - Ability to create High-Level Design (HLD) an

One address, no account. We’ll tell you when matching roles go live.

More at NR Consulting

Related open roles

View all roles