Source description
About the role
As an experienced Data Architect with expertise in Scala, Data Engineering, and Cloud Technologies (AWS/Azure/GCP), your role will involve designing and implementing scalable, secure, and high-performance data platforms while providing architectural leadership for enterprise data transformation initiatives. Key Responsibilities: - Architect and design enterprise-scale data platforms and solutions on major cloud platforms (AWS, Azure, or GCP). - Lead the design and implementation of large-scale batch and real-time data processing solutions using Scala and Apache Spark. - Define enterprise data architecture, models, integration patterns, and governance frameworks. - Design and optimize Data Lakes, Data Warehouses, and Lakehouse architectures. - Develop scalable ETL/ELT pipelines for processing structured and unstructured data. - Drive cloud migration and modernization initiatives. - Collaborate with stakeholders to translate business requirements into technical solutions. - Establish best practices for data quality, security, governance, and performance optimization. - Provide technical leadership, mentoring, and guidance to engineering teams. - Evaluate emerging technologies to improve scalability, reliability, and efficiency. Required Skills & Experience: Technical Skills: - 14+ years of IT experience with a strong Data Engineering background. - 3+ years of experience in Data or Solution Architecture roles. - Hands-on expertise in Scala programming. - Extensive experience with Apache Spark (Scala). - Working experience on major cloud platforms (AWS, Azure, or GCP). - Expertise in building and optimizing ETL/ELT pipelines. - Experience with real-time and streaming data processing. - Strong SQL and data modeling skills. - Familiarity with Data Lakes, Data Warehouses, and modern analytics platforms. - Knowledge of Kafka, Airflow, Databricks, or similar data ecosystem tools. - Experience with CI/CD, DevOps practices, and Infrastructure as Code. - Familiarity with Docker and Kubernetes is a plus. Architecture & Leadership Skills: - Experience in designing enterprise-wide data architectures and cloud strategies. - Ability to create High-Level Design (HLD) and Low-Level Design (LLD) documents. - Strong stakeholder management and communication skills. - Experience leading data engineering teams and cloud transformation programs. - Strong analytical and problem-solving abilities. Preferred Qualifications: - Experience in AWS, Azure, or GCP cloud-native data services. - Cloud certifications (AWS, Azure, or GCP) preferred. - Exposure to modern Data Lakehouse architectures. - Familiarity with AI/ML data platforms and advanced analytics solutions. Education: - Bachelor's or master's degree in computer science, Information Technology, Engineering, or related field. As an experienced Data Architect with expertise in Scala, Data Engineering, and Cloud Technologies (AWS/Azure/GCP), your role will involve designing and implementing scalable, secure, and high-performance data platforms while providing architectural leadership for enterprise data transformation initiatives. Key Responsibilities: - Architect and design enterprise-scale data platforms and solutions on major cloud platforms (AWS, Azure, or GCP). - Lead the design and implementation of large-scale batch and real-time data processing solutions using Scala and Apache Spark. - Define enterprise data architecture, models, integration patterns, and governance frameworks. - Design and optimize Data Lakes, Data Warehouses, and Lakehouse architectures. - Develop scalable ETL/ELT pipelines for processing structured and unstructured data. - Drive cloud migration and modernization initiatives. - Collaborate with stakeholders to translate business requirements into technical solutions. - Establish best practices for data quality, security, governance, and performance optimization. - Provide technical leadership, mentoring, and guidance to engineering teams. - Evaluate emerging technologies to improve scalability, reliability, and efficiency. Required Skills & Experience: Technical Skills: - 14+ years of IT experience with a strong Data Engineering background. - 3+ years of experience in Data or Solution Architecture roles. - Hands-on expertise in Scala programming. - Extensive experience with Apache Spark (Scala). - Working experience on major cloud platforms (AWS, Azure, or GCP). - Expertise in building and optimizing ETL/ELT pipelines. - Experience with real-time and streaming data processing. - Strong SQL and data modeling skills. - Familiarity with Data Lakes, Data Warehouses, and modern analytics platforms. - Knowledge of Kafka, Airflow, Databricks, or similar data ecosystem tools. - Experience with CI/CD, DevOps practices, and Infrastructure as Code. - Familiarity with Docker and Kubernetes is a plus. Architecture & Leadership Skills: - Experience in designing enterprise-wide data architectures and cloud strategies. - Ability to create High-Level Design (HLD) an
More at NR Consulting