Padmi

Data Architect

IndiaPosted 2 months ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at AuxoAI Engineering Pvt. Ltd.

Opens the source posting on shine.com

Source description

About the role

View original

As a Data Architect, your role will involve leading enterprise-scale implementation of data warehouse data platforms on Databricks and Snowflake environments. You will be responsible for designing and implementing Medallion (Bronze/Silver/Gold) architecture and scalable enterprise data models. Your key responsibilities will include: - Establishing data modeling standards such as dimensional, data vault, and lakehouse patterns to ensure best practices across projects. - Setting up enterprise data governance frameworks including cataloging, lineage, stewardship, and compliance using Atlan. - Defining and implementing CI/CD pipelines for infrastructure and data platform deployments. - Designing data architectures that support AI/ML and Generative AI workloads, including vector storage, feature layers, and secure access patterns. - Building scalable ingestion frameworks supporting batch, streaming, and CDC pipelines. - Architecting secure, high-performance data integration layers for analytics, BI, and AI consumption. - Developing target-state architecture blueprints and enforcing data standards, governance, and best practices across teams. - Collaborating with engineering, analytics, and data science teams to ensure platform alignment and scalability. - Engaging with clients as a trusted advisor, driving data strategy, roadmap definition, and identifying opportunities for expansion. Qualifications required for this position include: - Solid Databricks / AWS Data Architect profile. - Minimum 8+ years of experience in Data Architecture / Data Engineering, with exposure in enterprise-scale data platform modernization initiatives. - Minimum 3+ years of deep hands-on experience in Databricks-based lakehouse architecture on AWS, including large-scale data platform implementations. - Strong expertise in Databricks ecosystem including Delta Lake, Databricks SQL, Unity Catalog, Delta Live Tables, and MLflow with focus on performance optimization and security. - Strong experience with AWS data services including S3, Glue, EMR, Lambda, Redshift, Athena, Lake Formation, and DMS, with a strong understanding of cloud-native architecture patterns. - Proven experience designing and implementing Medallion (Bronze/Silver/Gold) architecture, scalable data models (Dimensional/Data Vault), and enterprise lakehouse platforms supporting batch and real-time processing. - Hands-on experience building scalable ingestion frameworks including batch, streaming, and CDC pipelines using tools like Kafka, Kinesis, Spark, or similar technologies. - Proven experience implementing CI/CD pipelines for data platforms, including infrastructure as code, automated deployments, and environment management. - Hands-on experience enabling data platforms for AI/ML and Generative AI use cases, including feature stores, vector storage, and secure data access patterns. - Experience with orchestration tools such as Apache Airflow or MWAA and designing integration layers for analytics, BI, and AI consumption. Please note that the company prefers candidates with experience in Product Companies and certifications in AWS, Databricks, or Snowflake, along with exposure to MDM, data quality frameworks, and enterprise metadata tools. As a Data Architect, your role will involve leading enterprise-scale implementation of data warehouse data platforms on Databricks and Snowflake environments. You will be responsible for designing and implementing Medallion (Bronze/Silver/Gold) architecture and scalable enterprise data models. Your key responsibilities will include: - Establishing data modeling standards such as dimensional, data vault, and lakehouse patterns to ensure best practices across projects. - Setting up enterprise data governance frameworks including cataloging, lineage, stewardship, and compliance using Atlan. - Defining and implementing CI/CD pipelines for infrastructure and data platform deployments. - Designing data architectures that support AI/ML and Generative AI workloads, including vector storage, feature layers, and secure access patterns. - Building scalable ingestion frameworks supporting batch, streaming, and CDC pipelines. - Architecting secure, high-performance data integration layers for analytics, BI, and AI consumption. - Developing target-state architecture blueprints and enforcing data standards, governance, and best practices across teams. - Collaborating with engineering, analytics, and data science teams to ensure platform alignment and scalability. - Engaging with clients as a trusted advisor, driving data strategy, roadmap definition, and identifying opportunities for expansion. Qualifications required for this position include: - Solid Databricks / AWS Data Architect profile. - Minimum 8+ years of experience in Data Architecture / Data Engineering, with exposure in enterprise-scale data platform modernization initiatives. - Minimum 3+ years of deep hands-on experience in Databricks-based lakehouse architecture on AWS, including

One address, no account. We’ll tell you when matching roles go live.

More at AuxoAI Engineering Pvt. Ltd.

Related open roles

View all roles