Source description
About the role
As a Data Architect at our company in Coimbatore, your role involves designing and architecting scalable, secure, and resilient data platforms leveraging cloud-native technologies such as AWS, Snowflake, and Redshift. You will lead the design and implementation of data pipelines for both batch and real-time processing. Additionally, you will be responsible for building and optimizing data lakes and data warehouses to support enterprise analytics and AI/ML use cases. Your key responsibilities include: - Designing and architecting scalable, secure, and resilient data platforms using cloud-native technologies. - Leading the design and implementation of data pipelines for batch and real-time processing. - Building and optimizing data lakes and data warehouses to support enterprise analytics and AI/ML use cases. - Defining and implementing data modeling standards, metadata management, and master data management practices. - Architecting event-driven and streaming solutions using Kafka, EventBridge, and similar technologies. - Ensuring compliance with governance, data security, privacy, and regulatory requirements. - Driving adoption of best practices in data engineering, cloud architecture, and DevOps for data platforms. - Collaborating with business stakeholders, data scientists, engineers, and product teams to deliver data-driven insights. - Providing technical leadership, mentoring, and guidance to engineering teams. To be successful in this role, you should have: - 10+ years of experience in data architecture, engineering, or related technical roles. - Proven expertise in the modern data stack including AWS Glue, Lambda, Kinesis, S3, and Redshift/Snowflake. - Strong programming and scripting experience with SQL and Python. - Hands-on experience with workflow orchestration tools such as Airflow, Prefect, and Step Functions. - Proficiency in Big Data technologies like Spark, PySpark, and Scala. - Solid understanding of streaming and event-driven architectures like Kafka and EventBridge/Event Bus. - Experience in data modeling, building data lakes/warehouses, and architecting analytical platforms. - Strong knowledge of data governance, security, compliance, and MDM practices. - Excellent problem-solving, analytical, and system design skills. - Exceptional communication, stakeholder management, and leadership capabilities. Nice-to-have skills for this role include exposure to ML Ops, supporting AI/ML pipelines, experience with containerization and orchestration using Docker and Kubernetes, familiarity with CI/CD pipelines and Infrastructure as Code tools like Terraform and CloudFormation, and experience in multi-cloud or hybrid-cloud environments. If this role does not fit your profile, we are continuously growing and seeking passionate and smart engineers. If you are enthusiastic about your career, feel free to reach out to us at careers@hashagile.com. As a Data Architect at our company in Coimbatore, your role involves designing and architecting scalable, secure, and resilient data platforms leveraging cloud-native technologies such as AWS, Snowflake, and Redshift. You will lead the design and implementation of data pipelines for both batch and real-time processing. Additionally, you will be responsible for building and optimizing data lakes and data warehouses to support enterprise analytics and AI/ML use cases. Your key responsibilities include: - Designing and architecting scalable, secure, and resilient data platforms using cloud-native technologies. - Leading the design and implementation of data pipelines for batch and real-time processing. - Building and optimizing data lakes and data warehouses to support enterprise analytics and AI/ML use cases. - Defining and implementing data modeling standards, metadata management, and master data management practices. - Architecting event-driven and streaming solutions using Kafka, EventBridge, and similar technologies. - Ensuring compliance with governance, data security, privacy, and regulatory requirements. - Driving adoption of best practices in data engineering, cloud architecture, and DevOps for data platforms. - Collaborating with business stakeholders, data scientists, engineers, and product teams to deliver data-driven insights. - Providing technical leadership, mentoring, and guidance to engineering teams. To be successful in this role, you should have: - 10+ years of experience in data architecture, engineering, or related technical roles. - Proven expertise in the modern data stack including AWS Glue, Lambda, Kinesis, S3, and Redshift/Snowflake. - Strong programming and scripting experience with SQL and Python. - Hands-on experience with workflow orchestration tools such as Airflow, Prefect, and Step Functions. - Proficiency in Big Data technologies like Spark, PySpark, and Scala. - Solid understanding of streaming and event-driven architectures like Kafka and EventBridge/Event Bus. - Experience in data modeling, building data lakes/warehouses, a
More at Hash Agile Technologies