Source description
About the role
Design and implement scalable, reliable, and secure data architectures. Develop best practices and frameworks for data integration, governance, and security. Define and drive the roadmap for enterprise data solutions aligned with business objectives. Architect, build, and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and PySpark. Work with SQL and big data technologies to ensure efficient data processing and storage. Design and manage data lakes, data warehouses, and cloud-based storage solutions. Implement cloud-based data solutions, primarily using Microsoft Azure (Azure Data Factory, Azure Synapse, Azure Databricks). Ensure cost-effective and high-performance cloud solutions for data processing and analytics. Lead and mentor a team of data engineers, ensuring adherence to best practices. Collaborate with stakeholders, including data analysts, business leaders, and software engineers, to define and implement data-driven solutions. Provide technical guidance and architectural direction for complex projects. Ensure high availability, scalability, and performance of data systems. Implement data security policies and ensure compliance with industry standards (GDPR, HIPAA, etc.). Optimize data storage and retrieval for maximum efficiency and cost savings . Requirements Proven experience in designing and implementing large-scale data solutions. SQL: Advanced skills in query optimization and database management. PySpark: Strong experience in data transformation and processing. Databricks: Hands-on experience in big data frameworks and analytics. Azure Data Factory (ADF): Expertise in orchestrating ETL/ELT pipelines. Cloud Platforms: Strong experience with Azure (preferred), AWS, or GCP. Data Warehousing: Deep understanding of data modeling, data lakes, and data warehouse architectures. Solution Architecture: Ability to design end-to-end data solutions for enterprises. Strong leadership and team management skills. Excellent problem-solving and analytical thinking. Effective communication and stakeholder management. Ability to work in a fast-paced and dynamic environment.
More at InFynd