Source description
About the role
As a Data Engineer at our company, you will play a crucial role in designing, developing, and optimizing enterprise-scale data solutions. Your responsibilities will include: - Designing and implementing scalable modern data architectures across cloud and hybrid ecosystems. - Building, optimizing, and maintaining high-performance ETL/ELT pipelines for structured and unstructured data. - Leading enterprise data modernization initiatives using advanced cloud and big data technologies. - Developing real-time and streaming data solutions for analytics and machine learning workloads. - Designing and implementing REST APIs, Azure App Services, and Azure PaaS-based integrations. - Ensuring data governance, security, compliance, and lineage standards are properly implemented. - Collaborating with Data Science, BI, Product, and Engineering teams to ensure reliable and high-quality data availability. - Driving DataOps and DevOps best practices including CI/CD, automated deployments, monitoring, and testing. - Evaluating emerging technologies and recommending innovative solutions to improve scalability and efficiency. - Translating complex business requirements into scalable and maintainable technical solutions. - Mentoring and guiding data engineers and technical teams on architecture and best practices. Qualifications required for this role: - Bachelors or Masters degree in Computer Science, Engineering, or related field. - 4+ years of experience in Data Engineering, Data Architecture, or related domains. - Strong expertise in Python, SQL, Apache Spark, Kafka, and Airflow. - Hands-on experience with cloud platforms such as Azure, AWS, or GCP. - Experience working with Snowflake, Databricks, Delta Lake, or similar modern data platforms. - Strong understanding of data modeling, metadata management, governance, and lineage concepts. - Experience designing scalable data lakes, warehouses, and distributed processing systems. - Excellent analytical, problem-solving, communication, and leadership skills. - Experience working in Agile development environments. Good to have skills include: - C#, .NET Core, and Entity Framework Core. - Azure PaaS and Azure Integration Services (iPaaS). - REST API development and microservices architecture. - Blazor UI development experience. - Knowledge of design patterns and cloud security best practices. - Exposure to CI/CD pipelines and infrastructure automation tools. As a Data Engineer at our company, you will play a crucial role in designing, developing, and optimizing enterprise-scale data solutions. Your responsibilities will include: - Designing and implementing scalable modern data architectures across cloud and hybrid ecosystems. - Building, optimizing, and maintaining high-performance ETL/ELT pipelines for structured and unstructured data. - Leading enterprise data modernization initiatives using advanced cloud and big data technologies. - Developing real-time and streaming data solutions for analytics and machine learning workloads. - Designing and implementing REST APIs, Azure App Services, and Azure PaaS-based integrations. - Ensuring data governance, security, compliance, and lineage standards are properly implemented. - Collaborating with Data Science, BI, Product, and Engineering teams to ensure reliable and high-quality data availability. - Driving DataOps and DevOps best practices including CI/CD, automated deployments, monitoring, and testing. - Evaluating emerging technologies and recommending innovative solutions to improve scalability and efficiency. - Translating complex business requirements into scalable and maintainable technical solutions. - Mentoring and guiding data engineers and technical teams on architecture and best practices. Qualifications required for this role: - Bachelors or Masters degree in Computer Science, Engineering, or related field. - 4+ years of experience in Data Engineering, Data Architecture, or related domains. - Strong expertise in Python, SQL, Apache Spark, Kafka, and Airflow. - Hands-on experience with cloud platforms such as Azure, AWS, or GCP. - Experience working with Snowflake, Databricks, Delta Lake, or similar modern data platforms. - Strong understanding of data modeling, metadata management, governance, and lineage concepts. - Experience designing scalable data lakes, warehouses, and distributed processing systems. - Excellent analytical, problem-solving, communication, and leadership skills. - Experience working in Agile development environments. Good to have skills include: - C#, .NET Core, and Entity Framework Core. - Azure PaaS and Azure Integration Services (iPaaS). - REST API development and microservices architecture. - Blazor UI development experience. - Knowledge of design patterns and cloud security best practices. - Exposure to CI/CD pipelines and infrastructure automation tools.
More at Big Ideas Social Media Recruitment