Source description
About the role
As a Senior Data Platform Engineer at NationsBenefits, you will be responsible for implementing and maintaining the data platform infrastructure. You will work closely with the Principal Data Platform Engineer to ensure the reliability and efficiency of our data ecosystem. Your role will involve executing platform improvements, providing technical guidance to data engineering teams, and contributing to the overall platform's performance and reliability. Key Responsibilities: - Implement and maintain data platform infrastructure using Terraform, Azure services, and our broader technology stack - Work with the Principal Data Platform Engineer on strategic platform improvements and architectural initiatives - Maintain and optimize Databricks environments, including cluster configurations, job scheduling, and performance tuning - Provide technical guidance and best practices to data engineering teams - Monitor platform performance and reliability, proactively identifying and resolving infrastructure issues - Collaborate with teams to troubleshoot platform-related issues and optimize their use of Azure data services - Support the implementation of compliance requirements (HIPAA) across the data platform - Contribute to platform documentation, runbooks, and best practice guides - Work with DevOps teams to implement CI/CD pipelines for data platform components - Participate in on-call rotations to ensure platform availability and reliability Qualifications Required: - 5-7 years of data platform or infrastructure engineering experience with hands-on expertise in cloud platforms - Strong proficiency in Azure services such as Databricks, SQL Server, EventHub, and Storage - Experience with Infrastructure as Code (Terraform) and version control (Git) for platform management - Hands-on experience with Databricks administration, including cluster management and job optimization - Knowledge of data platform architectures and experience maintaining large-scale data infrastructure - Strong understanding of Python and SQL for platform automation and troubleshooting - Experience with monitoring and alerting systems for data platform reliability - Familiarity with compliance requirements and security best practices in cloud environments - Excellent communication skills and ability to guide teams on technical best practices In summary, as a Senior Data Platform Engineer at NationsBenefits, you will play a crucial role in maintaining and improving the data platform infrastructure to support millions of members nationwide. Your expertise in cloud platforms, infrastructure management, and data engineering will be essential in ensuring the reliability and efficiency of our data ecosystem. As a Senior Data Platform Engineer at NationsBenefits, you will be responsible for implementing and maintaining the data platform infrastructure. You will work closely with the Principal Data Platform Engineer to ensure the reliability and efficiency of our data ecosystem. Your role will involve executing platform improvements, providing technical guidance to data engineering teams, and contributing to the overall platform's performance and reliability. Key Responsibilities: - Implement and maintain data platform infrastructure using Terraform, Azure services, and our broader technology stack - Work with the Principal Data Platform Engineer on strategic platform improvements and architectural initiatives - Maintain and optimize Databricks environments, including cluster configurations, job scheduling, and performance tuning - Provide technical guidance and best practices to data engineering teams - Monitor platform performance and reliability, proactively identifying and resolving infrastructure issues - Collaborate with teams to troubleshoot platform-related issues and optimize their use of Azure data services - Support the implementation of compliance requirements (HIPAA) across the data platform - Contribute to platform documentation, runbooks, and best practice guides - Work with DevOps teams to implement CI/CD pipelines for data platform components - Participate in on-call rotations to ensure platform availability and reliability Qualifications Required: - 5-7 years of data platform or infrastructure engineering experience with hands-on expertise in cloud platforms - Strong proficiency in Azure services such as Databricks, SQL Server, EventHub, and Storage - Experience with Infrastructure as Code (Terraform) and version control (Git) for platform management - Hands-on experience with Databricks administration, including cluster management and job optimization - Knowledge of data platform architectures and experience maintaining large-scale data infrastructure - Strong understanding of Python and SQL for platform automation and troubleshooting - Experience with monitoring and alerting systems for data platform reliability - Familiarity with compliance requirements and security best practices in cloud environments - Excelle
More at NationsBenefits