Big Data Engineer (AWS)

As an AWS-Scala Data Engineer at our company, you will play a crucial role in designing, building, and maintaining scalable data pipelines and solutions on AWS. Your responsibilities will include: - Designing and implementing robust, scalable, and high-performance data pipelines on AWS. - Developing and maintaining ETL workflows using Airflow. - Writing efficient and optimized code in Python for data processing and transformation. - Working with SQL to query, manipulate, and analyze large datasets. - Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders. - Ensuring data quality, integrity, and security across all data platforms. - Monitoring and troubleshooting data pipeline performance and reliability. To excel in this role, you must possess the following mandatory skills: - Extensive AWS experience (minimum 4 years) including services like S3, Lambda, Glue, Redshift, EMR, etc. - Scala strong programming skills for data manipulation and automation. - SQL advanced querying and optimization techniques. Preferred qualifications that would be beneficial for this position include: - Experience with big data technologies (e.g., Spark, Hadoop). - Familiarity with CI/CD pipelines and DevOps practices. - Knowledge of data warehousing concepts and tools. If you are passionate about cloud-based data engineering and have the required skills and experience, we encourage you to share your resume with us at [HIDDEN TEXT]. Join our dynamic team and make a significant impact with your expertise in AWS-Scala data engineering. As an AWS-Scala Data Engineer at our company, you will play a crucial role in designing, building, and maintaining scalable data pipelines and solutions on AWS. Your responsibilities will include: - Designing and implementing robust, scalable, and high-performance data pipelines on AWS. - Developing and maintaining ETL workflows using Airflow. - Writing efficient and optimized code in Python for data processing and transformation. - Working with SQL to query, manipulate, and analyze large datasets. - Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders. - Ensuring data quality, integrity, and security across all data platforms. - Monitoring and troubleshooting data pipeline performance and reliability. To excel in this role, you must possess the following mandatory skills: - Extensive AWS experience (minimum 4 years) including services like S3, Lambda, Glue, Redshift, EMR, etc. - Scala strong programming skills for data manipulation and automation. - SQL advanced querying and optimization techniques. Preferred qualifications that would be beneficial for this position include: - Experience with big data technologies (e.g., Spark, Hadoop). - Familiarity with CI/CD pipelines and DevOps practices. - Knowledge of data warehousing concepts and tools. If you are passionate about cloud-based data engineering and have the required skills and experience, we encourage you to share your resume with us at [HIDDEN TEXT]. Join our dynamic team and make a significant impact with your expertise in AWS-Scala data engineering.