Source description
About the role
As a highly skilled Big Data Engineer specializing in cloud technologies, your role will involve designing, developing, and maintaining scalable big data solutions. You will be responsible for ensuring efficient data processing, storage, and analytics by working with distributed systems, cloud platforms, and modern data frameworks to support real-time and batch data pipelines. Key Responsibilities: - Design, implement, and manage scalable big data architectures on AWS, Azure, or GCP. - Develop ETL pipelines for ingesting, processing, and transforming large datasets. - Work with Python, Apache Spark, Hadoop, and Kafka to build efficient data processing solutions. - Implement data lakes, data warehouses, and streaming architectures. - Optimize database and query performance for large-scale datasets. - Collaborate with Subject Matter Experts (SMEs), Clients, and software engineers to deliver content. - Ensure data security, governance, and compliance with industry standards. - Automate workflows using Apache Airflow or other orchestration tools. - Monitor and troubleshoot data pipelines to ensure reliability and scalability. No additional details about the company were provided in the job description. As a highly skilled Big Data Engineer specializing in cloud technologies, your role will involve designing, developing, and maintaining scalable big data solutions. You will be responsible for ensuring efficient data processing, storage, and analytics by working with distributed systems, cloud platforms, and modern data frameworks to support real-time and batch data pipelines. Key Responsibilities: - Design, implement, and manage scalable big data architectures on AWS, Azure, or GCP. - Develop ETL pipelines for ingesting, processing, and transforming large datasets. - Work with Python, Apache Spark, Hadoop, and Kafka to build efficient data processing solutions. - Implement data lakes, data warehouses, and streaming architectures. - Optimize database and query performance for large-scale datasets. - Collaborate with Subject Matter Experts (SMEs), Clients, and software engineers to deliver content. - Ensure data security, governance, and compliance with industry standards. - Automate workflows using Apache Airflow or other orchestration tools. - Monitor and troubleshoot data pipelines to ensure reliability and scalability. No additional details about the company were provided in the job description.