Cloud Data Engineer

Job Title: Cloud Engineer Location: Remote Job Type: Contract Overview Bright Tier Solutions is seeking a highly skilled Cloud Engineer with a strong background in cloud platforms like AWS, Azure, and GCP. The ideal candidate will be proficient in designing, implementing, and maintaining scalable ETL pipelines and data lakes using a variety of cloud-native tools. This role demands expertise in data platforms like Redshift, Snowflake, Databricks, and Synapse, with a focus on optimizing data ingestion and transformation processes. Familiarity with data extraction from SAP or ERP systems is a plus. Key Responsibilities: Design and Development: - Design, develop, and maintain scalable ETL pipelines using cloud-native tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, and GCP Dataflow. - Architect and implement data lakes and data warehouses on platforms such as AWS, Azure, and GCP. - Develop and optimize data ingestion, transformation, and loading processes using platforms like Databricks, Snowflake, Redshift, BigQuery, and Azure Synapse. - Implement ETL processes with tools like Informatica, SAP Data Intelligence, and others. Data Integration and Management: - Integrate various data sources including relational databases, APIs, unstructured data, and ERP systems into the data lake. - Ensure data quality and integrity through rigorous testing and validation. - Perform data extraction from SAP or ERP systems when necessary. Performance Optimization: - Monitor and optimize the performance of data pipelines and ETL processes. - Implement best practices for data governance, security, and compliance. Collaboration: - Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and design data solutions. - Partner with stakeholders to deliver high-quality, efficient cloud data solutions aligned with business needs. Documentation and Maintenance: - Document all technical solutions, processes, and workflows. - Maintain, troubleshoot, and optimize existing ETL pipelines and data integrations. Required Qualifications:

• Education: Bachelor's degree in Computer Science, Information Technology, or a related field (Advanced degrees are a plus).
• Experience: - 7+ years of experience in a Data Engineer or Cloud Engineer role. - Extensive experience with cloud platforms like AWS, Azure, and GCP. - Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc. - Proficiency in data platforms like Redshift, Snowflake, Databricks, BigQuery, and Azure Synapse. - Experience with SAP or ERP systems data extraction is a plus. - Strong experience with Spark and Scala for data processing. Key Skills:
• Strong programming skills in Python, Java, or Scala. - Proficient in SQL and query optimization techniques. - Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts. - Knowledge of data governance, security, and compliance best practices. - Excellent problem-solving, analytical, and communication skills. Preferred Qualifications:
• Experience with additional data tools and technologies such as Apache Spark or Hadoop. - Certifications in cloud platforms (e.g., AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate). - Experience with CI/CD pipelines and DevOps practices for data engineering.