Data Engineer

As a Data Engineer at the company, you play a crucial role as the foundation of the AI CoE. Your primary responsibility is to build and maintain robust, scalable, and efficient data pipelines to provide clean, reliable data to data scientists and ML models. Your expertise ensures that data is easily accessible, well-organized, and of the highest quality. Key Responsibilities: - Design, construct, install, and maintain large-scale data processing systems and data lakes/warehouses. - Build scalable and reliable ETL/ELT pipelines to ingest data from diverse sources. - Ensure data quality and implement data governance and security standards. - Collaborate closely with Data Scientists to comprehend data requirements for modeling. - Optimize data systems for enhanced performance and cost efficiency. - Work collaboratively with data architecture on data modeling and schema design. Qualifications: - Hold a Bachelors or Masters degree in Computer Science or a related field. - Possess 3+ years of experience in a Data Engineer role. - Demonstrate expert-level proficiency in SQL and hands-on experience with big data technologies like Spark, Hadoop, and Kafka. - Exhibit strong programming skills in Python, Scala, or Java. - Have practical experience with cloud data services such as AWS Redshift/S3, Azure Synapse/Data Lake, and GCP BigQuery. - Knowledgeable about data modeling and data warehousing concepts. Please note the above qualifications and responsibilities are based on the provided job description. As a Data Engineer at the company, you play a crucial role as the foundation of the AI CoE. Your primary responsibility is to build and maintain robust, scalable, and efficient data pipelines to provide clean, reliable data to data scientists and ML models. Your expertise ensures that data is easily accessible, well-organized, and of the highest quality. Key Responsibilities: - Design, construct, install, and maintain large-scale data processing systems and data lakes/warehouses. - Build scalable and reliable ETL/ELT pipelines to ingest data from diverse sources. - Ensure data quality and implement data governance and security standards. - Collaborate closely with Data Scientists to comprehend data requirements for modeling. - Optimize data systems for enhanced performance and cost efficiency. - Work collaboratively with data architecture on data modeling and schema design. Qualifications: - Hold a Bachelors or Masters degree in Computer Science or a related field. - Possess 3+ years of experience in a Data Engineer role. - Demonstrate expert-level proficiency in SQL and hands-on experience with big data technologies like Spark, Hadoop, and Kafka. - Exhibit strong programming skills in Python, Scala, or Java. - Have practical experience with cloud data services such as AWS Redshift/S3, Azure Synapse/Data Lake, and GCP BigQuery. - Knowledgeable about data modeling and data warehousing concepts. Please note the above qualifications and responsibilities are based on the provided job description.