Senior Data Engineer

Role Overview: As a Data Engineer at GEP, you will be joining a dynamic team of data scientists and software engineers. Your main responsibility will be to expand and optimize the data and data pipeline architecture, ensuring optimal data flow and collection for cross-functional teams. You will collaborate with software developers, data architects, and data scientists on various data initiatives, ensuring consistent data delivery architecture throughout ongoing projects. Additionally, you will work closely with data scientists and cross-functional teams to build new products or product features, including interesting machine learning productization areas. You will also be responsible for managing timely and quality deliverables through Agile or Iterative development processes and collaborating with the existing technology team to leverage current technology components available under existing products. Your role will involve conceptualizing, designing, and implementing modules within individual products. Key Responsibilities: - At least 3 years of relevant experience in data engineering - Strong analytical skills related to working with unstructured datasets - Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of databases - Experience in building and optimizing 'big data' data pipelines, architectures, and data sets - Building processes supporting data transformation, data structures, metadata, dependency, and workload management - Experience in manipulating, processing, and extracting value from large disconnected datasets - Experience with big data tools such as Hadoop, Spark, Kafka, etc. - Experience with both relational SQL and NoSQL databases - Experience with object-oriented/object function scripting languages, such as Python, Java, etc. Qualifications Required: - At least 3 years of relevant experience in data engineering - Strong analytical skills and experience working with unstructured datasets - Advanced working knowledge of SQL and relational databases - Experience in building and optimizing 'big data' data pipelines - Proficiency in big data tools like Hadoop, Spark, Kafka - Familiarity with both relational SQL and NoSQL databases - Proficiency in object-oriented/object function scripting languages like Python, Java (Note: No additional details about the company were present in the job description) Role Overview: As a Data Engineer at GEP, you will be joining a dynamic team of data scientists and software engineers. Your main responsibility will be to expand and optimize the data and data pipeline architecture, ensuring optimal data flow and collection for cross-functional teams. You will collaborate with software developers, data architects, and data scientists on various data initiatives, ensuring consistent data delivery architecture throughout ongoing projects. Additionally, you will work closely with data scientists and cross-functional teams to build new products or product features, including interesting machine learning productization areas. You will also be responsible for managing timely and quality deliverables through Agile or Iterative development processes and collaborating with the existing technology team to leverage current technology components available under existing products. Your role will involve conceptualizing, designing, and implementing modules within individual products. Key Responsibilities: - At least 3 years of relevant experience in data engineering - Strong analytical skills related to working with unstructured datasets - Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of databases - Experience in building and optimizing 'big data' data pipelines, architectures, and data sets - Building processes supporting data transformation, data structures, metadata, dependency, and workload management - Experience in manipulating, processing, and extracting value from large disconnected datasets - Experience with big data tools such as Hadoop, Spark, Kafka, etc. - Experience with both relational SQL and NoSQL databases - Experience with object-oriented/object function scripting languages, such as Python, Java, etc. Qualifications Required: - At least 3 years of relevant experience in data engineering - Strong analytical skills and experience working with unstructured datasets - Advanced working knowledge of SQL and relational databases - Experience in building and optimizing 'big data' data pipelines - Proficiency in big data tools like Hadoop, Spark, Kafka - Familiarity with both relational SQL and NoSQL databases - Proficiency in object-oriented/object function scripting languages like Python, Java (Note: No additional details about the company were present in the job description)