Source description
About the role
Data Engineer Working on top of worldwide research content, actions & knowledge, our Information Discovery, Machine Learning & Data Engineering teams explore new ideas and develop novel, AI-powered solutions which help publishers & researchers to know more, do more & achieve more. At the same time, our goal is to highlight low-quality research and ensure research (data) integrity identifying signals of potential research misconduct. We are looking for a talented and self-directed Data Engineer to work on the following areas Information Retrieval, Semantic Search, Recommendation services (on top of Elasticsearch also leveraging LLMs/Embeddings and GenerativeAI) Large scale distributed data processing (based on Apache Spark / Scala) Streaming data processing (based on Google DataFlow/ApacheBeam) Senior-level ML engineers are preferred, but all levels may apply. Requirement Military obligations fulfilled for male candidates How you will make an impact Work cross-functionally collaborating with AI/ML engineers and product management to develop AI-powered, highly efficient data & search solutions on all the above-mentioned areas. Design, build, orchestrate, and scale various streaming or batch processing data pipelines utilizing optimal patterns, technologies and frameworks. Be comfortable navigating the following technologies and programming languages Java, Python, Scala, ElasticSearch, Apache Spark, Spring Boot, Apache Beam, Airflow etc. What we look for Minimum Qualifications MSc with strong GPA in Computer Science/ Engineering 2+ years of work experience in data, backend and/or search engineering Solid background and experience in CS and S/W development (especially in backend development, databases etc) Experience with Java (and/or Python) backend APIs / development frameworks also supporting long running tasks (e.g., Spring Boot, FastAPI), microservices architecture, IoC/DI patterns and containerization. Strong Engineering Skills And Experience In Java Background and experience with (at least one) of the following technologies Lucene-based search Engines (e.g., ElasticSearch) Distributed Data Processing using ApacheSpark (preferably in Scala)
More at Virtusa