Source description
About the role
As a Data Engineer with hands-on experience in graph databases, your role will involve designing, building, and optimizing data pipelines and knowledge graph solutions to power advanced analytics and discovery. You will collaborate with data scientists, platform engineers, and product teams to model complex domains, integrate heterogeneous sources, and deliver queryable, scalable graph data products. Responsibilities: - Graph Data Modeling & Design: - Design and implement property graphs and RDF/OWL-based knowledge graphs. - Develop schemas/ontologies, entity resolution, and lineage strategies; define best practices for graph modeling, naming, and versioning. - Data Engineering & Integration: - Build and maintain ETL/ELT pipelines to ingest, cleanse, transform, and load data into graph stores from APIs, files, RDBMS, event streams. - Implement batch and streaming integrations using tools such as Airflow, dbt, Kafka/Kinesis, Spark/Flink. - Optimize data quality, deduplication, key management, and incremental upserts into graphs. - Querying & APIs: - Write advanced queries in Cypher, Gremlin, and/or SPARQL; tune queries and indexes for performance. - Expose graph capabilities via APIs/services (REST/GraphQL/GRANDstack) with robust governance, observability, and caching. - Performance, Reliability & Security: - Capacity planning, clustering, backups, and high availability for graph databases. - Monitoring/alerting (e.g., Prometheus/Grafana, CloudWatch), profiling, and query plan analysis. - Apply security best practices: encryption, RBAC/ABAC, least privilege, secrets management, and data masking/PII handling. Skills Must Have: - Experience: 6 years in Data Engineering (or similar) with 2+ years focused on graph databases (property graph and/or RDF). - Graph DBs: Hands-on with at least one of: - Property Graph: Neo4j, AWS Neptune (Gremlin/Cypher). - RDF Triple Stores: Ontotext GraphDB, Apache Jena/Fuseki, Blazegraph, Stardog, Neptune (RDF). - Query Languages: Strong in Cypher and/or Gremlin; SPARQL if working with RDF/OWL. - Data Pipelines: Proficient with Airflow (or similar), Kafka/Kinesis, Spark or Flink; building robust ETL/ELT at scale. - Programming: Python (dataframes, APIs, CLI tooling); solid testing practices (pytest/pytest-bdd). - Cloud: Experience with AWS managed graph/datastores, storage, compute, and networking basics. - Performance & Ops: Indexing, memory/GC tuning, query plan analysis, partitioning/sharding concepts, HA/DR, backup/restore. - Security & Governance: Secrets management, IAM, network isolation, PII compliance; familiarity with data catalog/lineage tools. - Communication: Ability to translate domain knowledge into graph models and explain trade-offs to non-technical stakeholders. Nice to Have: - Knowledge Graphs & Semantics: RDFS, SHACL, ontology engineering, reasoning/inference, vocabulary alignment (SKOS). - Graph Algorithms & Embeddings: Neo4j Graph Data Science, NetworkX, PyTorch Geometric, vector DB integration. - Graph + Search: Integration with Elasticsearch/OpenSearch, hybrid search (BM25 + embeddings). - Data Modeling: Experience migrating from relational to graph; CDC patterns (Debezium), event-driven architectures. - Observability: OpenTelemetry, tracing for data services; data quality frameworks (Great Expectations). - Delivery: Experience with productizing graph APIs, caching layers, SLA/SLO management. - Regulatory: Familiarity with GDPR/CCPA, data retention, sovereignty considerations. In addition, proficiency in English at C1 Advanced level is required for this role. This job is suitable for individuals with a senior level of experience. As a Data Engineer with hands-on experience in graph databases, your role will involve designing, building, and optimizing data pipelines and knowledge graph solutions to power advanced analytics and discovery. You will collaborate with data scientists, platform engineers, and product teams to model complex domains, integrate heterogeneous sources, and deliver queryable, scalable graph data products. Responsibilities: - Graph Data Modeling & Design: - Design and implement property graphs and RDF/OWL-based knowledge graphs. - Develop schemas/ontologies, entity resolution, and lineage strategies; define best practices for graph modeling, naming, and versioning. - Data Engineering & Integration: - Build and maintain ETL/ELT pipelines to ingest, cleanse, transform, and load data into graph stores from APIs, files, RDBMS, event streams. - Implement batch and streaming integrations using tools such as Airflow, dbt, Kafka/Kinesis, Spark/Flink. - Optimize data quality, deduplication, key management, and incremental upserts into graphs. - Querying & APIs: - Write advanced queries in Cypher, Gremlin, and/or SPARQL; tune queries and indexes for performance. - Expose graph capabilities via APIs/services (REST/Gr
More at Luxoft