AI Data Architect

Premium Recruitment Pack Senior AI Data Platform Engineer / AI Data Architect AI Factory Specialist AI Platform Engineering Team Location: Chennai, India (Offshore) | Opportunity to Relocate to the UK after 12 Months (subject to business needs, performance and immigration requirements). About the AI Factory We are building a next-generation Enterprise AI Factory focused on sovereign, secure and open-source AI platforms. Our engineering culture combines semantic intelligence, metadata-driven governance, Agentic AI, knowledge engineering and enterprise architecture to deliver trusted AI for regulated industries. The Opportunity Based in Chennai, you will join a niche specialist AI Platform Engineering team working directly with UK architects on strategic platform development. This is a long-term career opportunity with structured mentoring, ownership of key platform components and potential relocation to the UK after approximately 12 months. Role Summary Design and build the trusted data foundation for Agentic AI, RAG, GraphRAG, metadata governance, AI evaluation, model quality and enterprise analytics. This is a platform engineering role rather than a traditional ETL position. Key Responsibilities Design and build the data lakehouse foundation (Apache Iceberg), refining raw data through layered, medallion-style zones into curated gold datasets. Write custom ingestion connectors and pipelines for many heterogeneous sources batch, streaming and change-data-capture across APIs, files, databases and unstructured data, using Python and Go for high-throughput services (Airbyte, Kafka, Debezium). Implement metadata-first governance, lineage, data quality and privacy/PII controls for regulated industries (OpenMetadata, Great Expectations, Presidio). Build the semantic and knowledge layer vector, graph and knowledge stores with RAG/GraphRAG retrieval pipelines (chunking, embeddings, re-ranking). Engineer features, transformations and training/evaluation datasets, and maintain a feature store, to produce analytics- and AI-ready data products (Feast). Expose governed, agent-ready gold-layer data for Agentic AI and MCP-based services to consume reliably. Research emerging open-source technologies and collaborate closely with AI Architects, ML and Platform Engineers. About You Strong software engineering background with production experience in Python and SQL. Experience building data platforms or pipelines at scale (Spark, Kafka, containerised workloads). Experience designing layered data lakes or lakehouses (medallion / bronzesilvergold architectures). Familiarity with metadata, governance or data-quality tooling such as OpenMetadata or Great Expectations. Comfortable building bespoke connectors and integrations for varied source systems, protocols and data formats. Exposure to AI/ML data workflows RAG, vector or graph databases, or model evaluation (desirable). Comfortable in an open-source-first, cloud-native environment (Docker, Kubernetes, Linux). Working knowledge of Go is a plus particularly for high-throughput ingestion connectors, streaming services and MCP/Kubernetes-native tooling (desirable). A collaborative, continuous-learning mindset and clear communication with distributed, international teams. Technology Stack Python, SQL, Go, Spark, Docker, Kubernetes, Linux, PostgreSQL, MongoDB, Redis, ClickHouse, OpenMetadata, Airbyte, Kafka, Debezium, Qdrant, Chroma, FalkorDB, Neo4j, LangChain, LangGraph, MCP, MLflow, Kubeflow, Great Expectations, Evidently AI, Presidio, Feast and Apache Iceberg. Engineering Principles Metadata-first Semantic intelligence Open-source first API-first Secure by design Automation Scalability Observability Continuous learning 30/60/90 Day Expectations 30 Days: Learn the platform and contribute to core data engineering. 60 Days: Deliver metadata pipelines and AI data quality capabilities. 90 Days: Lead platform enhancements, optimise semantic data services and contribute to architecture decisions. Why Join Us Influence a next-generation AI platform, work on cutting-edge open-source technologies, collaborate internationally, and build enterprise AI capabilities with genuine opportunities for career progression and international mobility. Premium Recruitment Pack Senior AI Data Platform Engineer / AI Data Architect AI Factory Specialist AI Platform Engineering Team Location: Chennai, India (Offshore) | Opportunity to Relocate to the UK after 12 Months (subject to business needs, performance and immigration requirements). About the AI Factory We are building a next-generation Enterprise AI Factory focused on sovereign, secure and open-source AI platforms. Our engineering culture combines semantic intelligence, metadata-driven governance, Agentic AI, knowledge engineering and enterprise architecture to deliver trusted AI for regulated industries. The Opportunity Based in Chennai, you will joi