Lead Engineer - AI

Position Overview We re hiring an AI Lead Engineer to architect, ship, and scale production-grade Computer Vision with a focused GenAI charter. You ll lead 6 10 ML/CV engineers to deliver high-accuracy, low-latency video analytics detection, tracking, segmentation, recognition, re-identification tackling multi-camera tracking, 24/7 streaming at scale, long-tail drift, and edge optimization on GPUs/Jetson, while partnering with Product/Platform to meet FPS, latency, accuracy, and cost SLAs. The day-to-day centers on core CV model design, training/leval, deployment, and streaming/edge performance, complemented by GenAI that amplifies the stack: integrating VLM/LLM capabilities for natural-language video search, incident summarization, operator Q&A, and copilot workflows; standing up RAG over video/sensor/metadata embeddings with robust prompts, tooling, evals, and guardrails; and driving data ops with synthetic data, auto-labeling, active-learning triage with privacy, safety, and cost controls. What You ll Own: End-to-end delivery of CV products : problem framing data/labeling model design optimization deployment monitoring iteration. Technical roadmap & architecture for video analytics pipelines (ingest decode infer track post-process store/serve). Team leadership : mentoring, hiring input, OKRs, code/research standards, and performance coaching. Key Responsibilities: Technical Leadership & Execution Translate business goals (e.g., reduce shrinkage, increase throughput, improve safety ) into measurable CV objectives and SLAs/SLOs (e.g., mAP/IDF1, per-frame latency, dropped-frame rate, cost/stream). Lead design reviews; establish MLOps and coding standards; enforce experiment tracking, reproducibility , and dataset/version governance. Drive capacity planning , GPU/Jetson utilization, batching/windowing strategy, autoscaling, and cost governance. Computer Vision R&D (Detection, Tracking, Segmentation, Recognition) Deliver production models for object detection / segmentation / classification / tracking (e.g., YOLOv8/v9, Mask R-CNN/Mask2Former, EfficientNet/ConvNeXt, ByteTrack/OC-SORT/DeepSORT ). Build person/vehicle/product re-ID , face/attribute recognition (e.g., ArcFace/CosFace), OCR (e.g., PP-OCR), and keypoint/action recognition (e.g., MMPose, SlowFast/X3D). Tackle domain adaptation, class imbalance, and occlusions; design augmentations and semi-supervised/active learning loops to harvest hard negatives. Video Analytics & Edge Inference Architect real-time pipelines using NVIDIA DeepStream/GStreamer/OpenCV ; optimize decode (NVDEC), pre/post, and trackers for 30 60 FPS at 1080p . Optimize with TensorRT/ONNX Runtime/Torch-TensorRT , INT8 calibration, pruning/distillation; leverage Jetson Orin/Xavier/Nano and DLA where applicable. Design multi-camera fusion , homography/camera calibration, and cross-camera ID consistency for retail, traffic, manufacturing, and security use cases. Implement privacy-by-design features (e.g., face/license blur , PII redaction). Generative AI & LLMs Architect robust RAG: retrieval pipelines with Pinecone/ChromaDB/Milvus; index sharding/compaction; freshness policies; hybrid search. Design agents with LangChain/LangGraph; implement tool-use, safety filters, and guardrails; add evaluation loops (e.g., RAGAS/DeepEval-style). Platform, Serving & MLOps Ship services via FastAPI/Flask ; containerize with Docker ; orchestrate on Kubernetes (KServe) or AWS SageMaker/Vertex AI . Build high-throughput inference with Triton Inference Server (dynamic batching, concurrent models, model ensembles). Streaming & storage: RTSP/RTMP ingest , Kafka/Kinesis, object storage + time-series DB; index/frame-level metadata for search and analytics. CI/CD with MLflow/DVC (artifacts, model registry), unit/integration tests, and rollout strategies (canary, shadow). Observability, Drift & Governance Production monitoring with Prometheus/Grafana ; per-stage latency, FPS, GPU memory/SM occupancy, dropped frames , and backpressure. Model observability: data/feature drift, concept drift on detections/tracks, re-ID distribution shifts, outlier/novelty detection, safety metrics. Human-in-the-loop review tools (CVAT/Label Studio) and auto-retraining triggers ; maintain model cards, evaluation reports, versioned prompts/configs, and auditability. Ensure compliance and privacy/PII handling; ONVIF/edge security best practices. Cross-Functional & People Leadership Partner with Product/SRE/DevOps on roadmaps, SLAs, incident response runbooks , and cost/perf tradeoffs. Lead and grow a 6 10 person CV team; foster a culture of high-quality experiments, rigorous reviews, and measurable impact. Communicate progress/risks to executives with clear, metric-driven updates and customer-facing results. Required Qualifications Candidate shall have a degree in B.E/B.Tech/MCA in any discipline preferable computer science 5 8 years in ML/Computer Vision with 2+ years leading 6 10 engineers delivering production video analytics. Proven track record shipping detection / tracking / segmentation / recognition systems with business impact (accuracy, latency, cost). Strong in at least one per category (and comfortable across most) : CV Frameworks: PyTorch (preferred) or TensorFlow; OpenCV, NVIDIA DeepStream/GStreamer. Serving/Runtime: Triton Inference Server, FastAPI/Flask. Optimization: TensorRT, ONNX Runtime, Torch-TensorRT; quantization / pruning / distillation; INT8 calibration. Tracking/Re-ID/OCR: ByteTrack/OC-SORT/DeepSORT; ArcFace/CosFace; PP-OCR/Tesseract. Agents & Retrieval: LangChain or LangGraph; Pinecone/ChromaDB/Milvus MLOps: Docker, Kubernetes (KServe/SageMaker/Vertex AI), MLflow/DVC. Cloud: AWS (SageMaker, EC2/EKS) or GCP (Vertex AI) or Azure ML (AKS). Programming: Python (expert); C++ or Go for perf-critical components; CUDA fundamentals a plus. Streaming/IO: RTSP/RTMP, Kafka/Kinesis/Rabbitmq; ONVIF familiarity. Strong system design (multi-stream pipelines, GPU scheduling, distributed tracking/indexing) and excellent communication. Preferred Qualifications Operating vector or time-series stores for video metadata at 10M 50M+ rows; search over tracks, IDs, and events. Experience with multi-camera tracking , calibration and zone-based analytics. Jetson fleet management. Ray/Ray Serve or Kubeflow ; feature stores (Feast); complex event processing. Domain experience in one or more: retail analytics , traffic/ADAS , manufacturing QA , security/safety , sports analytics . Open-source contributions, patents, or publications in CV/video analytics. (Nice to have) Multimodal exposure CLIP/SigLIP, SAM/Mask2Former, or VLMs for captioning/search used sparingly to support CV workflows. About Company Hi there! We are Auriga IT. We power businesses across the globe through digital experiences, data and insights. From the apps we design to the platforms we engineer, were driven by an ambition to create world-class digital solutions and make an impact. Our team has been part of building the solutions for the likes of Zomato, Yes Bank, Tata Motors, Amazon, Snapdeal, Ola, Practo, Vodafone, Meesho, Volkswagen, Droom and many more. We are a group of people who just could not leave our college-life behind and the inception of Auriga was solely based on a desire to keep working together with friends and enjoying the extended college life. Who Has not Dreamt of Working with Friends for a Lifetime Come Join In! Our Website