Senior Consultant - Data Scientist

Job Description: Required Qualifications & Skills: Technical Skills: - Programming: Expert proficiency in Python and deep familiarity with asynchronous programming. - Deep Learning Frameworks: Extensive experience with PyTorch (preferred) or TensorFlow. - GenAI Stack: Hands-on experience with Hugging Face ecosystem (Transformers, Accelerate, PEFT, Diffusers) and LangChain or LlamaIndex. - Inference Optimization: Practical knowledge of quantization methods and high-throughput serving frameworks (e.g., vLLM). - Infrastructure: Proficiency with Docker, Kubernetes, and cloud platforms (AWS, GCP, or Azure) specifically for GPU-accelerated workloads. - Math & Theory: Strong foundation in linear algebra, probability, and the mathematical mechanics of Transformer architectures. Roles & Responsibilities: 1. Generative AI Development: - Work with various model architectures (Transformer-based, Diffusion models, etc.) to solve complex business problems. - Evaluate model performance using specialized metrics (Perplexity, BLEU, ROUGE, or custom LLM-as-a-judge frameworks). 2. AI Inference Engineering: - Optimize model architectures for efficient deployment, focusing on reducing latency and memory footprint. - Implement inference optimization techniques including Quantization (GGUF, AWQ, GPTQ), Pruning, and Knowledge Distillation. - Utilize high-performance inference engines and frameworks such as TensorRT, vLLM, ONNX Runtime, or DeepSpeed-Inference. - Design scalable serving infrastructures using tools like NVIDIA Triton Inference Server, BentoML, or Ray Serve. - Optimize GPU utilization and memory management for large-scale model serving. 3. Data & Model Lifecycle: - Curate and preprocess large-scale datasets for pre-training, fine-tuning, and RLHF (Reinforcement Learning from Human Feedback). - Build automated pipelines for model evaluation and continuous monitoring of production models (detecting drift or hallucinations). - Collaborate with ML Engineers to integrate models into scalable microservices. Role: IT & Information Security - Other Education: - UG: Any Graduate .