Prompt AI Chatbot Engineer

Prompt AI Chatbot Engineer

CVS

Onsite role in Hartford, CT MUST BE LOCAL

USC, GC or GC EAD ONLY

PLEASE ENSURE TO PROVIDE ID WITH SUBMISSION ALONG WITH LINKED IN PROFILE. LINKED IN MUST BE UP TO DATE AND HAVE PHOTO OF THE CANDIDATE INCLUDING THE CORRECT LOCATION AND MATCH RESUME

Position Summary

The Aetna IT Delivery organization, part of CVS Health's Data, Digital, Analytics, Technology (DDAT) division, is seeking a skilled and innovative Prompt Engineer to join our AI development team. This role focuses on crafting and optimizing prompts for a conversational AI chatbot that supports healthcare members and providers in accessing accurate, timely information.

Key Responsibilities

Develop and iterate on prompt strategies for LLM-based agents

Ensure prompts are contextually accurate, domain-specific, and aligned with end user (member or provider) needs.

Collaborate with healthcare SMEs, developers, and product teams to build effective conversational flows.

Analyze chatbot performance and iterate on prompt strategies using user feedback and analytics.

Maintain prompt libraries and documentation for healthcare use cases (e.g., benefits, claims, coverage).

Ensure compliance with HIPAA and other healthcare data privacy regulations.

Work closely with designers, engineers, and data scientists to align prompt design with conversational flows

Conduct A/B testing and usability studies to enhance chatbot interactions.

Required Qualifications

Bachelor's or Master's degree in Computer Science, Linguistics, AI/ML, or related field.

2+ years of experience in working with LLMs, prompt engineering and tuning techniques

Experience with IBM Watsonx or Google Dialogflow / Vertex AI.

Strong understanding of healthcare terminology and workflows.

Proficiency in Python and version control systems (e.g., Git).

Excellent communication and analytical skills.

Preferred Qualifications & Programming Languages

• Experience with agentic AI architectures and multi-agent orchestration.

• Knowledge of retrieval-augmented generation (RAG) and vector databases.

• Experience in healthcare provider or payer environments.

• Familiarity with regulatory frameworks (HIPAA, HITECH).

• Experience with chatbot analytics and UX testing tools.

• Python – for scripting, data analysis, and integration with AI platforms.

• JavaScript/TypeScript – for chatbot front-end and middleware development.

• Node.js – for backend services and API integration.

• Java – especially for IBM Watson integrations.

• Go or Kotlin – for scalable microservices (optional but beneficial).

• Education

• Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience required.