Source description
About the role
DataHub Developer / Streaming Data Engineer – Join Our Team .job-posting-container {font-family: Arial, sans-serif; line-height: 1.6; color: #333; margin: 0; padding: 20px; background-color: #ffffff; box-sizing: border-box;} .job-posting-container * {box-sizing: border-box;} .job-posting-content {background-color: #ffffff; padding: 30px; max-width: 800px; margin: 0 auto; box-shadow: 0 0 10px rgba(0,0,0,0.1); border-radius: 10px;} .job-posting-container h1, .job-posting-container h2 {color: #004080; margin: 15px 0;} .job-posting-container h1 {font-size: 22px;} .job-posting-container h2 {font-size: 20px; border-bottom: 1px solid #ccc; padding-bottom: 5px; margin-top: 30px;} .job-posting-container ul {margin-left: 20px;} .job-posting-container .section {margin-bottom: 25px;} .job-posting-container .highlight {background-color: #eef6ff; padding: 15px; border-left: 4px solid #004080; margin-bottom: 15px; border-radius: 5px;} .job-posting-container strong {color: #333;} .job-posting-container li {margin-bottom: 8px;} DataHub Developer / Streaming Data Engineer Remote Position | Employment Type: CTC, W2 | Experience Required: 6+ years | Pay Rate: $65/hour Position Summary We are seeking a DataHub Developer to own the operation, maintenance, and ongoing improvement of an event streaming data integration platform that supports a large-scale case management system. This platform enables secure, near real-time data sharing between our organization and multiple external partner systems. The role owns the Kafka-based event pipeline, including ingestion, schema validation, enrichment, and distribution, and leads a planned migration from a self-managed Kafka cluster to a managed streaming service on AWS. This is a data engineering and cloud infrastructure role, distinct from application or business process automation development, and the person in this role will serve as the primary technical point of contact for onboarding new data sharing partners and resolving integration issues. Why Join Us? Work on mission-critical systems supporting large-scale case management operations Lead strategic technology migrations to modern cloud-native platforms Collaborate with external partners on secure, real-time data integration solutions Opportunity to shape the future of enterprise event streaming architecture Key Responsibilities Design, implement, and maintain Apache Kafka topics, partitions, and consumer groups with exactly-once semantics Lead migration from self-managed Kafka to AWS Managed Streaming for Kafka (MSK) including MSK Connect configuration Develop and maintain Kafka Connect connectors for data ingestion, transformation, and distribution across hybrid cloud environments Implement schema validation, versioning, and event enrichment/denormalization processes Build and optimize ETL pipelines integrating with S3 data lakes and analytics platforms Configure monitoring, alerting, and observability tooling for production streaming services Collaborate with security teams on Login.gov/SSO federation and encryption standards Qualifications Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience) 6+ years of experience in data engineering, systems integration, or streaming-platform development Hands-on production experience with Apache Kafka including topic design, consumer groups, and Kafka Connect Direct experience migrating self-managed Kafka to AWS MSK or equivalent managed-service migration Experience working across hybrid cloud environments (Azure and AWS) in integrated architectures Proficiency with relational databases (Oracle preferred) including SQL and PL/SQL development Experience with data lake/analytics integration patterns (S3, ETL pipelines) and BI tools (Tableau preferred) Strong programming skills in Java, Python, Node.js/JavaScript, and GraphQL Experience with infrastructure-as-code (Terraform, CloudFormation), CI/CD pipelines, and monitoring tools Familiarity with JIRA and Confluence for agile project management Ready to Apply? Take the next step in your career with this exciting opportunity to work on cutting-edge streaming data technologies in a mission-critical environment. Contact: ram.ch@dprsolutionsinc.com Phone: 5715566111 Take the next step in your career!
More at DPR Solutions