Data Engineer (MongoDB/Databricks with DevOps)

Greetings!

Hope you are doing well !

Position – Data Engineer (MongoDB/Databricks with DevOps)

Visas – USC , GC , GC- EAD and H1B

Duration – 12+ Months Contract

Location – Maryland USA( Hybrid)

Experience - 5-9 Years

Need Local to MD, VA, DC

Cuboid is looking for Data Engineer Consultants for a 12+ month project located in Remote – Local To MD, VA, DC (Hybrid)

Experience: 8-9+ years

Job Description :-

Job Summary

Responsibilities

• Design, implement, and maintain MongoDB data models and schemas for real-time event-driven processing.

• Develop and optimize data pipelines and workflows using Databricks.

• Create and manage MongoDB databases to serve as authoritative transactional data stores for online processing.

• Collaborate with software engineers to integrate MongoDB solutions into applications.

• Implement and manage CI/CD pipelines for MongoDB and Databricks workflows.

• Automate data infrastructure provisioning and management using infrastructure as code (IaC) tools.

• Monitor and optimize MongoDB performance, ensuring scalability and reliability.

• Ensure data security and compliance with IRS standards, implementing necessary security measures.

• Develop technical documentation, including data models, data dictionaries, and data flow diagrams.

• Provide support for data migration and integration from legacy systems to MongoDB.

• Conduct performance tuning and index optimization for MongoDB databases.

• Manage data replication and backup strategies to ensure data availability and integrity.

• Execute tasks to support environments within AWS Gov Cloud or Treasury Cloud.

• Provide data engineering design activities to modernize legacy functionality into event-driven and business rules orchestrated services.

• Develop and assess logical and physical designs.

• Analyze legacy system use cases, features, and functionality that should be built into the modernized system for requirement support.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.

• At least 5 years of experience in data engineering, with a focus on MongoDB database management and optimization.

• Expert in NoSQL (MongoDB) database management and optimization.

• Proficient in data modeling techniques and database architecture principles, particularly for MongoDB.

• Strong experience with Databricks for data analytics and pipeline development.

• Knowledge of data pipeline orchestration and scheduling.

• Deep understanding of data security and compliance requirements.

• Knowledge of legacy data formats such as QSAM and VSAM.

• Experience with big data technologies is a plus.

• Experience modernizing data stores.

• Proficiency in CI/CD tools, scripting, and automation.

• Experience with infrastructure as code (IaC) and configuration management tools.

• Strong analytical and problem-solving skills.

• Excellent communication and collaboration skills.

• Must have or be able to obtain an MBI (Minimum Background Investigation) clearance.