Hadoop Spark Developer

Hadoop Spark Developer – Join Our Team .job-posting-container {font-family: Arial, sans-serif; line-height: 1.6; color: #333; margin: 0; padding: 20px; background-color: #ffffff; box-sizing: border-box;} .job-posting-container * {box-sizing: border-box;} .job-posting-content {background-color: #ffffff; padding: 30px; max-width: 800px; margin: 0 auto; box-shadow: 0 0 10px rgba(0,0,0,0.1); border-radius: 10px;} .job-posting-container h1, .job-posting-container h2 {color: #004080; margin: 15px 0;} .job-posting-container h1 {font-size: 22px;} .job-posting-container h2 {font-size: 20px; border-bottom: 1px solid #ccc; padding-bottom: 5px; margin-top: 30px;} .job-posting-container ul {margin-left: 20px;} .job-posting-container .section {margin-bottom: 25px;} .job-posting-container .highlight {background-color: #eef6ff; padding: 15px; border-left: 4px solid #004080; margin-bottom: 15px; border-radius: 5px;} .job-posting-container strong {color: #333;} .job-posting-container li {margin-bottom: 8px;} Hadoop Spark Developer Pennington, New Jersey, USA | Full-Time | $105,000 | C2C Position Overview We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big Data technologies, including PySpark, Hadoop Ecosystem, Hive, and Python. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining large-scale data processing solutions. Experience with Microsoft Copilot for AI-assisted development and productivity enhancement is highly desirable. The developer should hold a bachelor's or master's degree. The candidate should possess strong analytical skills, hands-on experience in distributed data processing, and the ability to work closely with business stakeholders, architects, and data engineering teams. Why Join Us? Work with cutting-edge Big Data technologies in a collaborative environment Opportunity to leverage Microsoft Copilot for AI-assisted development and productivity enhancement Competitive compensation package with professional growth opportunities Engage with cross-functional teams including Data Architects, Data Scientists, and Business Analysts Key Responsibilities Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark Build and optimize ETL/ELT pipelines using PySpark, Hive, and Python Process and analyze large datasets in distributed environments Develop high-performance Spark jobs and optimize existing workloads Create and manage Hive tables, partitions, views, and complex queries Implement data quality, data validation, and reconciliation frameworks Utilize Microsoft Copilot to accelerate development, automate code generation, troubleshooting, documentation, and testing activities Build both batch and real-time streaming applications with Kafka Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams Troubleshoot production issues and perform root cause analysis Design data ingestion frameworks for structured, semi-structured, and unstructured data Participate in Agile ceremonies including sprint planning, estimation, and retrospectives Mentor junior developers and provide technical leadership Qualifications 10+ years of experience in Big Data technologies including Hadoop, Spark, PySpark, Hive, and Python Strong experience building both batch and real-time streaming applications with Kafka Bachelor's or master's degree in Computer Science, Engineering, or related field Experience with Microsoft Copilot for AI-assisted development is highly desirable Strong analytical skills and hands-on experience in distributed data processing Ability to work closely with business stakeholders, architects, and data engineering teams Ready to Apply? Take the next step in your career with this exciting opportunity in Big Data development! Contact: prakash@dprsolutionsinc.com Phone: 5202825034 Take the next step in your career!