Source description
About the role
Job Information Number of Positions 1 Date Opened 07/22/2026 Industry IT Services Job Type Full time Work Experience 5-7 years City New Delhi State/Province Delhi Zip/Postal Code 110017 Country India We are hiring a Data Engineer (5+ years) with expertise in building and managing production-scale data platforms in secure, air-gapped environments. The ideal candidate should have hands-on experience with Apache Airflow, Spark, PostgreSQL, Docker, Python, SQL, and S3-compatible storage (MinIO), along with robust knowledge of geospatial and time-series data. This role requires end-to-end ownership of data pipelines, infrastructure deployment, and troubleshooting in isolated environments without cloud dependencies. Requirements - 5+ years of experience in Data Engineering and production-scale data platforms - Design and manage Apache Airflow pipelines for high-volume sensor, satellite, and third-party data ingestion within isolated environments - Build and optimize Apache Spark workloads for batch processing, geospatial analytics, and large-scale aggregations - Develop and maintain PostgreSQL, TimescaleDB, PostGIS, and DuckDB-based data solutions - Implement efficient data ingestion, transformation, and bulk-loading pipelines without external connectivity - Containerize and deploy applications using Docker and Docker Compose in air-gapped environments - Work with S3-compatible object storage (e.g., MinIO) for on-prem data storage - Proven experience deploying via Docker/Docker Compose in air-gapped or restricted-network environments - Comfortable working in Ubuntu-based environments with manual/local infrastructure management - Strong proficiency in Python, SQL, Airflow, Spark, and PostgreSQL - Experience with geospatial and time-series data - Collaborate with customer teams to translate business requirements into data products - Ensure data quality, lineage, observability, performance, and SLA compliance - Troubleshoot production issues on-site/remotely without cloud tooling support - Create and maintain technical documentation, data models, and operational run-books - Strong communication, stakeholder management, and problem-solving skills Benefits - Comprehensive insurance coverage that gives you peace of mind, so you can focus on doing your best work - Flexible work arrangements designed to support sustained productivity, personal well-being, and work-life balance - Continuous learning and accelerated skill development through hands-on projects and mentorship from experienced industry leaders - Global client exposure across 20+ countries, offering real-world experience with diverse markets and business environments. - Opportunity to work on high-impact, large-scale projects that have collectively generated over $1B in measurable business value - Competitive, market-aligned compensation packages that recognize performance, expertise, and long-term contribution - Monthly demo days that celebrate innovation, showcase your work, and give you a real voice in what we build - Annual recognition programs and performance-driven awards in a truly meritocratic environment - Referral bonuses that reward you for helping grow a strong, like-minded team - A strong problem-solving culture with opportunities to tackle meaningful, real-world challenges - A positive, people-first workplace that supports happiness, balance, and long-term growth .
More at Spark Eighteen
Related open roles
Fullstack Engineer (Python) - Senior
Delhi NCR
Data Engineer u2013 AI-Driven Data Platforms
Delhi NCR
Data Engineer Secure / Air-Gapped Environments (New Delhi)
Delhi NCR
Data Engineer Secure / Air-Gapped Environments
Delhi NCR
Full Stack Engineer(React.js) -Senior II
Delhi NCR
Full Stack Engineer (React.js) - Senior II
Delhi NCR