Data Engineer

Job Title: Data Engineer Experience: 5–10 Years. Location: Pan India Joining Time: Immediate to 15 Days Maximum About the Role: Indus Net Technologies is looking for an experienced Data Engineer to design, build, and maintain robust data pipelines leveraging Databricks and Azure Cloud Services . The ideal candidate will have hands-on expertise in processing large-scale IoT sensor data from manufacturing equipment, ensuring data quality, integrity, and high performance across multi-plant operations. Key Responsibilities : Design and implement ETL/ELT pipelines using Databricks and PySpark . Process and transform real-time IoT sensor data from multiple manufacturing plants. Manage data storage, versioning, and optimization using Delta Lake . Integrate data from diverse sources (SQL Server, JSON, CSV, APIs, etc.). Write and optimize complex SQL queries and stored procedures for performance. Implement data quality monitoring , testing, and CI/CD pipelines using Azure DevOps . Collaborate closely with manufacturing and analytics teams to deliver actionable IoT data insights. Top 4 Mandatory Skills: Databricks & Apache Spark (PySpark) – Minimum 3 years of hands-on experience Azure Cloud Services – Experience with ADF, Blob Storage, and DevOps Python – Advanced proficiency with OOP concepts, pandas, and robust error handling Delta Lake – Strong knowledge of data versioning, time travel, and optimization Good-to-Have Skills: Advanced SQL and stored procedure development Experience in JSON data processing and schema handling Git-based version control and CI/CD integration using Azure DevOps Exposure to manufacturing or industrial IoT data patterns Preferred Domain Knowledge: Industrial IoT and time-series data management Machine data and equipment performance monitoring Multi-plant data integration and central data architecture Data quality frameworks , downtime, and defect analytics Qualifications: Bachelor’s degree in Computer Science , Engineering , or a related field 4–6 years of proven experience in Data Engineering 2+ years of strong exposure to Databricks/Spark ecosystem Azure Data Engineer Associate or Databricks certification is preferred Soft Skills: Excellent communication skills in English (written and verbal) Strong analytical and problem-solving mindset Collaborative and proactive approach with cross-functional teams High attention to detail and commitment to data accuracy