Data Engineer

About Soul AI Pods Deccan AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from top tier institutes like IITs, NITs, and BITS. We're hiring for our client servicing arm Soul AI. Soul AI has a talent network, known as Soul AI Pods , under which highly skilled & vetted tech talent gets the opportunity to work with top-tier global tech companies. Our client list includes tech giants like Google & Snowflake. Read more about here Responsibilities Design, build, and maintain ETL/ELT pipeline s using tools like Airflo w, DB T, or Spark Develop and optimize data lake s, data warehouse s, and streaming pipelines Ensure data quality, reliability, and lineag e across sources and pipelines Integrate structured and unstructured data from internal and third-party APIs Collaborate with ML teams to deliver production-ready feature pipeline s, labeling dat a, and dataset versioning Implement data governanc e, security, and access control policies Required Skills Strong SQL skills including analytical queries, CTEs, window functions, and query optimization Proficient in Python for data manipulation and scripting using libraries like Pandas and NumPy Experience with ETL orchestration tools such as Airflow, Prefect, or Luigi Hands-on with batch and streaming data processing using Spark, Kafka, or Flink Familiarity with data lakes and warehouses (S3, BigQuery, Redshift, Snowflake) and schema design Bonus: experience with DBT, data validation, MLOps integration, or compliance-aware data workflows Application & Other Details To apply, fill the Soul AI Pods Interest Form You will be invited for selection process R1: Test, R2: AI Interview, R3: 1:1 Interview We are hiring for full-time or long Contract (40 hrs/week) hybrid roles We are hiring across different seniority levels You will work on a key client project (Top-tier tech consulting firm)