Data Engineer

Job Title: Data Engineer Experience Required: 3 6 Years Location: Bangalore - On-site(5 days) Job Type: Full-Time Key Responsibilities: Data Engineering: Design, build and optimize large-scale ETL/data pipelines using Databricks, PySpark and SQL to ingest, transform and persist structured data into cloud data catalogs/lakehouses. Pipeline Optimization: Tune Spark jobs using adaptive query execution, caching, partitioning and join optimizations to handle high-volume datasets efficiently. Data Warehouse & SQL Development: Develop and maintain complex T-SQL stored procedures and queries for pre-computing business metrics, aggregations and derived datasets in SQL Server. AI & LLM Applications: Build and deploy LLM-powered chatbots and AI automation using Azure OpenAI and Claude/GPT models to enable natural-language querying and automated report generation. Automated Reporting: Develop AI-driven weekly report generators and change-detection notification systems that summarize data changes and send automated email alerts to stakeholders. Backend Development: Design and implement RESTful APIs using .NET Core / ASP.NET with clean architecture patterns (Controllers, Services, Repositories, Models). Frontend Development: Build responsive, data-intensive Vue.js 3 + Vuetify web applications with advanced filters, editable grids, pivot tables and real-time data interactions. End-to-End Delivery: Own the full data flow from source databases through ETL pipelines, APIs and frontend dashboards for planning and analytics applications. Integration & Configuration: Manage secure integrations with cloud services, key vaults, SMTP, JDBC and OpenAI APIs for production notebooks and web apps