OSB Group - Data Engineer

Note : If shortlisted, you will be invited for initial rounds on 20th June 2026, Saturday in Bangalore About The Role : The Data Engineer will be responsible for translating business requirements into Azure Cloud-based big data solutions for the data modernisation program. You will be responsible for building complex data pipelines, data warehouses, and data lakes using Azure services like Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. The Azure Data Engineer will work closely with other members of the Data Engineering team and Product Owners ensuring Data strategy and platforms fulfil current needs and are aligned with the overall vision of the organisation. They will be responsible for delivery of enterprise-scale data transformation and modernisation programmes. The ideal candidate will be an experienced data technologist and have a blend of experience across delivery and the practical application of contemporary data technologies. Experience in working within the Banking Industry (in banking, vendors or a large tech firm) is highly desirable. Responsibilities : - Develop high-quality big data technology-based solutions on Azure Cloud leveraging Azure Databricks and other services for advanced data processing and analytics tasks while optimizing performance and scalability. - Analyse current business practices, processes, and procedures as well as identify future business opportunities for leveraging Microsoft Azure Data & Analytics Services. - Develop best practices including reusable code, libraries, patterns, and consumable frameworks for Azure cloud-based data warehousing and data pipelines. - Work closely with the Azure Data Engineering Manager and Technical Leads to ensure the execution of plans corresponds with what is being promised. - Drive data processing efficiency improvements and migrations from on-premises to public cloud platforms. Experience & Qualifications : - Overall 4 to 5 years of IT experience preferably in Data and Analytics implementation. - Minimum 3 years of Data Engineering (Azure) delivery experience including analysis, development, configuration, and deployment. - 2 years of implementation experience in Azure Data Engineering projects. - Experience in an MI / BI / Analytics environment (Kimball, Lakehouse, Data Lake) is essential. - Proficiency in Python, SQL, Spark SQL, and PySpark. - Expert-level understanding of Azure Data Factory, Azure Synapse Analytics, Azure SQL, Azure Data Lake, Databricks, Purview, and Azure App Service. - Significant technical skills such as Transact-SQL and relational database technologies are essential. - Understanding of data governance and security best practices. - Experience in streaming and batch architecture (e.g., Kafka, Kafka Streams, Spark, Flink). - Exposure to at least one distributed data processing framework such as Spark (Core, Streaming, SQL), Storm, or Flink. - Experience working with NoSQL technologies such as MongoDB, Cassandra, HBase, Cosmos DB, DynamoDB, BigTable, or similar platforms. - Good exposure to development using CI/CD pipelines. - Knowledge of containerization, orchestration, and Kubernetes Engine would be an added advantage. - Development of data pipelines using API ingestion and streaming ingestion methods. - Experience working in a fast-paced Agile environment. Knowledge Requirements : - Excellent understanding of the data technologies landscape and ecosystem (both On-Premises and Cloud). - Detailed knowledge of software development is essential. - Detailed knowledge of the following technologies is essential : i. Azure Data Factory ii. Azure Databricks iii. Azure Synapse Analytics iv. SQL v. Python vi. Data Modelling vii. Data Warehousing viii. Data Lake ix. ETL - Proven ability to build, manage, and foster a team-oriented environment. - Proven ability to work creatively and analytically in a problem-solving environment. - Excellent communication (written and verbal) and interpersonal skills. - Excellent organizational, multi-tasking, and time-management skills. Required Qualifications/Certifications : - Bachelors or Masters degree in Computer Science, Information Systems, or a related field, and/or equivalent work experience is essential. - Azure Certifications related to Design and Development. - Professional IT accreditation or qualification is desirable. Note : If shortlisted, you will be invited for initial rounds on 20th June 2026, Saturday in Bangalore About The Role : The Data Engineer will be responsible for translating business requirements into Azure Cloud-based big data solutions for the data modernisation program. You will be responsible for b