Marketing-Mkt-Data Engineer-Compliance&Regulatory Analytics-Bangalore-

Job Purpose : A Data Engineer is responsible for designing, building, and maintaining robust data pipelines and systems that enable efficient data collection, storage, processing, and analysis. They ensure data quality, scalability, and performance across large datasets while working with data scientists to deliver actionable insights. Data Pipeline Development : Design, build, and optimize ETL pipelines using SSIS (SQL Server Integration Services) and Databricks. Ensure data is moved efficiently and accurately across various systems and environments Azure Data Solutions and Databricks integration : Implement and manage Azure Data Services, such as Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, and Azure Databricks for data processing, transformation, and storage. Leverage Databricks to build advanced data workflows. Database Design and Optimization : Work with relational and NoSQL databases, ensuring they are optimized for high performance, reliability, and scalability Server and Infrastructure Administration : Administer and maintain on-premises and cloud-based servers, ensuring system availability, performance, and security. Perform regular system updates and backups. Data Quality and Governance : Establish data quality and governance standards. Ensure data integrity and compliance with industry standards and company policies. Automation and Monitoring : Implement automated solutions for data pipeline monitoring, troubleshooting, and optimization. Ensure continuous data flow and quick issue resolution.