Source description
About the role
Position: Data Engineer Experience: 48 Years Location: Bangalore Employment Type: Full time Job Summary We are looking for a skilled Data Engineer to build and maintain scalable data pipelines, improve data quality, and develop solutions for record matching and identity resolution. The ideal candidate should have strong experience in Python, SQL, PySpark, Databricks/Snowflake, and modern data engineering practices. You will work with large Business, Consumer, and Healthcare datasets to create accurate, reliable, and high-performing data solutions. Key Responsibilities Design and develop scalable ETL/ELT data pipelines. Process, clean, and transform large datasets. Build and maintain data models and databases. Perform data deduplication and identity resolution. Optimize SQL queries and improve data processing performance. Ensure data quality, accuracy, and consistency across multiple sources. Develop and maintain workflows using Databricks, Spark, or cloud platforms. Collaborate with Data Scientists, Analysts, and Engineering teams. Implement data security, governance, and privacy best practices. Troubleshoot and resolve data pipeline issues. Required Skills Robust experience in Python and Advanced SQL Hands-on experience with PySpark Experience with Databricks or Snowflake Valuable understanding of ETL/ELT processes Experience with Data Modeling and Data Warehousing Knowledge of Data Quality and Data Validation Experience working with large structured and unstructured datasets Familiarity with Git and version control Experience with Azure or AWS is preferred Nice to Have Experience in Entity Resolution or Record Linkage Knowledge of Master Data Management (MDM) Understanding of Identity Resolution techniques Experience with Airflow, Prefect, or Dagster Knowledge of Healthcare, Consumer, or Business data domains Compensation: 510,705.92 - 1,000,000.00 per year Work Location: In person Position: Data Engineer Experience: 48 Years Location: Bangalore Employment Type: Full time Job Summary We are looking for a skilled Data Engineer to build and maintain scalable data pipelines, improve data quality, and develop solutions for record matching and identity resolution. The ideal candidate should have strong experience in Python, SQL, PySpark, Databricks/Snowflake, and modern data engineering practices. You will work with large Business, Consumer, and Healthcare datasets to create accurate, reliable, and high-performing data solutions. Key Responsibilities Design and develop scalable ETL/ELT data pipelines. Process, clean, and transform large datasets. Build and maintain data models and databases. Perform data deduplication and identity resolution. Optimize SQL queries and improve data processing performance. Ensure data quality, accuracy, and consistency across multiple sources. Develop and maintain workflows using Databricks, Spark, or cloud platforms. Collaborate with Data Scientists, Analysts, and Engineering teams. Implement data security, governance, and privacy best practices. Troubleshoot and resolve data pipeline issues. Required Skills Robust experience in Python and Advanced SQL Hands-on experience with PySpark Experience with Databricks or Snowflake Valuable understanding of ETL/ELT processes Experience with Data Modeling and Data Warehousing Knowledge of Data Quality and Data Validation Experience working with large structured and unstructured datasets Familiarity with Git and version control Experience with Azure or AWS is preferred Nice to Have Experience in Entity Resolution or Record Linkage Knowledge of Master Data Management (MDM) Understanding of Identity Resolution techniques Experience with Airflow, Prefect, or Dagster Knowledge of Healthcare, Consumer, or Business data domains Compensation: 510,705.92 - 1,000,000.00 per year Work Location: In person
More at Sagacious Infosystems