Padmi

Databricks Unified Data Analytics Platform

ChennaiPosted 1 month ago
Software engineeringMid-levelFull Time; Regular
Apply at Artech

Opens the source posting on shine.com

Source description

About the role

View original

Databricks + SQL + Python/PySpark + Data EngineeringRole Overview We are seeking an 6 Y of experienced Databricks Data Engineer with strong expertise in building scalable data pipelines, managing large datasets, and delivering business-driven solutions. The ideal candidate will have advanced skills in Python and SQL, hands-on experience with Databricks, and the ability to translate business requirements into efficient technical implementations.Key ResponsibilitiesDesign, develop, and optimize ETL pipelines and workflows using Databricks, Python, and SQL.Handle large-scale datasets, ensuring performance, scalability, and data integrity.Translate business requirements into robust data models, queries, and scripts.Implement data transformations, orchestration, and automation within Databricks.Collaborate with analysts, data scientists, and business stakeholders to deliver actionable insights.Build dashboards and reports using Power BI or similar BI tools.Ensure compliance with data governance, security, and best practices.Document processes, pipelines, and solutions for knowledge sharing.Required SkillsStrong proficiency in Python and SQL with 6+ years of experience.Hands-on expertise with Databricks (data engineering, Spark, orchestration).Experience handling large datasets and optimizing performance.Knowledge of data warehousing concepts and ETL workflows.Familiarity with BI tools (Power BI, Tableau) for reporting and visualization.Exposure to cloud platforms (Azure, AWS, or GCP) and version control (Git).Strong problem-solving, communication, and collaboration skills.Exposure to machine learning workflows within Databricks is a plus. Databricks + SQL + Python/PySpark + Data EngineeringRole Overview We are seeking an 6 Y of experienced Databricks Data Engineer with strong expertise in building scalable data pipelines, managing large datasets, and delivering business-driven solutions. The ideal candidate will have advanced skills in Python and SQL, hands-on experience with Databricks, and the ability to translate business requirements into efficient technical implementations.Key ResponsibilitiesDesign, develop, and optimize ETL pipelines and workflows using Databricks, Python, and SQL.Handle large-scale datasets, ensuring performance, scalability, and data integrity.Translate business requirements into robust data models, queries, and scripts.Implement data transformations, orchestration, and automation within Databricks.Collaborate with analysts, data scientists, and business stakeholders to deliver actionable insights.Build dashboards and reports using Power BI or similar BI tools.Ensure compliance with data governance, security, and best practices.Document processes, pipelines, and solutions for knowledge sharing.Required SkillsStrong proficiency in Python and SQL with 6+ years of experience.Hands-on expertise with Databricks (data engineering, Spark, orchestration).Experience handling large datasets and optimizing performance.Knowledge of data warehousing concepts and ETL workflows.Familiarity with BI tools (Power BI, Tableau) for reporting and visualization.Exposure to cloud platforms (Azure, AWS, or GCP) and version control (Git).Strong problem-solving, communication, and collaboration skills.Exposure to machine learning workflows within Databricks is a plus.

One address, no account. We’ll tell you when matching roles go live.

More at Artech

Related open roles

View all roles