Source description
About the role
As an experienced Databricks Data Modeler, your role will involve designing, developing, and optimizing enterprise-scale data models and data platforms on Databricks. You should have expertise in data modeling, data warehousing, ETL/ELT processes, and cloud-based data engineering solutions. - Design and implement conceptual, logical, and physical data models for enterprise data platforms. - Develop scalable data solutions using Databricks, Apache Spark, and cloud technologies. - Create and maintain dimensional models (Star Schema, Snowflake Schema) for analytical and reporting requirements. - Collaborate with business stakeholders, data architects, and engineering teams to gather and analyze data requirements. - Build and optimize ETL/ELT pipelines for large-scale data processing. - Ensure data quality, consistency, governance, and security standards are maintained. - Perform data profiling, data lineage analysis, and impact assessments. - Optimize Databricks workloads for performance and cost efficiency. - Support data migration and modernization initiatives from legacy systems to cloud platforms. Required Qualifications: - Strong hands-on experience with Databricks. - Expertise in Data Modeling (Conceptual, Logical, Physical). - Experience with Dimensional Modeling, Data Warehousing concepts, Star/Snowflake schemas. - Strong SQL development and query optimization skills. - Experience with Apache Spark, PySpark, and Databricks notebooks. - Knowledge of ETL/ELT frameworks and data integration tools. - Experience with cloud platforms such as Azure, AWS, or GCP. - Strong understanding of Data Governance, Data Quality, and Metadata Management. - Experience working with large-scale structured and unstructured datasets. Preferred Qualifications: - Experience with Azure Data Factory (ADF), Delta Lake, and Lakehouse architecture. - Knowledge of Data Vault Modeling. - Familiarity with BI tools such as Power BI, Tableau, or Looker. - Experience with CI/CD and DevOps practices in data engineering. Qualifications: - Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or related field. - 5+ years of experience in Data Engineering/Data Modeling. - Strong communication and stakeholder management skills. Mandatory Skills: - Databricks - Data Modeling - SQL - Spark/PySpark - Data Warehousing - Cloud Platform (Azure/AWS/GCP) Good to Have: - Delta Lake - Azure Data Factory - Data Vault Modeling - Power BI/Tableau - CI/CD Pipelines As an experienced Databricks Data Modeler, your role will involve designing, developing, and optimizing enterprise-scale data models and data platforms on Databricks. You should have expertise in data modeling, data warehousing, ETL/ELT processes, and cloud-based data engineering solutions. - Design and implement conceptual, logical, and physical data models for enterprise data platforms. - Develop scalable data solutions using Databricks, Apache Spark, and cloud technologies. - Create and maintain dimensional models (Star Schema, Snowflake Schema) for analytical and reporting requirements. - Collaborate with business stakeholders, data architects, and engineering teams to gather and analyze data requirements. - Build and optimize ETL/ELT pipelines for large-scale data processing. - Ensure data quality, consistency, governance, and security standards are maintained. - Perform data profiling, data lineage analysis, and impact assessments. - Optimize Databricks workloads for performance and cost efficiency. - Support data migration and modernization initiatives from legacy systems to cloud platforms. Required Qualifications: - Strong hands-on experience with Databricks. - Expertise in Data Modeling (Conceptual, Logical, Physical). - Experience with Dimensional Modeling, Data Warehousing concepts, Star/Snowflake schemas. - Strong SQL development and query optimization skills. - Experience with Apache Spark, PySpark, and Databricks notebooks. - Knowledge of ETL/ELT frameworks and data integration tools. - Experience with cloud platforms such as Azure, AWS, or GCP. - Strong understanding of Data Governance, Data Quality, and Metadata Management. - Experience working with large-scale structured and unstructured datasets. Preferred Qualifications: - Experience with Azure Data Factory (ADF), Delta Lake, and Lakehouse architecture. - Knowledge of Data Vault Modeling. - Familiarity with BI tools such as Power BI, Tableau, or Looker. - Experience with CI/CD and DevOps practices in data engineering. Qualifications: - Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or related field. - 5+ years of experience in Data Engineering/Data Modeling. - Strong communication and stakeholder management skills. Mandatory Skills: - Databricks - Data Modeling - SQL - Spark/PySpark - Data Warehousing - Cloud Platform (Azure/AWS/GCP) Good to Have: - Delta Lake - Azure Data Factory - Data Vault Modeling - Power BI/Tableau - CI/CD Pi
More at Persistent Systems