Data Engineer

As a Data Engineer, your role will involve the following key responsibilities: - Identify, analyze, and document available data sources, formats, and access methods. - Assess data quality across completeness, accuracy, consistency, and reliability. - Define and maintain comprehensive data mapping between source systems and Databricks tables. - Design and implement scalable ETL/ELT pipelines using Databricks and Apache Spark. - Develop and optimize Databricks workloads using Spark and Delta Lake. - Design efficient data models optimized for performance, analytics, and API consumption. To excel in this role, you should possess the following skills and qualifications: - Strong hands-on experience with Databricks and Apache Spark. - Proficiency in Python and SQL. - Proven experience in data mapping, transformation, and data modeling. - Experience integrating data from APIs, databases, and cloud storage. - Solid understanding of ETL/ELT concepts and data warehousing principles. As a Data Engineer, your role will involve the following key responsibilities: - Identify, analyze, and document available data sources, formats, and access methods. - Assess data quality across completeness, accuracy, consistency, and reliability. - Define and maintain comprehensive data mapping between source systems and Databricks tables. - Design and implement scalable ETL/ELT pipelines using Databricks and Apache Spark. - Develop and optimize Databricks workloads using Spark and Delta Lake. - Design efficient data models optimized for performance, analytics, and API consumption. To excel in this role, you should possess the following skills and qualifications: - Strong hands-on experience with Databricks and Apache Spark. - Proficiency in Python and SQL. - Proven experience in data mapping, transformation, and data modeling. - Experience integrating data from APIs, databases, and cloud storage. - Solid understanding of ETL/ELT concepts and data warehousing principles.