Databricks Senior Data Engineer

JD:

Role name: Databricks Senior Data Engineer

Work site: Pittsburgh, PA (Onsite)

Contract

Job Description:

10+years of expereince as Datawarehouse Data Engineer.

• Data Architecture Design: Develop/Modify the architecture for the EDW, including data models, data quality standards, data integration strategies, data migration and data warehousing technologies to effectively store and access data from various sources as per the requirments.

• Business Requirements Gathering: Collaborate with business stakeholders to understand their data needs, identify key performance indicators (KPIs), and translate them into data warehouse requirements.

• Data Integration and ETL Development: Design and implementation of ETL processes to extract data from various source systems,

transform it into a consistent format, and load it into the EDW through Databricks. Proven track record in implementing databricks for modernization projects.

• Performance Optimization: Monitor and optimize the performance of the EDW to ensure efficient data access and query response times.

• Overall Technical Leader: Provide technical guidance on data warehouse technologies, tools, and best practices to the relevant stakeholders.

• Collaboration with Stakeholders: Work closely with business users, data analysts, and application developers to understand their data needs and deliver data-driven insights.

Required Skills and Experience:

• Data Warehousing Expertise: Deep understanding of data warehousing concepts, architectures, and technologies like dimensional modeling, star schema, Databricks schema, and ETL processes.

• Database Management Systems (DBMS): Proficient in SQL’s and Databricks.

• Data Integration Tools: Familiarity with data integration tools for ETL development and data cleansing.

Communication Skills: Excellent communication skills to effectively collaborate with stakeholders from various departments

Job type: Contract Division: eTeam Inc (US) Category: eTeam United States Reference: 25-454928