Source description
About the role
Role:Sr/Lead Data Engineer
Location: 100% Remote – PST Hours Job Type: Contract – 12+ Months
Must Haves: Looking for Sr/Lead level person – Around 12-15 Years exp Should have strong experience and hands-on in Sql, PySpark, Azure, Databricks, and ADLS. Someone coming from a Sql/ETL/BI Development background, No bigdata/Hadoop background consultants
Key Responsibilities: Data Engineering : Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies. Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions. Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability. Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform. Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.
Must-Have Skills & Qualifications: Minimum 8+ years of overall experience in IT Industry. 4+ years of experience in data engineering, with a strong background in building large-scale data solutions. 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions) Proven expertise in SQL for querying, manipulating, and analyzing large datasets. Strong knowledge of ETL processes and data warehousing fundamentals. Self-motivated and independent, with a “let’s get this done” mindset and the ability to thrive in a fast-paced and dynamic environment.
Good-to-Have Skills: Databricks Certification is a plus. Data Modeling, Azure Architect Certification, CPG.
More at Thoughtwave Software and Solutions