Source description
About the role
Role : Sr Data Engineer Location: Remote Duration: 06 Months Contract: W2
Need west Coast PST Candidates only Job Description : looking for aSenior Data Engineer to support the Store Development organization. One of topinitiatives to make the data available on enterprise platform so that it isreadily available for the Store Development business and other teams toconsume. So there is a need for a Senior Data Engineer who would need to buildpipelines to bring the data from different store development applications intoan azure based storage of EDAP system. The pipeline would be built onDatabricks platform and would use PySpark. Team culture/work environment:· 9 partners· Supportingthe stores in the domains of constructions/ real-estate Key projects:· Making dataavailable on the enterprise platforms· Working onadditional work Daily Responsibilities:· Buildingpipelines using different store development applications· Working inthe EDAP systems· UsingDatabricks platform and Pyspark to help build said pipelines· Collaboration with the team· Taking allthe data and putting it all in format in EDAP· Working onthe data and writing the code on databricks Technology requirements:· Agile/Scrum methodologies· Azure· Cloud based· Python· SQL
More at Thoughtwave Software and Solutions