Source description
About the role
Role:Azure Data Architect
Location:REMOTE Duration:12 Months
Must Haves : Azure Data Lake design and implementation experience Experience modeling and building out star schema on Cloud Data Lake for BI use cases. Databricks Data Lake experience Spark SQL Team Coaching skills. Strong architect who can hold their own and suggest solutions. AWS/Azure or GCP data lake experience Streaming data pipelines with kafka for real time needs Polished consulting skills
Responsibilities
They have teams that currently work with Azure and data so not completely in the dark here. The place they need help with is with a data warehouse that is pulling data from a lot of different areas across the organization. 5-6 different analytics pipeline. Feed these to one data warehouse that will be used as a single source of truth. Data analytics that will have to be aligned. How will members align in different data pipelines and then transfer to data warehouse. Azure type structure. Not relational. Utilize star scheema to do rollup queries. Need help on Data warehousing approach on azure then drive maintenance of star scheema in that environment. Doing lots of fits and starts and going down false trails. Lots of trial and error. Wants someone with previous experience in this area. Need super strong resource. Using looking at synaps on azure or possibly something else. Medallion type architecture. Gold/silver/bronze. Not looking at using sql clusters in synapse. This doesn’t work for them. Using spark based ETL. Serverless compute running against deltalake. Databricks?? TBD they are looking into this. Would love someone to be able to recommend yes or no. Need someone with strong data warehouse background.
Bhargavi Ankam IT Recruiter Staffing | Thoughtwave Software and Solutions Limited 6306891366 bhargavi@thoughtwavesoft.com www.thoughtwavesoft.com 314 N. Lake St, Suite 6, Aurora IL 60506
More at Thoughtwave Software and Solutions