Source description
About the role
C2C/W2
Role: Azure Synapse Data Engineer
Location: San Antonio, TX (4 days onsite) Duration: 12-month contract
TOP Needs Position Summary: Data Engineering group is seeking a Senior Data Engineer to join our team. The Data Engineer will play a key role in building and maintaining end-to-end data pipelines for analytics solutions within Marathon’s Insights & Discovery Platform, based on Microsoft Azure Cloud and Azure Synapse Analytics. Key Responsibilities: · Design, develop, and implement analytics solutions on the Microsoft Azure Synapse Analytics Platform. · Develop ETL/ELT processes to collect and integrate data from various sources, ensuring data quality and pipeline performance for large volume data ingestion. · Utilize data preparation, integration, storage, and analytics tools within the Azure landscape. · Drive automation of repeatable data preparation tasks to minimize manual data management processes. · Partner with business unit IT teams to gather and document analytics solution requirements. · Document and provide solution options and recommendations for analytics solutions. · Collaborate with cloud service providers, data science, data governance, and other IT and business teams to deliver analytics solutions. · Participate in MPC’s scaled agile framework for data engineering product delivery by engaging in all relevant tasks and ceremonies. · Provide troubleshooting, analysis, and resolutions for existing solutions, including routine production support issues and major/minor enhancements. Education and Experience: · Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering, Information Systems, or a related field. · Minimum of 8-10 years of hands-on experience in building data pipelines, data models, and maintaining/supporting enterprise data warehouse solutions. · Experience in scaled agile framework for data engineering product delivery. · Microsoft Azure certifications in various analytics technologies are a plus. · Working knowledge/familiarity with Oil & Gas industry processes is a plus. Skills: · Strong SQL experience, data modeling, data warehouse, and OLAP concepts. · Experience with Azure Data Lake Storage, Azure Synapse Analytics, Azure Spark Pools, Databricks Notebook, Cosmos DB, CDC tools, Python, DevOps, CI/CD. · Familiarity with data integration tools (e.g., Qlik Replicate) and data modeling tools (e.g., Erwin) is a plus. · Familiarity with data lake medallion architecture and concepts of Unified Data Models. · Familiarity with contextualization products (e.g., Cognite) is a plus. · Experience with visualization tools such as Microsoft PowerBI and Tableau is desired. · Familiarity with Scaled Agile, DevOps, Scrum, and ITIL concepts is a plus. · Experience with Microsoft SSIS, SSRS, SSAS is a plus. Competencies: · Strong communication and presentation skills – Ability to present and communicate with technical and non-technical stakeholders at different levels within IT and business departments during various stages of solution design, development, and implementation. · Collaboration & Building Partnerships – Developing and leveraging relationships within and across work groups to achieve results. · Drive for Results – Taking ownership of assigned work and prompt action to accomplish objectives; taking actions to achieve goals beyond what is required; being proactive. · Continuous Improvement – Originating actions to improve existing conditions and processes, identifying improvement opportunities, generating ideas, and implementing solutions. Thanks & Regards Ambica, SR IT Recruiter Thought wave software and solutions 314 N,Lake St, Suite 6, Aurora IL 60506 Desk:6307120049 Email:gambica@thoughtwavesoft.com LinkedIn: linkedin.com/in/gnanambica-neelam-600189228
More at Thoughtwave Software and Solutions