Source description
About the role
Role Senior Data Engineer
INDUSTRY Pharma, Development & Manufacturing
DURATION CONTRACT, probable extension
LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355
INTERVIEW MS TEAMS conversation
the candidate will be required to work in EST starting around 10AM EST till 6 PM EST
Experis is looking for a talented and motivated individual to serve as a Sr. Data Engineer within our client's Data Engineering and Integration team. The individual will contribute to the overall objectives of the team and will be a key technical resource that helps to monitor the daily operations of various data pipelines and ETL jobs. The candidate will have to have a solid background in key database technologies with a focus on data management, data integration, and data transformation experience. The ideal candidate will be a highly self-motivated IT professional that enjoys working closely with commercial business leaders. This person will be inspired by technology and its use in an ever-changing, fast-paced environment.
Key Responsibilities:
Monitor daily operations of ETL pipelines for data ingestion and transformation
Troubleshoot failures and/or errors in various data pipelines in a timely fashion
Investigate root causes for pipeline issues and address those issues where applicable
Escalate any issues that's not immediately resolvable, providing initial analysis
Be the liaison between team and the Business, communicate any blocking issues to the Business and provide ETA and/or timely updates on resolutions
Other Responsibilities:
Gain deep understanding of team's data platforms / architectures and follow guidelines
Perform data profiling to understand data domains, data dependencies and lineage
Effectively collaborate with external Business teams, including but not limited to sales, marketing, and finance
Participate in daily stand-up, sprint review and sprint planning sessions
Required Qualifications:
5+ year of experience with workflow orchestration tools (Airflow)
5+ years of experience working with RDBMS (MSSQL, Postgres, etc.)
Hands-on experience working with APIs and able to troubleshoot related issues
Strong knowledge of SQL and the ability to write, test, and optimize SQL queries
Familiarity with various BI solutions (Power BI, Qlik, etc.)
BS/MS degree in Computer Science, Engineering, Applied Math, or related field
Desired Qualifications:
3+ year of experience with CI/CD pipelines (Azure DevOps)
3+ year of experience with Cloud Data Warehouse solutions (Snowflake)
3+ years of experience architecting and building enterprise-scale data warehouses
1+ year of experience with Azure Platform (Azure Data Factory, Azure Blob Storage)
1+ year of experience with data modeling and data warehousing concepts (Data Vault)
More at 3B Staffing