Data Engineer, ZTD R&D

POSITION RESPONSIBILITIES Business Analysis • Autonomously perform Business Analysis as needed for data-based use cases, including open interaction with SMEs to answer questions and seek feedback, early analysis investigation spikes to analyze preliminary datasets, and phase-based design planning for implementation. • Creates accurate entity mappings for data integrations and transformations, including business rules • Creates entity relationship diagrams to document a variety of data development cases, including process flow, entity source to target, and database diagrams • Define scope, approach, next steps, and direction with regard to assigned project objectives, and consult with technical lead for internal and business objective alignment • Determine appropriate frequency and mode of needed data staging, from near-real-time streaming to daily wipe-reload • Determine appropriate means of provisioning data, from direct file or analysis table consumption to visualization 15% Data Analysis • Analyze incoming data (from raw sets, database tables, APIs, and other sources) rapidly to understand its potential, needed manipulations, and issues. • Perform data cleanup activities without direction • Profile datasets, detecting anomalies, needed alignments, and patterns • Proactively determine probable rules, and confirm unknown concepts with domain technical owner • Understands AI tools and technologies; able to leverage pre-trained models for daily tasks. • Provide L3/L4 support for production data issues including advanced query capabilities and ETL pattern knowledge/familiarity to troubleshoot datasets and ETLs, and direct contracted resources as needed to remediate issues. 25% Data Development • Design and develop data solutions from prototype to production, largely self-driven, with a particular focus on rapid ETL development, including integrations, data processing, and analyses, as well as limited data apps and visualizations • Automate pipelines using scripting and ETL tools • Manage and monitors pipeline execution • Design and implement error handling capabilities • Setup simple orchestration jobs • Perform data migration analysis tasks, such as evaluation of current sets, mapping, and process flow diagramming • Own and oversee as needed execution of data migration tasks as part of system deployment • Diagnose, handle, and manage data migration issues • Understands ACID principles for databases • Understands and applies different approaches for data loading based on the scenario, such as wipe/reload, upsert, and CDC • Recognizes and can approach varying latencies of data loading, from batch to near-realtime • Oversee and work with contract resources to fulfill design and execution for data products. • Assume responsibility for the overall quality of delivered products. • Understand and apply key Agile concepts like failing fast and minimum viable product. • Participate in project management activities like daily stand-up meetings, sprint reviews, etc. • Assume responsibility for own assigned tasks and reaching out for clarity, • Create tasks as needed and delegate where appropriate • Document technical design specifications • Interpret and diagnose existing legacy or inherited code for problems and proposed remediation • Unit test workflows extensively to minimize rework • Peer review with others to receive and provide advice and insight • Regression test developed items to verify continuous coverage of existing functionality • Design, execute, and oversee test script execution and automation • Define deployment/installation documentation • Execute or oversee deployment, including installation, installation verification, and hypercare • Document products consistently 50% Data Architecture • Recognize key VMRD data entities and understand how they relate to others, to extend the value and linkability of data across use cases. • Know and apply approaches and sources to acquire additional metadata for key VMRD entities • Understands basic Master Data Management principles • Assure adherence to basic data security approaches, including app, visualization, database, and file security • Understand and apply role-based security approaches and inheritance • Recognize and safely handle sensitive data such as Personal Information and Intellectual Property • Good understanding of the technical impacts of GxP-related systems and processes • Build and continually enhance knowledge of both the technical and business functional landscape for VMRD • Actively interface with Systems Engineers on app-related projects • Collaborate with colleagues to continually enhance process and knowledge 10% ORGANIZATIONAL RELATIONSHIPS • ZTD R&D Solution Partners • ZTD R&D Systems Engineers • ZTD Centers Of Excellence • VMRD business SMEs from multiple product lines and departments Supervision 0-4 contingent workers technical direction EDUCATION AND EXPERIENCE • Undergraduate degree related to information technology and/or computer science or equivalent education and work experience required. • 5-8+ years experience with the design, building, and supporting of rapid data development (3-6+ with Master's degree) • Experience with utilizing multiple vendors and/or departments for service and support activities. • Excellent interpersonal and communication skills with the ability to build relationships. • Experience in coordinating activities with multidisciplinary teams distributed in many physical locations with different time zones. • Ability to prioritize issues and drive progress in ambiguous situations. TECHNICAL SKILLS REQUIREMENTS • Familiarity with structured and unstructured data approaches • Familiarity with structuring data to serve analytic needs, both for visualizations and data science use cases • Expert experience with rapid ETL tools, including Alteryx/KNIME and Python/R • Strong experience deploying rapid ETLs from PoC to production • Experience with scripted languages such as Powershell, Python, and R in an automation environment • General experience with SQL Server and/or Oracle databases • Strong experience with SQL query writing • Working knowledge of T-SQL and/or PL/SQL • Expert experience with data analysis and troubleshooting • Basic statistics knowledge • Some experience with Power BI and/or Tableau • Strong experience with Microsoft Excel for basic ad hoc data purposes as well as as a data source • Some experience using pretrained GenAI tools for code acceleration • Experience with software testing including unit, integration, and regression testing • Experience with technical writing for SDLC documentation Project Management • Experience working within a Solution Delivery Lifecycle Management framework • Experience with Agile and familiarity with Waterfall development methodologies • Ability to self-manage targeted projects, and create and delegate tasks