Senior Data Engineer

Role- Senior Data Engineer Duration- 6 Months Location- Remote Required Skills- 6-10 years of successful Data Warehouse, Data Lake, or Big Data implementation experience required - 3+ years of cloud-based data management technology implementation and maintenance experience required (e.g., AWS S3, Lambda, Glue ETL, Redshift, Snowflake, etc.) - Proficient in Python and SQL Job Description Title: IT Data Engineer Senior Job Code: 007441 Department: Information Technology Sub Function: Data Solutions FLSA Status: Exempt Reports to: Senior Manager Data Engineering Effective Date: October 2022 Positions Supervised: None No. Dir Reports: 0 Peer or Similar Roles: BI Engineer Sr, Data Operations Engineer Sr, Data Reliability Engineer Sr, Data Quality Engineer Sr PURPOSE: The IT Data Engineer Senior role is responsible for creating and maintaining an enterprise data platform leveraged to drive data-driven decision making across the business, as well as contribute to projects and initiatives within the Data Services – Data Engineering team necessary to support data integrations across business systems. This role is accountable for developing and implementing data pipelines to ingest raw data into the enterprise data platform from a variety of source systems and transforming and preparing the raw data for consumption through data visualization, reporting and advanced analytics tools, and APIs for data sharing and integrations. The Data Engineer Senior role achieves team and individual goals that align with broader IT goals and support the achievement of UNFI’s strategic imperatives. JOB RESPONSIBILITIES: • Architects, designs, and builds data pipelines for cloud-based enterprise data platform and ensures appropriate documentation and artifacts exist for ongoing maintenance and operation activities • Analyzes source databases for data acquisition, integration, and extraction • Assembles large, complex data sets to meet functional and non-functional business requirements • Implements data engineering and data management best practices and executes on continuous improvement initiatives for enterprise data management • Triages and communicates issues impacting data pipelines, project execution, and solution delivery • Collaborates with application development and database administration teams on data management standards, data acquisition, and data ingestion into enterprise data platform • Adheres to department standards, guidelines, and data engineering methodologies for all assigned tasks and mentors others in their use • Understands project management methodology and leads resource planning, estimation, and responsibility assignment processes • Stays abreast of emerging technologies and trends in Data Management, Data Engineering, and Advanced Analytics disciplines to drive innovation into the organization 80% Leadership & Coaching • Mentors and coaches junior data engineers in technical best practices and proper documentation techniques • Leads and guides other team members in data solutioning and problem-solving activities 20% • Performs other duties as assigned POSITION DESCRIPTION 2 Revised 06.2021 JOB REQUIREMENTS: Education/ Certifications: (Required/Preferred-list requirement is required or preferred) • Bachelor’s degree in the field of data science, computer science, information systems, or software engineering, or equivalent work-related experience required Experience: • 6-10 years of successful Data Warehouse, Data Lake, or Big Data implementation experience required • 3+ years of cloud-based data management technology implementation and maintenance experience required (e.g., AWS S3, Lambda, Glue ETL, Redshift, Snowflake, etc.) • Proficient in Python and SQL • Possesses expert knowledge of data design, coding, unit testing and documentation Knowledge: • In-depth knowledge of data engineering, data warehousing principles, ETL processes, business intelligence and reporting standards, and cloud-based technologies to support these areas • In-depth knowledge of data stream processing, message queuing, and highly scalable data stores for big data • Strong knowledge of workflow orchestration, workflow performance, scaling, and optimization • Strong knowledge of data security and privacy principals • Strong knowledge of Wholesale, Retail, Transportation, Distribution or Manufacturing industry preferred • Strong knowledge of Agile/iterative SDLC methodology Skills/ Abilities: • Excellent written and verbal communication skills, strong customer focus and interpersonal skills, with the demonstrated ability to work in geographically dispersed teams • Ability to manage competing priorities • Ability to apply logical thought process and learn new systems, concepts, and procedures • Demonstrate strong critical thinking, analytical, and conceptual skills used to define technical needs and solve technical problems -- ---- Thanks & Regards, Tejash - Technical Recruiter Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6304918494 EXTN: 157 Email :tejash@thoughtwavesoft.com Website:www.thoughtwavesoft.com https://www.linkedin.com/in/tejash-chettipalli-342aa2246