Lead Data Engineer

For the Lead Data Engineer they need Lead exp. SQL Server and solid Python. This is a full-time hands-on Lead role.

3 days on-site

The JD is for a sr. data engineer. You can use this JD, but add Lead or managerial exp.

Job Title: Data Engineer

COMPANY OVERVIEW:

Bethlehem Shared Services provides professional services exclusively for Cigars International, CIGAR.com, Pipes & Cigars, Thompson Cigar, Meier & Dutch, Cigarbid.com and its affiliates. We are the

fastest growing cigar company in the country, and leading online and direct marketer of fine cigars, premium pipe tobaccos, luxury gifts and accessories, and more.

Our Headquarters is in the heart of the Lehigh Valley in historic Bethlehem, PA. While our roots are in direct marketing, we have a strong eCommerce and growing brick and mortar retail presence. We

have three (3) Retail locations in Pennsylvania, two (2) in Texas, two (2) in Florida and soon to be more.

POSITION DESCRIPTION :

The Data Engineer ensures that the infrastructure handles diverse sources of data seamlessly, understands data analysis, end-user requirements analysis, and business requirements analysis to develop a

clear understanding of the business needs and to incorporate these needs into technical solutions. S/he will design, develop, and maintain data pipelines, integrate with new technologies, and oversee

the development of new data managed processes that support key customer facing functions. This role will ensure data pipelines are scalable, repeatable, and secure, and can serve multiple business

units within the organization. You will facilitate data collection and movement between a variety of different sources, analyze data from the various sources and produce meaningful reports and/or

presentations. Delivery from this team will be not only on delivering business value but also about reliability, agility, and scalability.

PRIMARY RESPONSIBILITIES :

Implement data integration projects, including writing Python and Powershell scripts for data integration and analysis.

Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.

Analyze, transform, and prepare data for large scale migration projects.

Identify and work on master data consolidation and management as part of data migration.

Develop automated workflows to perform data migrations using both on-premises and cloud-based technologies

Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines to support numerous business needs.

Produce scalable, replicable code and solutions that help automate repetitive data management tasks.

Perform one-off data manipulation and analysis

Implement and monitor best in class security measures with an eye towards the evolving threat landscape.

Design robust integration solution error handling, monitoring, and reporting ensuring early detection and resolution of issues.

Perform in-depth data analysis to validate system behavior, identify problems, and support business users

Collaborate with application and IT system administration teams as required and make recommendations on SQL Server sizing and configuration, database design and features, or T-SQL query tuning/best practices

REQUIRED SKILLS/EXPERIENCE:

Bachelor's degree in computer science, computer engineering, or similar technical discipline or equivalent work experience.

Candidates without an Intermediate+ proficiency with Python, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes will not

be considered

Experience and high proficiency in

Microsoft SQL Server

T-SQL query language

Python Programming Language a must

SQL Server Management Studio (SSMS)

JSON and XML

Azure Data Bricks / Azure Data Factory is a plus

PowerShell is a plus

2+ years of experience on MS SQL Server, writing complex stored procedures and functions and working on ETL pipelines.

Excellent communication skills

Strong logical, analytical, and problem-solving skills

Can work in a fast paced, ever-changing environment with a growth mindset

Proven experience working hands-on with big data systems.

Experience in master data management for large scale implementations

Experience in working on data migration projects with large data sets

Release management (Git, Visual Studio, etc.) is a plus

Advanced level knowledge of relational databases, database structures and modeling, systems design, data management, data warehouse a plus.

Experience with Microsoft Azure a plus.

Benefits

• We value our employees and in addition to our competitive salaries, we offer a competitive benefit package to our talented team members including:

• Comprehensive Health Care, Vision & Dental Plan

• Flexible Spending Account

• Disability Plans

• Basic & Supplemental Life Insurance

• Additional Supplemental Benefits

• Paid Vacation, Paid Time Off (PTO) days, Holidays

• 401(k) Retirement Saving Plan including a generous Company match