Data Engineering Lead and Data Engineers

Call us 609-945-2590 410 Wall St. Princeton, NJ 08540 support@alltechconsultinginc.com Login / Register Login to Alltech Consulting Services reset form Reset Password Please Enter Username or Email Create a free Alltech Consulting Services account Already have an account? Login heading Data Engineering Lead and Data Engineers Ottawa January 22, 2025 Contract Apply Now email apply form here Apply for this job Apply with login Please login as "Candidate" to apply Back to jobs Main content job description Job Description Must Have: Snowflake Databricks SQL Python ADF PySpark Data Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise in understanding Banking and Capital markets , especially in investment banking would be a big plus. Strong Database fundamentals is a must along with PySpark Coding expertise. Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data. Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling. Proficient in developing programs in Python and SQL Experience with Data warehouse Dimensional data modeling. Working with event based/streaming technologies to ingest and process data. Working with structured, semi structured and unstructured data. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions. Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process. Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards. Skills: 5+ years Python coding experience. 5+ years – SQL Server based development of large datasets 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark. Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake. Experience in Data warehousing – OLTP, OLAP, Dimensions, Facts, and Data modeling. Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills. Experience with Cloud based data architectures, messaging, and analytics. Cloud certification(s). Strong experience in Code Optimizations and Performance tuning Apply Now email apply form here Apply for this job Apply with login Please login as "Candidate" to apply job social Share this post Facebook Twitter LinkedIn Email job releated Related Jobs Senior Project Manager United States JPC-1702 Contract #post-## Senior Consultant United States JPC-1701 Contract #post-## Technical Project Manager Alpharetta - GA JPC-1699 Contract #post-## Job Overview Job ID JPC-559 Date Posted January 22, 2025 Location Ottawa Expiration date -- Experience 4-6 Years Qualification Bachelor Degree Job Location Job Skills Cloud Data Management Data Modelling Data Warehousing design PySpark Python Snowflake SQL #post-## .site-main .content-area .site-content Alltech Consulting Services 410 Wall St. Princeton, NJ 08540 609-945-2590 609-430-0133 CLIENT Why Alltech Services Expertise CANDIDATES Why Alltech View Jobs Submit Resume Recruitment Referral Program COMPANY About Us Contact Us Careers Privacy Policy Terms of Service Cookie Policy © Copyright Alltech Consulting Services, 2022. All rights reserved. .site WP Job Board Pro Structured Data