Source description
About the role
Requisition Number: Senior Data Engineer Location: This is a hybrid opportunity in Delhi NCR, Bangalore, Hyderabad, Gurugram area. Insight at a Glance - 14,000+ engaged teammates globally with operations in 25 countries across the globe. - Received 35+ industry and partner awards in the past year - $9.2 billion in revenue - #20 on Fortunes World's Best Workplaces list - #14 on Forbes World's Best Employers in IT 2023 - #23 on Forbes Best Employers for Women in IT- 2023 - $1.4M+ total charitable contributions in 2023 by Insight globally Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organisations through complex digital decisions. About the role We are looking for a Senior Data Engineer to design and build scalable data pipelines on GCP. You will be responsible for replacing end-of-life legacy ETL tools with up-to-date cloud frameworks and building the core data models that power analytics and reporting. Key Responsibilities: - Pipeline Development: Design and implement GCP-based ETL/ELT pipelines using Cloud Composer, BigQuery, and Dataform to replace legacy Hadoop-stack jobs - Data Modeling: Build core data models (Silver and Gold Layers) in BigQuery for downstream analytics and reporting - Governance Implementation: Ensure data quality and governance by implementing Dataplex, Data Validation Tools (DVT), and automated quality checks - Migration Execution: Perform large-scale historical data migrations from on-prem Oracle/MySQL to BigQuery and Cloud SQL - CI/CD: Develop and implement CI/CD pipelines for all data transformation jobs using GitHub Actions - Be AmbITious: This opportunity is not just about what you do today but also about where you can go tomorrow. When you bring your hunger, heart, and harmony to Insight, your potential will be met with continuous opportunities to upskill, earn promotions, and elevate your career. What were looking for - Bachelors degree in a related field - Minimum of 5-8 years of relevant experience - Key Technical SkillsGCP Data Stack: BigQuery, Cloud Composer, Cloud SQL, Dataplex.Transformation: DBT,Dataform, SQL (Advanced), Python, Dataproc.Legacy Migration: Ability to read Oozie/Pig/Hive and proprietary ETL configurations.DevOps: GitHub Actions, Terraform (basic), Docker. What you can expect Were legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include: - Freedom to work from another locationeven an international destinationfor up to 30 consecutive calendar days per year. - Medical Insurance - Health Benefits - Professional Development: Learning Platform and Certificate Reimbursement - Shift Allowance But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities. Join us today, your ambITious journey starts here. When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process. At Insight, we celebrate diversity of skills and experience so even if you dont feel like your skills are a perfect match - we still want to hear from you! Today's talent leads tomorrow's success. Learn more about Insight: Insight does not accept unsolicited resumes from recruiters or employment agencies. Unsolicited resumes will be treated as direct applications from the candidate, and recruiters or agencies who submit candidates for this position without a prior, written vendor agreement will not be eligible for any form of compensation, even if the candidate is hired. .
More at Insight Enterprises